About the Company
Lake Erie Data Solutions is a forward-thinking technology firm based in Southwestern Ontario, specializing in cutting-edge data analytics, machine learning, and cloud-native solutions for a diverse client base across Canada and North America. We are committed to fostering innovation, driving digital transformation, and building robust, scalable data platforms. Our team thrives on solving complex challenges and empowering businesses with actionable insights. We believe in investing in top talent from around the globe, providing comprehensive support including visa sponsorship to welcome the best minds to our team.
Job Description
We are seeking a highly skilled and experienced Big Data Architect with a strong focus on Hadoop and Spark ecosystems to design, develop, and implement scalable big data solutions. As a key member of our data engineering team, you will be responsible for architecting high-performance, fault-tolerant, and secure data platforms that support our advanced analytics and machine learning initiatives. This role requires deep expertise in big data technologies, cloud platforms, and a passion for building robust data pipelines. We offer visa sponsorship for qualified international candidates looking to make a significant impact.
Key Responsibilities
- Design and architect scalable, reliable, and secure big data solutions using Hadoop, Spark, and related technologies.
- Develop and optimize data pipelines for ingestion, processing, and storage of large datasets from various sources.
- Lead the selection and implementation of appropriate big data tools and frameworks to meet business requirements.
- Collaborate with data scientists, data engineers, and business stakeholders to understand data needs and translate them into technical solutions.
- Ensure data quality, security, and governance across all big data platforms.
- Provide technical leadership and mentorship to junior engineers.
- Monitor and troubleshoot big data infrastructure, ensuring optimal performance and availability.
- Stay current with emerging big data technologies and industry best practices.
- Develop and maintain comprehensive documentation for data architecture and processes.
Required Skills
- Minimum 5 years of experience in big data architecture and engineering.
- Expertise in Hadoop ecosystem components (HDFS, YARN, Hive, HBase).
- Proficiency in Apache Spark for large-scale data processing.
- Strong programming skills in Scala, Python, or Java.
- Experience with cloud big data services (AWS EMR, Azure HDInsight, Google Cloud Dataproc).
- Solid understanding of SQL and NoSQL databases.
- Experience with data modeling, ETL/ELT processes, and data warehousing principles.
- Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
- Excellent problem-solving, analytical, and communication skills.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Certifications in big data technologies (e.g., Cloudera, AWS, Azure, GCP).
- Experience with streaming technologies like Kafka or Flink.
- Knowledge of data governance and compliance frameworks.
- Previous experience in a lead architect or team lead role.
Perks & Benefits
- Competitive salary and performance-based bonuses.
- Comprehensive health, dental, and vision insurance.
- Generous paid time off and holidays.
- Professional development and training opportunities.
- Relocation assistance and full visa sponsorship.
- Modern office environment with collaborative workspaces.
- Employee wellness programs and initiatives.
- Opportunity to work on challenging and impactful projects.
How to Apply
If you are interested in this position, please click the "Apply Now" button below. To ensure your application is properly considered, please prepare the following:
- An up-to-date Resume or CV
- A brief cover letter summarizing your experience and motivation
Applications are reviewed on a rolling basis. Only shortlisted candidates will be contacted for an interview.
⚠️ Important Disclaimer
Welcome to Courierser Jobs. We publish job opportunities aggregated from public sources, employers, and job portals. We never charge any fees to access or use our website; all information is provided entirely for free.
Courierser Jobs does not directly offer or manage these positions, nor are we directly involved in the hiring process for the vacancies published on https://job.courierser.com.
If you suspect a fraudulent listing or have any questions, please contact us at techturna@gmail.com.