AWS Technical Lead - Data & Analytics
Adastra Corporation
- Markham, ON
- Permanent
- Temps-plein
- Design, develop, and maintain scalable ETL pipelines using AWS services such as Glue, Lambda, S3, and Redshift
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data availability and integrity
- Implement and optimize data storage solutions, including data lakes and data warehouses, to support analytics and reporting
- Monitor and troubleshoot data pipelines to ensure continuous and reliable data flow
- Ensure data security and compliance with industry standards and best practices
- Automate data integration and processing tasks using AWS tools like Step Functions, CloudFormation, and others
- Document data flows, data models, and processes for internal use and future reference
- Stay updated with the latest trends and best practices in data engineering and AWS technologies
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. A Master's degree is a plus
- 5+ years of experience in data engineering with a focus on AWS services
- Strong experience with AWS services such as S3, Glue, Lambda, Redshift, DynamoDB, and Athena
- Proficiency in programming languages such as Python, Java, or Scala
- Experience with SQL and NoSQL databases
- Familiarity with data warehousing concepts, ETL processes, and data modeling
- Knowledge of data security, governance, and compliance best practices
- Strong problem-solving skills and attention to detail
- Excellent communication skills, with the ability to collaborate effectively with cross-functional teams
- AWS Certified Data Engineer, or AWS Certified Data Analytics, or AWS Certified Solutions Architect
- Experience with big data tools and technologies like Apache Spark, Hadoop, and Kafka
- Knowledge of CI/CD pipelines and automation tools such as Jenkins or GitLab CI
- Opportunity for advancement and career progression
- Competitive compensation package
- Comprehensive benefits plan
- Successful referral program
- The opportunity to work with one of Canada’s 50 Best Managed Companies
- Satisfaction of working for a reputable company
- A flexible, dynamic, and diverse workplace