Big Data Developer/Data Engineer

Artech Information Systems Voir toutes les offres

  • Toronto, ON
  • Contrat
  • Temps-plein
  • Il y a 22 jours
Job Title: Big Data Developer/Data Engineer
Location: Toronto, Ontario
Duration: 6 MonthsIntroductionJoin a dynamic team working with cutting-edge Big Data technologies to design, develop, and maintain data ingestion flows and platforms. This role offers an opportunity to work within an Agile cross-functional team and contribute to innovative data solutions.Required Skills & Qualifications
  • 5 years of experience with Big Data technologies used for ETL such as Hadoop, Spark, and Hive.
  • Proficiency in the Snowflake Platform.
  • Strong SQL skills and knowledge of data modeling.
  • Programming experience with Scala or Java and API development.
  • Experience with ETL tools (e.g., Informatica, Talend, Apache Airflow).
  • Familiarity with cloud platforms, preferably AWS.
  • Knowledge of Gen AI to generate code and improve developer proficiency.
  • Knowledge of Python or other scripting languages is a plus.
  • Excellent problem-solving and communication skills.
  • Knowledge of SCM, Infrastructure-as-code, and CICD pipelines.
  • Prior work experience in the client's industry.
Preferred Skills & Qualifications
  • Experience with workflow management tools like Apache Airflow.
  • Experience with Continuous Integration tools such as Git Actions, GitHub, Automated Testing tools, Git, or similar tools.
  • Experience with Docker, Kubernetes, Containers, OCP4.
  • Shell scripting.
  • Bachelor's or master's degree in computer science, data engineering, or a related field.
Day-to-Day Responsibilities
  • Design and implement data pipelines, framework, and ETL processes.
  • Ensure data quality, security, and performance.
  • Develop and optimize SQL queries, stored procedures, and views.
  • Integrate Snowflake with other data sources and BI tools.
  • Monitor and troubleshoot data jobs and platform issues.
  • Develop and maintain comprehensive documentation for data pipelines, transformations, and data models.
Company Benefits & Culture
  • Opportunity to work with cutting-edge technologies in a dynamic environment.
  • Collaborative and innovative team culture.
  • Flexible working arrangements with a hybrid model.
For immediate consideration please click APPLY to begin the screening process with Alex.

Artech Information Systems