IT Manager - Data & Analytics (Full Time) - Mississauga, ON
Linde Voir toutes les offres
- Mississauga, ON
- 105.500 $ par an
- Permanent
- Temps-plein
- Design and Develop Data Pipelines: Architect, build, and maintain scalable data pipelines leveraging Apache Spark and Microsoft Fabric to process large volumes of structured and unstructured data from diverse sources.
- Data Integration: Integrate data from internal and external sources, ensuring accuracy, consistency, and reliability throughout the data lifecycle.
- Develop and Support reporting needs of the Canadian businesses
- Performance Optimization: Monitor and optimize ETL/ELT processes for performance, scalability, and cost-efficiency, proactively identifying bottlenecks and implementing improvements.
- Data Quality and Governance: Implement best practices for data quality, data cataloging, and lineage, and support governance policies to ensure compliance and high standards.
- Collaboration: Work closely with data scientists, analysts, business stakeholders, and cross-functional IT teams to gather requirements, deliver insights, and support analytical models.
- Documentation: Prepare and maintain detailed documentation for data workflows, pipeline architectures, data schemas, and processes.
- Continuous Improvement: Stay current with emerging trends and technologies in data engineering, suggesting and implementing innovative solutions to enhance the data platform.
- Troubleshooting: Diagnose, debug, and resolve data pipeline and infrastructure issues to ensure robustness and reliability of the data ecosystem.
- Security: Adhere to and enforce data security and privacy guidelines, ensuring sensitive data is handled appropriately.
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
- 5+ years of professional experience in data engineering, data architecture, or a related domain.
- Proven experience working with Apache Spark for large-scale data processing (batch and streaming).
- Hands-on expertise with Microsoft Fabric (formerly Power BI Dataflows, Data Factory within Fabric, or similar cloud-based data integration platforms).
- Strong proficiency in SQL, Python, and/or Scala for data manipulation and ETL development.
- Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud, with a preference for Azure.
- Solid understanding of distributed systems, data warehousing, and data modeling concepts.
- Demonstrated ability to design, implement, and optimize ETL/ELT workflows.
- Knowledge of data governance principles and data quality management.
- Excellent problem-solving skills and meticulous attention to detail.
- Professional certifications in Apache Spark, Azure Data Engineering, or Microsoft Fabric/Power Platform.
- Experience with real-time data processing and streaming frameworks (e.g., Kafka, Azure Event Hubs).
- Knowledge of DevOps practices for data pipelines, including CI/CD, automated testing, and infrastructure as code.
- Experience with data visualization and reporting tools (e.g., Power BI, Tableau).
- Data warehousing experience (design/maintenance/support)
- Minimum 3- 5 years SQL server experience
- Table creation/indexing/job scheduling/programming
- Adhoc reporting for business teams on demand
- Creation of SQL tables feeding PowerBI reports/applications
- Experience in Visual Studio
- Creating and modifying SSIS packages
- Deploying and scheduling SSIS packages to SQL server for scheduling
- IT Business Support
- Managing other IT related projects and providing support to the business teams as required