Senior Data Engineer

Job Title: Senior Data Engineer
Location: Montreal QC (Hybrid 3 days onsite/week)Job Description:

Technology: Technology works as a strategic partner with Morgan Stanley business units and the world's leading technology companies to redefine how we do business in ever more global, complex, and dynamic financial markets. Morgan Stanley's sizeable investment in technology results in quantitative trading systems, cutting-edge modelling and simulation software, comprehensive risk and security systems, and robust client-relationship capabilities, plus the worldwide infrastructure that forms the backbone of these systems and tools. Our insights, our applications and infrastructure give a competitive edge to clients' businesses—and to our own.
Counterparty Data and Regulatory Technology (CDRT) team has commenced on several strategic initiatives to better our technology and data platform. As a senior data engineer in CDRT, you'll be part of an agile team dedicated to breaking the norm and pushing the limits of innovation. You will be involved in detailed technical design, development and implementation of applications using emerging technology platforms.

Who You Are

Want to be part of cutting edge, high visibility projects and are motivated by delivering world-class solutions on an aggressive schedule
Someone who is not intimidated by challenges; thrives under pressure; is passionate about their craft and focused on delivering exceptional results
Enjoy learning new technologies and raise the bar on your team
Enjoy working with technical and non-technical stakeholders for delivery of software systems
Enjoy working with and managing junior developers

What’s the Role

Collaborating and leading part of a cross-functional Agile team to create and enhance software for data ingestion and entity resolution platform
Expertise in application, data and infrastructure architecture disciplines
Working with large, complex data sets from a variety of sources
Participate in the rapid development of user-driven prototypes to identify technical options and inform multiple architectural approaches
Building efficient storage and search functions over structured and unstructured data
Utilizing programming languages Python, Java, Scala, Relational and NoSQL databases
Learning newer technologies for entity resolution such as Quantexa platform

Basic Qualifications

Proven track record of a minimum of 4 years in management, in a space with strong focus on large scale data processing and instrumentation.
Strong coding background, ideally in Java/ Python / Scala
Strong working knowledge of engineering best practices & big data ecosystem.
Experience in at least one big data product: Databricks, Elasticsearch, Snowflake
Experience building batch / real time data pipelines for production systems.
Experience with Relational and Non-Relational DBs like DB2, MongoDB
Experience with various data formats: Parquet, CSV, JSON, XML, Relational Data
Strong familiarity with Kafka, Spark, Hadoop, Iceberg, Airflow, Data Modeling, relational databases, columnar databases
Previous working experience in large scale distributed systems.
Strong familiarity with software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices.
Excellent communication skills, with the ability to effectively collaborate with cross-functional teams and explain technical concepts to non-technical stakeholders.

Desired Qualifications