Abinitio Developer
Diverse Lynx Voir toutes les offres
- Toronto, ON
- Permanent
- Temps-plein
- Design, build, and maintain high-volume ETL (Extract, Transform, Load) processes and data integration pipelines using the Ab Initio suite
- Support enhancements using GDE (Graphical Development Environment) for data transformations (XFR), Join, Rollup, and Reformat components. Create complex XFRs (Transform Functions) and utilize Lookup files, JOIN, Reformat, and Rollup components.
- Optimize ETL graphs and performance-tune data processing, including lookups and in-memory joins. Optimize graph performance by utilizing MFS (Multi-File Systems), data parallelism, and component parallelism.
- Use EME (Enterprise Metadata Environment) commands for code check-in, check-out, and sandbox management. Thorough experience in connectivity with databases using SQL and Ab Initio dbc files.
- Provide ongoing production support for Ab Initio applications, including troubleshooting and resolving any issues that arise.
- Manage and enhance existing Unix shell scripts to automate ETL scheduling, using Autosys
- Develop and tune complex SQL queries for data staging and loading/unloading.
- Analyze data model architecture to understand the underlying data structures and relationships
- Develop and execute unit test cases to verify the accuracy and integrity of ETL processes.
- Perform source-to-target data validation to ensure that the number of records and data values match between the source and target systems
- Work closely with upstream source system owners and downstream data consumers to ensure a smooth and reliable data flow.
- Partner with data architects, business analysts, and other stakeholders to understand requirements and translate them into effective data processing solutions.
- Ab Initio Suite: Expertise in GDE, Co-operating System, EME, BRE (Business Rules Engine), and Data Profiler.
- Environment: Strong command of UNIX/Linux and shell scripting (Korn shell, Bash).
- Database: Proficiency in SQL, Oracle or other relational databases.
- Data Technologies: Solid understanding of data warehousing concepts