Job DescriptionWhat's the opportunity?We are seeking a Lead Data and AI Quality Engineering to join our Risk and Compliance team and take ownership of quality assurance for AI and Non-Financial Risk Reporting initiatives. This role combines strategic test planning with hands-on automation and manual testing expertise to ensure the delivery of robust, high-quality solutions that meet regulatory and compliance standards.What will you do?Ensures that products being built and processes being used adhere to all standards and requirements. Applies extensive, in-depth knowledge, skills, and practices to perform complex assignments.Test Strategy & PlanningDesign and implement comprehensive test strategies aligned with risk, compliance, and regulatory requirementsDefine test scope, acceptance criteria, and quality gates for AI and risk reporting solutionsCollaborate with Risk and Compliance stakeholders to understand requirements and translate them into testable specificationsIdentify quality risks and develop mitigation plans in alignment with compliance frameworksApplication Development & TestingDesign and code application programs for testing purposes, including test utilities and quality assurance toolsPerform comprehensive testing for developed applications, including functional, integration, and system-level testingValidate system performance and reliability across Risk and Compliance workflowsProven expertise building production server applications (APIs, microservices, backends)AI Code Agent TestingDesign and execute comprehensive test strategies for AI code agents and autonomous systemsTest AI code agents' ability to generate, review, and validate code across risk and compliance applicationsPerform edge case testing and failure scenario analysis for AI agent decision-making processesEvaluate AI agent performance metrics, including accuracy rates, false positives, and code quality standardsDatabase & Data ModelingValidate database schemas, data models, and data integrity for risk and compliance reporting systemsDesign and execute SQL queries to test data consistency, accuracy, and completeness across databasesTest AutomationDevelop and maintain scalable, automated test frameworks and test suites using extensive Python expertiseLeverage Python libraries (pytest, requests, django, fastapi) for comprehensive test coverageExecute automated tests as part of CI/CD pipelines and regression testing cyclesWhat you need to succeed?Must HavesExtensive Python proficiency with 5+ years of hands-on development experienceAdvanced Python expertise including OOP principles, design patterns, async programming, and advanced data structuresStrong software development background with experience in designing, coding, and debugging applicationsHands-on experience testing AI models and machine learning systemsExperience designing and testing AI code agents, autonomous systems, or LLM-powered applicationsDemonstrated expertise in Large Language Model (LLM) testing, including prompt engineering, output validation, and hallucination detectionExperience testing Model Context Protocol (MCP) implementations and integrationsKnowledge of relational and non-relational databases (e.g., Oracle, SQL Server, PostgreSQL, MongoDB)Solid understanding of DevOps practices and containerizationProficiency with Git and GitHub Actions for CI/CD pipeline automation and workflow orchestrationNice to haveSoftware development certifications or advanced programming credentialsExperience with data governance, data quality frameworks, and metadata managementExperience with AI agent frameworks and orchestration toolsKnowledge of Infrastructure as Code (IaC) and containerization best practicesWhat’s in it for you?We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicableLeaders who support your development through coaching and managing opportunitiesAbility to make a difference and lasting impact.Work in a dynamic, collaborative, progressive, and high-performing teamA world-class training program in financial servicesOpportunities to do challenging workOpportunities to take on progressively greater accountabilitiesAccess to a variety of job opportunities across business and geographies#LI-ASPost#TECHPJJob Skills Application Testing, Decision Making, Detail-Oriented, Group Problem Solving, IT Quality Assurance, Long Term Planning, Predictive Analytics, Programming Languages, Software Product Testing, Test AutomationAdditional Job DetailsAddress: RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTOCity: TorontoCountry: CanadaWork hours/week: 37.5Employment Type: Full timePlatform: TECHNOLOGY AND OPERATIONSJob Type: RegularPay Type: SalariedPosted Date: 2026-04-15Application Deadline: 2026-05-13Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date aboveOur Employment OpportunitiesAt RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.Join our Talent CommunityStay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at .RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.
