Senior QA API AI Automation Engineer
Direct IT Recruiting Voir toutes les offres
- Toronto, ON
- Permanent
- Temps-plein
- Own the end-to-end API automation strategy and framework architecture across microservices and distributed systems.
- Build advanced API automation using Playwright (API), Cypress (API), RestAssured,Postman/Newman, and Karate.
- Design and automate AI/LLM test use cases to validate response quality, correctness, consistency, determinism, and safety.
- Build API-level automated tests for LLM prompt handling, structured outputs (JSON), error scenarios, and edge cases.
- Implement contract testing, schema validation, negative testing, and API security testing.
- Integrate automation into CI/CD pipelines (Jenkins, GitHub Actions, Azure DevOps) and drive shift-left quality practices.
- Use service virtualization and mocking tools (Parasoft, WireMock) to stabilize environments and accelerate delivery.
- Improve automation stability, reduce flakiness, and define quality KPIs and reporting metrics.
- Provide technical leadership, mentorship, and code reviews across automation initiatives.
- Hands-on expertise with Parasoft SOAtest and Parasoft Virtualize to design, build, and maintain enterprise-grade API automation frameworks.
- Implement service virtualization to simulate complex backend systems, third-party services, and AI dependencies, enabling early and stable testing.
- Design and enforce API contracts, schema validation, and data-driven tests using Parasoft.
- Integrate Parasoft test suites into CI/CD pipelines and leverage dashboards to track coverage, execution health, and quality KPIs.
- Collaborate with security, architecture, and DevOps teams to align Parasoft usage with enterprise governance standards.
- Provide best-practice guidance and technical leadership on scalable Parasoft adoption.
- 8-12 years of QA and automation experience, including 4-6 years in a senior or staff-level role.
- Deep expertise with API automation frameworks and strategies.
- Strong programming skills in Java, JavaScript/TypeScript, Python, or C#.
- Hands-on expertise with Playwright, Cypress, RestAssured, Karate, and Postman/Newman.
- Strong experience with CI/CD pipelines, microservices, Git, cloud platforms, and containerization.
- Proven hands-on experience with Parasoft SOAtest and Parasoft Virtualize.
- Experience testing AI- and LLM-powered APIs and validating response quality and correctness.
- Familiarity with AI quality risks such as hallucinations, non-deterministic outputs, bias, and response drift.
- Experience validating structured AI outputs (JSON, schemas, contracts).
- Contract testing (Pact) and performance testing (JMeter, Gatling, k6).
- API security testing and advanced service virtualization experience.
- Demonstrated mentorship and technical leadership experience.