Quality Assurance Engineer-III, Prime Video Ads QA
Amazon
Description
Are you passionate about delivering high-quality advertising experiences at scale? Join Amazon's Prime Video Ads QA team, where we ensure seamless ad delivery across millions of customers worldwide. As a Sr. Quality Assurance Engineer, you will:
- Design, develop, and maintain scalable test automation frameworks for Prime Video Ads platform, ensuring high coverage across functional, integration, and end-to-end testing.
- Lead org-level quality initiatives and define QA strategy & test plans across multiple concurrent projects, collaborating with engineering, product, and data science teams.
- Champion AI adoption in test automation — leveraging AI/ML tools to generate test cases, predict risk areas, detect anomalies, and accelerate defect resolution.
- Drive shift-left testing practices by embedding quality early in the software development lifecycle, including requirements review and design validation.
- Mentor and guide junior QA engineers, establishing best practices and quality standards across the team.
- Define and track quality metrics and KPIs, providing data-driven insights to stakeholders on release readiness.
- Partner with data science and ML teams to validate ad delivery algorithms, targeting logic, and measurement accuracy.
- Identify gaps in test coverage and proactively drive improvements to reduce customer-impacting defects.
- Contribute to CI/CD pipelines, ensuring automated tests are integrated and executed efficiently across build and deployment workflows.
Key job responsibilities
- Design, develop, and maintain scalable test automation frameworks for Prime Video Ads platform, ensuring high coverage across functional, integration, and end-to-end testing.
- Develop and maintain E2E automation scripts using TypeScript with Concierge/TREx for real device automation, leveraging a layered architecture (Components → Features → Tests) with VQA for visual validation, Sauron for stream data verification, and integrated reporting via ReportBuilder/TestRail — ensuring robust and maintainable test coverage across VOD, Live Events DAI, Linear DAI, and Interactive Video Ads on Prime Video Living Room devices.
- Lead quality initiatives and define QA strategy across multiple concurrent projects, collaborating with engineering, product, and data science teams.
- Champion AI adoption in test automation — leveraging AI/ML tools to generate test cases, predict risk areas, detect anomalies, and accelerate defect resolution.
- Drive shift-left testing practices by embedding quality early in the software development lifecycle, including requirements review and design validation.
- Mentor and guide junior QA engineers, establishing best practices and quality standards across the team.
- Define and track quality metrics and KPIs, providing data-driven insights to stakeholders on release readiness.
- Partner with data science and ML teams to validate ad delivery algorithms, targeting logic, and measurement accuracy.
- Contribute to CI/CD pipelines, ensuring automated tests are integrated and executed efficiently across build and deployment workflows.
A day in the life
As a Sr. QAE on the Prime Video Ads team, your day involves collaborating with engineers, program and product managers to review requirements, identify risks early, and define test strategies. You'll write and review automation scripts, triage failures in CI/CD pipelines, and leverage AI tools to improve test coverage. You will optimize QA processes using AI adoption. You'll participate in sprint ceremonies, contribute to design reviews, and mentor junior QA engineers. You'll also partner with data science teams to validate ad delivery and measurement accuracy, and present quality metrics to stakeholders to drive release readiness decisions.
About the team
The Prime Video Ads QA team is at the forefront of ensuring seamless and high-quality advertising experiences for millions of customers worldwide. We are a passionate group of quality engineers who thrive on innovation, collaboration, and continuous improvement. Our team works closely with engineering, product, and data science teams to deliver reliable and impactful advertising solutions at scale. We embrace a culture of ownership, where every team member is empowered to drive quality initiatives and make a meaningful impact. We are committed to leveraging AI/ML tools and automation to stay ahead in a fast-paced, ever-evolving landscape.