Description

The Senior Quality Auditor serves as a specialist who becomes the organization's deepest expert on 1-2 complex machine learning data workflows while maintaining hands-on audit execution. This role within the Machine Learning Data Operations job family leads Quality Audit Design (QuAD) teams for high-complexity workflows, handles the most ambiguous audit scenarios, and generates workflow-specific quality analysis that drives customer insights and workflow optimization.

Key job responsibilities
Workflow Expertise Development

- Become the organization's deepest expert on 1-2 assigned complex workflows through intensive pilot participation and continuous learning
- Participate in workflow pilots as an annotator to build foundational knowledge before production begins
- Develop comprehensive understanding of workflow conventions, edge cases, and quality requirements
Team Leadership
- Lead QuAD teams of 3-5 Quality Auditors for Template 2 (High-Engagement Support) workflows
- Provide day-to-day leadership and make real-time quality decisions during iteration phases
- Handle escalations from team members and serve as the go-to expert for workflow-specific questions
- Mentor and develop Quality Auditor team members through coaching, feedback, and knowledge sharing
Audit Execution
- Execute audits on the most ambiguous and complex scenarios, reducing escalations to Quality Specialists
- Maintain 60-70% hands-on audit execution to preserve expertise required for real-time decision-making
- Validate team audit decisions and ensure consistency across QuAD team members
- Support Template 1 workflows by auditing high-complexity scenarios requiring specialized judgment
Analysis & Insights
- Generate workflow-specific deep dives and thematic analysis providing insights beyond conventions adherence scores
- Identify error patterns, convention evolution, and areas of ambiguity within assigned workflows
- Provide actionable recommendations for workflow optimization and quality improvement
- Partner with DSLs and customers on workflow-specific quality insights
Strategic Collaboration
- Provide input to audit strategy design led by Quality Specialist I
- Collaborate with Quality Specialists on cross-workflow patterns and tactical improvements
- Participate in workflow design discussions with customers and stakeholders
- Support new-tool onboarding for operationalized and bootstrapped interfaces
- Track record of generating actionable insights from quality data.