Job Description
Specialists design, test, and deploy Machine Learning and Generative AI models to improve issue detection, triage, and quality assurance for autonomous vehicles. They leverage AI-powered insights and triage signals to identify emerging trends, risk scenarios, and edge cases. Specialists refine data strategies with ML model outputs to monitor issues proactively. Roles define policies, SOPs, and guidelines integrating AI into vendor workflows for seamless adoption.
Waymo operates as an autonomous driving technology company founded in 2009 from the Google Self-Driving Car project. The company advances the Waymo Driver to enhance mobility and cut traffic crash deaths saving thousands. Waymo Driver supports ride-hail services and vehicle platforms, delivering over 10 million rider-only trips. Fleet has over 100 million public road miles driven autonomously plus tens of billions in simulation across 15 U.S. states. Software Quality Operations team builds scalable AI-powered operation for deployment insights safely.
Specialists serve as links between AI/ML development and execution, creating policy updates for scopes, platforms, signals. They implement quality controls for human and AI outputs through meta-quality checks. Specialists validate vendor work, offer feedback to enhance performance. Subjects matter experts consult stakeholders, escalate tool issues, provide requirements to engineering, conduct user testing. Flexible schedules include weekends and holidays. Teams use proprietary tools, SQL queries, LLM/transformer models, robotics ML.
The base salary range is $120,000 to $151,000 USD. Compensation includes discretionary annual bonus, equity incentive plan, generous benefits. Full-time across US locations with on-site needs as needed. Benefits cover health insurance, paid holidays, professional training. Environment requires judgment in fast-paced settings, collaboration in diverse teams. Learning focuses on new concepts, tools for autonomous vehicle quality.
Responsibilities
- Partner with Engineering to design, test, and deploy Machine Learning (ML) and Generative AI (Gen-Ai) models and tools
- Leverage AI-powered insights and traditional triage signals to proactively identify issues
- Develop and refine data-driven strategies for issue discovery and monitoring
- Define and document policies, guidelines, and SOPs that integrate AI tools into workflows
- Design and implement quality control processes for human and AI-generated outputs
- Perform meta-quality checks, validate vendor work, provide feedback to improve performance
- Act as subject matter expert for Software Quality Operations
- Consult stakeholders on workflow enhancements and quality
- Provide technical leadership and consultation
- Identify and escalate issues with tools, provide requirements, drive user testing
Requirements
- BS/BA degree or 4 years of relevant work experience in AV Software Quality Operations
- Increased competency in supporting all phases of the machine learning development lifecycle
- Experience with ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance evaluation using statistical metrics
- Ability to quickly learn and implement new concepts and utilize proprietary tools
- Strong understanding of driving rules and regulations
- Must have the ability to work a flexible schedule, including some weekends and holidays
- Demonstrated strong execution with ability to drive outcomes preferred
- Experience working with offshore teams / multiple local operations hubs preferred
- Basic SQL querying preferred
- Competency in LLM / transformer models, and / or ML for robotics domain experience preferred
- A greater focus on using subject matter expertise for results analysis and direct customer consultation in developing solutions preferred
- Self-motivated with basic skills in task planning and time management preferred