Senior/Staff Machine Learning Validation Data Scientist - Perception

Job expired!
You will be part of a team building state-of-the-art AI solutions for Zoox's autonomous driving Perception stack. A member of the Perception team, you will be a part of the "eyes and ears" of Zoox's autonomous driving stack, deploying advanced AI solutions to ensure safe and effective driving. In this role, you will design and build systems to validate models on large (PBs) multimodal data. Your work will massively impact the shipping of high-performance ML models by ensuring robust and comprehensive evaluation pipelines for safe and effective driving behavior. Think you can create the best machine learning systems on the planet? Come join us! Responsibilities - Develop and evangelize our strategy for data development and model evaluation metrics for safe and effective autonomous driving, including defining success criteria for ML model deployment. - Analyze and interpret validation outcomes to provide recommendations for improving ML models. - Support data-centric AI by: - Building a framework for measuring, reporting, and iterating on label quality improvements - Define data labeling strategies to evaluate PCP performance for upcoming milestones - Explore and visualize data to identify data distribution impacts to ML model performance when deployed in the real world - Define key performance metrics to help Perception engineers measure the impact of the new features they're developing on the end-to-end driving behavior. - Stay up-to-date with the latest developments in machine learning validation techniques and best practices for perception in autonomous vehicles. Qualifications - Bachelor's, Master's, or Ph.D. in CS, statistics, mathematics, or related fields - Experience in Bayesian statistics, parametric, and non-parametric statistics - Experience designing and building evaluation systems for classical and deep-learning models - Strong understanding of statistical analysis, experimental design, and hypothesis testing, including parametric & non-parametric testing - Advanced knowledge of data visualization techniques - Experience handling big data, including exposure to distributed data or compute, e.g., Hadoop, Spark, Hive, MapReduce, Databricks - Proficiency with Python-based data and statistics frameworks, e.g., numpy, scipy, pandas, statsmodels, and data visualization tools, e.g., Matplotlib, Plotly - Experience with data query languages and common databases, e.g., SQL, NoSQL, Databases Bonus Qualifications - Experience building or evaluating ML models that operate on raw sensor data (detection, classification, tracking) - Experience with ethical AI validation - Experience incorporating ML validation into MLOps frameworks and automation - Experience using and/or building RESTful APIs - Experience with dashboarding or front-end tools, e.g., Looker, Tableau, Dash, Streamlit, ReDash - Experience with C++, JavaScript Compensation There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. The salary ranges from $211,000-$300,000. A sign-on bonus may form part of the compensation package. Compensation varies based on geographic location, job-related knowledge, skills, and experience. Zoox offers comprehensive benefits, including paid time off, unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance. Vaccine Mandate Employees in this position will be required to have a vaccine approved by the U.S. FDA and/or the WHO. Besides, eligible employees for a COVID-19 booster vaccine ("Booster") will need to get a Booster. Employees would need to show proof of vaccination status upon receiving a conditional offer of employment. About Zoox Zoox is developing the first fully autonomous vehicle fleet and the supporting ecosystem to bring this technology to the market. At the intersection of robotics, machine learning, and design, Zoox aims to deliver the next generation of mobility-as-a-service in urban environments. We're looking for top talent that's passionate about our mission and joining a fast-moving, highly execution-oriented team. A Final Note: You don't need to match every listed expectation to apply for this position. Here at Zoox, we believe diverse perspectives spark the innovation we need to succeed. We are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.