Mission Summary:
The Metrics Engine team is responsible for the extraction of data to assess the performance of our av-stack, from the conception of the metric mechanism based on traffic laws, ethics, and safety, to the extraction of necessary information to calculate these metrics from the logs. Apart from evaluating system-level behavior, we also compute metrics to assess subsystems that together contribute to AV system behavior.
As we are generating an increasing amount of metrics at different stages of the development process, our team is seeking a Senior Engineer to analyze the progression of our av-stack performance in regard to those metrics, and highlight key trends. This person will have the opportunity to produce reports and recommendations that are directly relevant to many different teams across the organization, including leadership.
What you’ll be doing:
- Analyze the output of our metric evaluator to provide high-level insights on the progress of our stack
- Communicate with the Testing, Operations, and Autonomy teams to understand their daily analysis needs
- Provide recommendations on how to design experiments to get a stronger signal from the metrics
- Question the results of certain metrics, delve into their formulations and contribute to improving them regularly
What we’re looking for:
- Significant Python coding experience
- MSc in Statistics, Math, Physics, Computer Science or equivalent + 3 years of experience in data science in a tech-heavy industry
- Python/Julia experience in statistical analysis
- Commitment to rigorous analysis - if assumptions need to be made to infer results, they should be articulated
- Ability to communicate clearly to non-domain experts about potentially complex behaviors
- An interest in contributing to the metric formulation and implementation
Bonus points:
- Experience in evaluating human or autonomous driving behavior
- Experience in robotics
The salary range for this role is an estimate based on a broad range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range listed in this job posting reflects base salary only. This role may include additional forms of compensation such as a bonus or company equity. The recruiter assigned to this role can share more information about the specific compensation and benefit details associated with this role during the hiring process.
Candidates for certain positions are eligible to participate in Motional’s benefits program. Motional’s benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more.