Product Manager, ML Platform: Inference

Job expired!

Job Offer: Product Manager, ML Platform: Inference at Netflix

Netflix is the world's leading entertainment service, boasting 270 million paid memberships across 190+ countries. Our members enjoy TV series, films, and games in numerous genres and languages, with the flexibility to play, pause, and resume viewing anytime and anywhere, plus the ability to change plans anytime.

Leveraging Machine Learning and Artificial Intelligence, Netflix has excelled in personalized recommendations and optimized operations for years. Our Machine Learning Platform (MLP) drives technological innovations and boosts productivity for researchers and engineers by managing all phases of machine learning development, including data processing, training, evaluation, deployment, and operations.

About the Role

We are seeking a highly technical Product Manager to advance data scientist productivity through platform enhancements. Your mission involves crafting a vision for ML inference at Netflix, catering to model producers and consumers. You will collaborate closely with multiple engineering teams to develop solutions for model management, batch, and online inference, particularly focusing on scaling our infrastructure for large, generative models and expanding Netflix's ML footprint to edge computing.

Ideal Candidate Profile

Excellent candidates possess deep product management experience for AI/ML platforms, empathy for both ML practitioners and application engineers, and a robust understanding of ML production and consumption patterns. Familiarity with modern application stacks (cloud computing, microservices, DevOps tools/procedures) and ML-specific inference services (feature stores, model monitoring) is essential. Candidates should demonstrate initiative, strong communication skills, and a proven ability to align diverse teams effectively.

Location

This role is based at our Los Gatos office with a hybrid work model. We are open to remote candidates located on the West Coast of the US, with monthly travel required for remote-based employees.

Primary Responsibilities

  • Build a comprehensive vision for machine learning inference at Netflix, encompassing model management, hosting, and consumption.
  • Engage with a wide range of customers to gather and document requirements clearly. Prioritize roadmaps based on these needs.
  • Drive the execution and adoption of ML Platform’s inference tools across various Netflix stakeholders, including Consumer Engineering, Algorithms Engineering, Studio and Content Engineering, and Data Science teams.
  • Understand Netflix's diverse ML use cases, defining standard personas and tasks for requirements enumeration.
  • Define new support pathways for Generative AI within the ML Platform.
  • Regularly measure success metrics like adoption and developer productivity.
  • Apply technical, organizational, and communication skills to ensure alignment across different groups.
  • Communicate regularly with senior Netflix management and ML practitioners.

Skills and Qualifications

  • 7+ years of technical product management experience.
  • Extensive experience innovating on ML/AI platforms.
  • Deep understanding of ML/AI development workflows and MLOps.
  • Working knowledge of ML tools and inference necessities.
  • Familiarity with modern application patterns, including cloud computing and DevOps.
  • Technical knowledge of inference internals, such as GPU management, auto-scaling, and batching/pipelining.
  • Experience in defining, measuring, and improving developer productivity.
  • Strategic thinking capability and ability to drive a vision for maximum business impact.
  • Demonstrated initiative in clarifying ambiguous projects and driving them to completion.
  • Leadership experience working with engineers, data scientists, and ML practitioners.
  • Exceptional written communication skills to present technical content to non-technical audiences.
  • Ability to partner with various functions to ensure solutions drive significant business impact.

Compensation and Benefits

Our compensation structure consists solely of an annual salary; we do not offer bonuses. You can choose how much of your compensation you prefer in salary versus stock options. Determination of compensation is based on market indicators, job family, background, skills, and experience, with a range of $120,000 to $515,000.

Netflix offers comprehensive benefits, including health plans, mental health support, a 401(k) retirement plan with employer match, stock option programs, disability programs, health savings and flexible spending accounts, family-forming benefits, and life and serious injury benefits. We also provide paid leave programs. Full-time hourly employees accrue 35 days annually for vacations, holidays