Join Apple as a Senior Software Engineer in Machine Learning Ops

Company: Apple

Job Title: Machine Learning Ops, Applied Machine Learning

Location: United States

Role Number: 200545290

Weekly Hours: 40

Posted Date: May 6, 2024

Overview

Apple's Applied Machine Learning team is looking for a talented and dedicated Senior Software Engineer to innovate and scale our infrastructure for GenAI applications across cloud environments like AWS and GCP. If you have a passion for leveraging the latest in distributed systems technology and machine learning, come and help us develop Apple-scale platforms and products.

Key Qualifications

• 4+ years of Python programming experience
• Expertise in managing cloud applications on AWS/GCP & Kubernetes
• Strong understanding of model inferencing pipelines, specifically RAG based and GuardRails
• Experience with open-source LLM app frameworks such as LangChain/LlamaIndex
• Familiarity with cloud managed services like AWS BedRock/GCP Vertex AI
• Proficiency in infrastructure as code tools including CloudFormation, Terraform
• Experience with GitOps-based deployment tools such as Spinnaker, Flux, ArgoCD
• In-depth knowledge of Kubernetes management using Helm and Kustomize
• Experience in observability and traceability for Large Language Models
• Advanced problem-solving skills and the ability to manage complex operating system environments like Linux

Role Description

As a Senior Software Engineer, you will:

• Develop LLM applications using frameworks like AWS BedRock/GCP Vertex AI
• Optimize Language Models to enhance performance while reducing operational costs
• Create tools for comparing and benchmarking various embedding databases and LLMs
• Support and improve CI/CD processes for managing and deploying applications on AWS/GCP & Kubernetes
• Design and implement automation for self-healing systems
• Develop multi-tenancy systems ensuring data protection across different use cases
• Troubleshoot complex network, system, and application issues
• Engage in fast-paced and challenging projects delivering innovative solutions to support Apple's business divisions

Education & Experience

Candidates should possess a BS in computer science with at least 4 years of experience or an MS with 2 years of relevant experience.

Additional Requirements

• Experience with LLM infrastructure such as GPUs, TPUs, and Inferentia is a plus
• Familiarity with LLM runtime environments like Triton and frameworks like TensorRT, vLLM is advantageous
• General Java troubleshooting skills are desirable

Pay & Benefits

The salary range for this position is between $138,900 and $256,500, based on skills, qualifications, and experience. Apple offers comprehensive medical and dental coverage, retirement benefits, discounted products, stock purchase options, and tuition reimbursements among other perks. Eligibility for discretionary bonuses, commissions, and relocation may also be available.

Equal Opportunity Employer

Apple is an equal opportunity employer that values diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.