Join Our Trailblazing AI Team as a Research Inference, Tech Lead at OpenAI

About the Team

The Platform ML team at OpenAI is pivotal in building the machine learning (ML) framework that powers our advanced internal training systems. We specialize in distributed model execution and fine-tuning the interfaces and deployment for model coding, training, and inference processes. Our focus is ensuring high training throughput and optimization of researcher output, striving to expedite advancements towards Artificial General Intelligence (AGI). Collaboration across various teams is routine, as we work to fast-track new capabilities.

About the Role

As an experienced Technical Lead, you will spearhead crucial developments in our proprietary inference stack and play a key role in team expansion. Our focus is on enhancing and adapting the inference stack, crafted by our Applied AI engineering team, to better suit research applications. This role involves:

• Achieving state-of-the-art (SOTA) throughput for key research models.
• Reducing the timeline for efficient inference implementations across new model architectures.
• Partnering closely with the Applied AI engineering team to maximize the utility of our advanced internal inference stack.
• Creating and maintaining a workplace culture that promotes diversity, equity, and inclusion, facilitating open communication and innovation.

Why You'll Thrive Here

Ideal candidates for this role typically have:

• Proven experience in ML systems, especially in high-scale distributed training or inference for contemporary large language models (LLMs).
• A good grasp of the latest AI research and the practical implementation of efficient systems.
• A track record of managing large-scale engineering projects from inception to completion.
• Expertise in core High Performance Computing (HPC) technologies such as InfiniBand, MPI, CUDA, and OpenAI Triton.
• Deep knowledge of GPU/hardware accelerators and networking performance to optimize multi-device inference throughput.
• A humble approach, readiness to assist team members, and a commitment to collective success.

About OpenAI

OpenAI, a leading AI research and deployment company, is committed to developing general-purpose AI that benefits all of humanity. We are pushing the frontiers of AI capabilities and ensuring the safe deployment of these technologies. Our mission is guided by a dedication to safety, inclusivity, and the diverse needs of global communities.

We are proud to be an equal opportunity employer that embraces diversity and inclusiveness in our team. OpenAI does not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status and considers qualified applicants with criminal histories as guided by the San Francisco Fair Chance Ordinance.

Think you're a good fit? Apply now to shape the future of AI with us at OpenAI!