Join NVIDIA as an Applied Deep Learning Research Scientist

At NVIDIA, we're on the forefront of technology, developing AI computers that are transforming industries. We are actively seeking Applied Deep Learning Research Scientists to advance the field of deep learning (DL) through innovative research in numerics and systems performance using advanced GPU systems. This role involves cutting-edge research aimed at accelerating DL training and inference, with real-world impact through integration into our hardware (HW) and software (SW) products.

What You'll Do

Numerics: You'll dive into research on low-bit number representations and their impact on neural network inference and training accuracy. This includes adapting to the requirements of current state-of-the-art neural networks and co-designing future architectures and optimizers.

System Performance: Explore various parallelization strategies for large neural networks, both in training and inference stages. Investigate communication patterns, and their performance bottlenecks in extensive GPU systems, focusing on optimizing communication-computation overlaps.

Preferred Qualifications

A strong candidate will have:

• An MS or PhD in Computer Science, Computer Engineering or related fields, or equivalent experience in relevant areas.
• At least 3 years of industry experience with a deep understanding of neural network architectures and optimizers.
• Proficiency in Python, C++, or ideally both.
• For those focused on numerics: experience with training neural networks, particularly Large Language Models (LLMs) and multi-modal models, as well as quantization of neural networks and numerical analysis.
• For those focused on system performance: a background in parallel programming, performance analysis, and understanding of collective communications. Knowledge of GPU computing and CUDA is advantageous but not essential.

Why Join NVIDIA?

NVIDIA is considered one of the most coveted employers in the technology sector. We offer competitive salaries, with potential earnings between $160,000 and $345,000 annually, based on your location, experience, and comparable salaries within the company. Additionally, you will be eligible for equity and a comprehensive benefits package.

We are committed to diversity and inclusion, ensuring our workplace reflects global perspectives. NVIDIA is proud to be an equal opportunity employer, embracing differences in race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, and disability status.

If you are creative, self-driven, and eager to make significant impacts in AI, apply today and help us shape the future at NVIDIA!

Additional Information:

• Company Name: NVIDIA
• Job Title: Applied Deep Learning Research Scientist, Numerics and Systems Performance

NVIDIA accepts applications continuously. Take this opportunity to become part of a team that thrives on innovation and creativity.