Join NVIDIA as a Research Scientist in the Generalist Embodied Agent Research (GEAR) Group

NVIDIA is on the lookout for an exceptional research scientist to develop humanoid robot foundation models and systems within our Generalist Embodied Agent Research (GEAR) group. At NVIDIA, we believe that everything that moves will eventually be autonomous. Our mission is to create general-purpose embodied agents capable of mastering complex skills across both virtual and physical worlds.

About the Role

As a member of our team, you will collaborate with an amazing and highly collaborative research team, renowned for producing influential work on multimodal foundation models, large-scale robot learning, game AI, and physical simulation. Our notable projects include Eureka, VIMA, Voyager, MineDojo, MimicPlay, Prismer, and the groundbreaking Project GR00T—a foundation model for humanoid robots.

What You'll Be Doing

• Design and implement advanced AI algorithms and models for general-purpose humanoid robots and embodied agents.
• Develop large-scale AI training and inference methods for foundational models.
• Optimize and deploy AI models in physical simulations and on robotic hardware.
• Collaborate with various research and engineering teams across NVIDIA to transfer research innovations into products and services.

What We Need to See

• Ph.D. in Computer Science/Engineering, Electrical Engineering, or equivalent research experience.
• Outstanding engineering skills in rapid prototyping and model training frameworks (PyTorch, Jax, Tensorflow). Proficiency in Python or C++ is required, while CUDA or ROS proficiencies are a plus.
• Excellent hands-on experience in training LLMs, multimodal foundation models, or large generative models.
• Expertise in foundation and diffusion models, reinforcement learning, agent learning, and applied robotics.

Experience and Skills

Multimodal Foundation Models

• Hands-on training experience and significant publications in topics such as LLMs, large vision-language models, video generative models, and diffusion algorithms.
• Ability to work with large-scale machine learning/AI systems and compute infrastructure.

Robotics

• Experience and publications in robot learning, including reinforcement learning, imitation learning, classical control methods, etc.
• A deep understanding of robot kinematics, dynamics, and sensors.
• Competence in safely operating robot hardware, lab equipment, and tools.
• Knowledge of control methods, such as PID, model predictive control, and whole-body control.
• Familiarity with physics simulation frameworks like MuJoCo and Isaac Sim.
• Experience in robot hardware design and hands-on building.

Why Join Us?

NVIDIA is regarded as one of the technology sector's most desirable employers. Our team is composed of some of the most innovative and productive minds in the industry. Join us and contribute to the forefront of developing general-purpose robots and embodied agents.

The base salary range for this position is $160,000 - $253,000, and your final salary will be determined based on location, experience, and comparable positions. You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees. NVIDIA does not discriminate in hiring or promotion practices based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other legally protected characteristic.

Company Name: NVIDIA
Job Title: Research Scientist, Generalist Embodied Agent Research - New College Grad 2024