Senior Research Engineer at NVIDIA

**Who this is for** This role is for a senior-level research engineer looking to work at the nexus of AI research and systems engineering to push the boundaries

Work type: remote

Location: US, CA, Santa Clara | US, CA, Remote

Salary: $192,000 – $356,500/yr

Type: Full-time

Summary

**Who this is for** This role is for a senior-level research engineer looking to work at the nexus of AI research and systems engineering to push the boundaries of post-training software for generative AI models. **Key highlights** You will directly impact the development of core technologies behind Nemotron models, working on large-scale distributed training, RL algorithms, and optimization recipes to drive performance across the model lifecycle. **You might be a good fit if you...** - Have 6+ years of experience in large-scale model training and distributed computing. - Possess deep expertise in AI frameworks like PyTorch or JAX. - Have hands-on experience with inference stacks like vLLM or TRT-LLM. - Understand GPU/CPU architecture and distributed performance tuning (pipelining, parallelism).

Job Description

Join NVIDIA and help build the software that will define the future of generative AI. We are looking for a research engineer who is passionate about open-source and excited to create our next-generation post-training software stack. You will work at the intersection of research and engineering, collaborating with the Post-Training and Frameworks teams to invent, implement, and scale the core technologies behind our Nemotron models.
 

What you’ll be doing:

• Work with applied researchers to design, implement and test next generation of RL and pos-training algorithms

• Contribute and advance open source by developing [NeMo-RL](https://github.com/NVIDIA-NeMo/RL), [Megatron Core,](https://github.com/NVIDIA/Megatron-LM/tree/main/megatron/core) and NeMo Framework and yet to be announced software

• You will be engaged as part of one team during Nemotron models post-training

• Solve large-scale, end-to-end AI training and inference challenges, spanning the full model lifecycle from initial orchestration, data pre-processing, running of model training and tuning, to model deployment.

• Work at the intersection of computer-architecture, libraries, frameworks, AI applications and the entire software stack.

• Performance tuning and optimizations, model training with mixed precision recipes on next-gen NVIDIA GPU architectures.

• Publish and present your results at academic and industry conferences

• BS, MS or PhD in Computer Science, AI, Applied Math, or related fields or equivalent experience

• 6+ years of proven experience in machine learning, systems, distributed computing, or large-scale model training.

• Experience with AI Frameworks such as Pytorch or JAX

• Experience with at least one inference and deployment environments such as vLLM, SGLang or TRT-LLM

• Proficient in Python programming, software design, debugging, performance analysis, test design and documentation.

• Strong understanding of AI/Deep-Learning fundamentals and their practical applications.

• Contributions to open source deep learning libraries

• Hands-on experience in large-scale AI training, with a deep understanding of core compute system concepts (such as latency/throughput bottlenecks, pipelining, and multiprocessing) and demonstrated excellence in related performance analysis and tuning.

• Expertise in distributed computing, model parallelism, and mixed precision training

• Prior experience with Generative AI techniques applied to LLM and Multi-Modal learning (Text, Image, and Video).

• Knowledge of GPU/CPU architecture and related numerical software.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 192,000 USD - 304,750 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and [benefits](https://www.nvidia.com/en-us/benefits/).

Applications for this job will be accepted at least until April 26, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

View this job on nocollar jobs