Senior Research Engineer, ML Data Pipelines

Key Skills

AWS, Azure, Data pipelines, Data Visualization, Elasticsearch, Framework, Google Cloud Platform (GCP), JAX framework, Kubernetes-K8s, MySQL, Postgres, Python Programming, PyTorch, REDIS, TensorFlow

Job Description

NVIDIA is searching for a senior or principal engineer who specializes in designing and optimizing large-scale machine learning data pipelines in the Generalist Embodied Agent Research (GEAR) group. Our team is leading Project GR00T, NVIDIA’s moonshot initiative at building foundation models and full-stack technology for humanoid robots.

You will work with an amazing and collaborative research team that consistently produces influential works on multimodal foundation models, large-scale robot learning, embodied AI, and physics simulation. Our past projects include Eureka, VIMA, Voyager, MineDojo, MimicPlay, Prismer, and more. Your contributions will have a significant impact on our research projects and product roadmaps.

What you will be doing:

• Design, implement, and optimize scalable ML data pipelines for training multimodal foundation models;

• Collaborate closely with researchers to preprocess, transform, and manage large datasets for robot model training and evaluation;

• Develop tools for labeling and curating multiple streams of sensor data;

• Continuously monitor robot data collection process and evaluate data quality;

• Implement and optimize PyTorch data loading modules for video processing and robot learning on large GPU clusters.

What we need to see:

• Bachelor's Degree in Computer Science, Robotics, Engineering, or a related field;

• 10+ years of full-time industry experience working with large-scale machine learning data pipelines;

• Proficiency in JavaScript/TypeScript and React for building frontend applications, such as dashboards, visualization, and analysis tools;

• Proficiency in Python data processing libraries. Hands-on model training experience in PyTorch, JAX, or Tensorflow;

• Strong experience with large-scale GPU clusters, HPC environments, and job scheduling/orchestration tools (e.g., SLURM, Kubernetes).

Ways to stand out from the crowd:

• Master’s or PhD’s degree in Computer Science, Robotics, Engineering, or a related field;

• Strong experience with cloud infrastructure management (AWS, Azure, GCP) and data stores (Postgres, MySQL, ElasticSearch, Redis);

• Experience at autonomous driving or robotics companies training machine learning models on massive datasets;

• Demonstrated Tech Lead experience, coordinating a team of engineers and driving projects from conception to deployment.

• Contributions to popular open-source frameworks.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world. Please join us and be part of the forefront of developing general-purpose robots and large-scale foundation models!

The base salary range is 224,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.