Tech Lead Manager, Machine Learning Infrastructure

Key Skills

Aartificial intelligence, Algorithms, C++, CUDA kernels, Deep Learning, Framework, JAX framework, Machine learning techniques, Natural Language Processing (NLP), NVIDIA Jetson, Python Programming, PyTorch, TensorFlow, TensorRT, Triton

Job Description

Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver™ is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and improve through data, the Nuro Driver™ is one of the few driverless autonomous technologies on public roads today.

Nuro has raised over $2B in capital from Fidelity, Bailie Gifford, T. Rowe Price, Google, and other leading investors. We’ve partnered with some of the world’s most respected brands including Uber, FedEx, Domino’s, Walmart, Kroger, and 7-Eleven.

About the Role

The ML Infra team is growing and we are looking for talented leaders to join us. To support the ML-first software stack of Nuro, our team provides solutions to empower machine learning development in Nuro and optimize on-cloud training and onboard inference. Our solutions include a distributed training platform, ML compiler, model components libraries etc.

We are looking for a tech lead manager to grow the team, lead strategic vision and ML infra team, cross-team alignments with stakeholders, and drive key technology advancement. Your responsibilities:

• Identify and resolve critical bottlenecks in the lifecycle of ML model development and deployment.
• Spearhead research and implementation of advanced ML Infra solutions.
• Develop and execute technical roadmaps.
• Drive adoption of team solutions across ML teams.
• Foster engineering excellence and continuous improvement.
• Provide technical mentorship and drive professional development of team members.

About You

• 6+ years of industry or research experience in ML Infra, distributed training, model inference, or GPU programming.
• Strong expertise in deep learning frameworks (PyTorch, TensorFlow, JAX) and algorithms across CV, NLP, and planning.
• Advanced programming skills in C++/C and Python.
• Excellent communication skills with proven ability to drive technical innovation.

Bonus Points

• Experience with CUDA, Cublas, Cudnn or any other Nvidia SDKs.
• Experience with model quantization or pruning.
• Experience with compilers or ML compilers (e.g. TensorRT, Triton, XLA, Clang).
• Experience with AI algorithms and hardware codesign (e.g. Depthwise Conv, Flash Attention).
• Experience with distributed training speedup (e.g. FSDP, DeepSpeed).

At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $202,000 and $303,000 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.

At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.