Senior Machine Learning Engineer, Runtime & Optimization

Key Skills

C++, Deep Learning, Machine learning techniques, Python Programming, PyTorch, TensorFlow

Job Description

We are looking for engineers with ML software or ML systems expertise to help us improve compute performance on our car. You'll work across the entire ML framework/compiler stack (e.g. JAX, XLA, Triton, and CUDA), as well as system-efficient deep learning models. You will be pleasantly challenged with deploying a hugely diverse set of Waymo ML models on limited computation resources. Non-exhaustive examples of the types of work you will work on:

• Collaborate with ML practitioners on models for perception, behavior prediction and planner, to understand their models and modify model architectures to run faster on the car.
• Deep dive into the whole stack of ML software stack, from custom ops, framework/ ML compiler, to low level libraries. Analyze numeric behaviors. Make sure inference results are stable and consistent across multi-devices. Develop tools/system software for optimal resource usage, hardware efficiency, and platform reliability in a ML serving system.
• Analyze the ML workload performance; Apply model optimization and efficient deep learning techniques to models; Develop highly optimized ML operator libraries.
• Build tools to benchmark, optimize and productize deep learning models for a streamlined and robust onboard and offboard deployment.

At a minimum, we'd like you to have:

• Sc in Computer Science, Mathematics or a related field
• 3+ years of industry experience
• Strong C++ programming skills
• Experience in developing on or using deep learning frameworks (e.g., PyTorch, TensorFlow, ONNX, etc.)
• Passion for developing and optimizing ML software stacks for modern ML accelerator architectures (framework, runtime library, ML compiler, efficient deep learning etc.)
• Working knowledge on system performance, GPU optimization or ML compiler

It's preferred if you have one of the following:

• Sc or PhD in Computer Science, Mathematics or a related field.
• Strong Python programming skills.
• Strong experience with efficient deep learning and/or model optimization techniques such as quantization, NAS, distillation.
• Solid experience with designing, training and debugging deep learning models to achieve the highest scores/accuracies.
• In-depth knowledge of ML frameworks, ML compiler and IRs (Triton, HLO, MLIR, Relay) or modern ML system architectures.

LI-Hybrid

The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

Salary Range

$192,000—$243,000 USD