Senior Software Engineer, ML Deployment Tools

Key Skills

C++, Debugging, Deep Learning, Machine learning techniques, Optimization, Python Programming, PyTorch, Software Development, TensorFlow, TensorRT

Job Description

We're Cruise, a self-driving service designed for the cities we love.

We’re building the world’s most advanced self-driving vehicles to safely connect people to the places, things, and experiences they care about. We believe self-driving vehicles will help save lives, reshape cities, give back time in transit, and restore freedom of movement for many.

In our cars, you’re free to be yourself. It’s the same here at Cruise. We’re creating a culture that values the experiences and contributions of all of the unique individuals who collectively make up Cruise, so that every employee can do their best work.

Cruise is committed to building a diverse, equitable, and inclusive environment, both in our workplace and in our products. If you are looking to play a part in making a positive impact in the world by advancing the revolutionary work of self-driving cars, come join us. Even if you might not meet every requirement, we strongly encourage you to apply. You might just be the right candidate for us.

Cruise is looking for Sr. Software Engineer, ML Deployment Tools to help us build tools and workflows that fully automate ML deployment at Cruise. Our ML deployment process maps models developed in high level ML frameworks (e.g. PyTorch) to binaries optimized for the resource constrained heterogeneous compute platforms on our cars. This is a unique opportunity to build tools that play a significantly visible role in commercial scaling of AV products.!

In this position, you will be working closely with AV ML engineering teams such as perception/prediction/planning & controls as customers of your tools. You will also be working closely with our ML compiler team to implement application/tool specific passes in the compiler infrastructure, and contribute to building tools used in the model deployment process - such as linters, debuggers, performance models, parity checkers etc..

If you are looking to solve one of today’s most complex engineering challenges, see the results of your work contributing to building the world’s most advanced, self-driving vehicles to safely connect people to the places, things, and experiences they care about and make a positive impact in the world starting in our cities, let's chat!

What you’ll be doing:

• Analyze, understand and articulate the engineering requirements of preparing high level ML models (PyTorch) for predictable, high quality AV stack integration and deployment.
• Introduce innovative tools and techniques into our ML deployment workflow.
• Design and implement highly reliable, maintainable, extensible, scalable software components that can be released into production.
• Participate and lead in full SDLC and standard software engineering practices, including testing and root-causing issues across the full software stack (including 3P and in-house tools)
• Lead discussions with 3P vendors (incl. open source communities and closed source support teams) to get issues resolved and to get new enhancements per Cruise roadmap priorities.

What you must have:

• Strong expertise in writing production quality C++ code
• You are comfortable and experienced in software development life cycle - coding, debugging, optimization, testing, integration
• You have experience with deep learning and deep learning frameworks (e.g., PyTorch, TensorFlow, etc) and software stack (e.g., TensorRT, MLIR, TVM, XLA etc).
• You have a BS, or higher degree, in CS/CE/EE, or equivalent, in industry experience

Bonus points!

• 1-2 years experience in writing compiler passes (such as PyTorch, Onnx, MLIR, LLVM etc)
• 2+ years of experience in developing, maintaining and supporting tool developer APIs across different tool applications.
• Experience in design review and merging into community maintained open source code.
• Thrive in a fast paced environment
• Able to work in a diverse, cross-collaborative environment

The salary range for this position is $163,200 - $240,000. Compensation will vary depending on location, job-related knowledge, skills, and experience. You may also be offered a bonus, restricted stock units, and benefits. These ranges are subject to change.

Why Cruise?

Our benefits are here to support the whole you:

• Competitive salary and benefits
• 401(k) Cruise matching program