Senior Software Engineer, Deep Learning Inference

Key Skills

Analytical and Problem solving, C++, CUDA kernels, Deep Learning, Framework, Generative AI, Linux Operating system, Natural Language Processing (NLP), Python Programming, Unix Operating system

Job Description

At NVIDIA, we're at the forefront of innovation, driving advancements in AI and machine learning to solve some of the world’s most challenging problems. We're seeking talented and motivated engineers to join our TensorRT team in developing the industry-leading deep learning inference software for NVIDIA AI accelerators.

As a Senior Software Engineer in the TensorRT team, you will be responsible for designing and implementing inference optimizations to enable real-time AI applications on personal computing devices with NVIDIA AI accelerators (GPU, DLA). You will work closely with cross-functional teams to integrate and deploy AI solutions in production environments and your expertise will help shape the performance, functionality and efficiency of our AI models and systems. If you're ready to take on challenging projects and make a significant impact in a company that values creativity, excellence, and collaboration, we want to hear from you!

What you’ll be doing:

• Design, implement and optimize TensorRT components to achieve tightly coordinated and responsive Generative AI inference applications for PCs and workstations.

• Develop software in C++, Python, and CUDA to accelerate systems that enable seamless and efficient deployment of next-gen AI models.

• Collaborate with deep learning experts and GPU architects throughout the company.

What we need to see:

• BS, MS, PhD or equivalent experience in Computer Science, Computer Engineering or a related field.

• 5+ years of software development experience on a large codebase or project.

• Strong proficiency in C++ and Python programming languages.

• Experience with development of: Deep Learning Frameworks, Compilers, or System Software.

• Foundational knowledge of Machine Learning techniques or GPU optimizations.

• Excellent problem-solving skills and the ability to learn and work effectively in a fast-paced, collaborative environment.

• Strong communication skills and the ability to articulate complex technical concepts.

Ways to stand out from the crowd:

• Experience in developing inference backends and compilers for GPU or NPU.

• Knowledge of GPU programming using CUDA or OpenCL.

• Experience with deploying AI models in production environments.

• Knowledge of additional performance optimization tools and techniques.

• Windows application, middleware, or driver development.

NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working with us. Do you want to contribute to the deep learning community and help build a state of the art, next generation inference accelerator for the automotive industry? If so, we welcome you to apply. Tell us why you think you might be a great fit for our team, and we'd love to tell you more about what we do.

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.