Senior Software Engineer, Deep Learning Inference - Windows

Key Skills

Aartificial intelligence, C++, CUDA kernels, Deep Learning, Design, Effective communication skills, GPUs, Machine learning techniques, OpenCL, Python Programming

Job Description

As a Senior Software Engineer in the TensorRT team, you will be responsible for designing and implementing inference optimizations to enable real-time AI applications on personal computing devices with NVIDIA AI accelerators (GPU, DLA). You will work closely with cross-functional teams to integrate and deploy AI solutions in production environments and your expertise will help shape the performance, functionality and efficiency of our AI models and systems. If you're ready to take on challenging projects and make a significant impact in a company that values creativity, excellence, and collaboration, we want to hear from you!

What you’ll be doing:

• Design, implement and optimize TensorRT components to achieve tightly coordinated and responsive Generative AI inference applications for PCs and workstations.

• Develop software in C++, Python, CUDA, and DirectML to accelerate systems that enable seamless and efficient deployment of next-gen AI models.

• Collaborate with deep learning experts and GPU architects throughout the company.

What we need to see:

• BS, MS, PhD or equivalent experience in Computer Science, Computer Engineering or a related field.

• 5+ years of software development experience on a large codebase or project.

• Strong proficiency in C++ and Python programming languages.

• Experience with development of: Deep Learning Frameworks, Compilers, or System Software.

• Foundational knowledge of Machine Learning techniques or GPU optimizations.

• Excellent problem-solving skills and the ability to learn and work effectively in a fast-paced, collaborative environment.

• Strong communication skills and the ability to articulate complex technical concepts.

Ways to stand out from the crowd:

• Experience in developing DirectML backend for GPU or NPU.

• Windows application and middleware development using DirectX or DirectML API.

• Knowledge of GPU programming using CUDA or OpenCL.

• Experience with deploying AI models in production environments.

• Knowledge of additional performance optimization tools and techniques as well as contributions to open-source projects or publications in relevant areas.

The base salary range is 148,000 USD - 276,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.