-
Job Type
Full Time -
Experience
16-18 year -
Salary
$268,000 - $414,000 / Year -
Location
Champaign, IL, USA -
Job Function
-
Industry
Information Technology -
Qualification
Key Skills
Algorithms, Apache Flink, Apache Hadoop, Big Data Technology, C++, CUDA kernels, Data Engineering, Data Lake, Data management, Data science techniques, Effective communication skills, GPUs, Java Programming, Kubernetes-K8s, Machine learning techniques, Scala Programming, SPARK Programming
Job Description
We are seeking experienced Distributed Systems Engineers to accelerate Apache Spark and related frameworks on GPUs. Apache Spark is the most popular distributed data processing engine in data centers. It is used for a wide variety of workloads, from data preparation, feature generation, reporting, analytics, and more. Data scientists spend a considerable amount of time exploring data and iterating over machine learning (ML) experiments. Every hour of compute required to sort through datasets, extract features and fit ML algorithms impedes an efficient business workflow. At NVIDIA, we are passionate about working on hard problems that have an impact. You will work with the open source community to enable Apache Spark data processing with GPUs. Data workflows can benefit tremendously from being accelerated, enabling data scientists to explore many more and larger datasets to achieve their business goals, faster and more efficiently.
What you'll be doing:
- Extending the RAPIDS Accelerator for Apache Spark to work seamlessly with data lake table formats – including Delta Lake, Apache Iceberg, and Apache Hudi
- Benchmarking and optimizing data lake table formats at scale with NVIDIA GPUs
- Optimizing I/O operations on table layout formats and backing stores (distributed filesystems, object stores)
- Engaging open source communities, including Apache Spark, RAPIDS, and for technical discussions and contributions around data lake table formats
- Creating a collection of GPU accelerated libraries for data processing, data analytics and ML for compatibility with data lake table formats
- Working with NVIDIA strategic partners on deploying sophisticated data analytics solutions in public cloud or on-premise clusters
- Presenting technical solutions in industry conferences and meetups
What we need to see:
- BS, MS, or PhD in Computer Science, Computer Engineering, or equivalent experience
- 15+ years of work or research experience in software development
- 5+ years working with key open source big-data projects as a contributor or committer including Delta Lake, Apache Iceberg, Apache Hudi, Apache Spark, Apache Hadoop, Apache Flink, Apache Kafka, Apache Storm and Apache Hive
- Understanding of data management architecture and experience with table formats at large scale
- Experience with Apache Parquet, Apache ORC, Apache Arrow
- Outstanding technical skills in crafting and implementing high-quality distributed systems
- Excellent programming skills in C++, Java, and/or Scala
- Knowledge of distributed system schedulers: Kubernetes, Hadoop YARN, Spark standalone
- Able to work successfully with multi-functional teams across organizational boundaries and geographies
- Highly motivated with strong communication skills
Ways to stand out from the crowd:
- Development work on one or more of Delta Lake, Apache Iceberg, Apache Hudi, preferably with contributions back to the open source community
- Track record of contributions to major open source projects (such as Apache Spark, Apache Hadoop, Apache Flink, Apache Kafka, Apache Arrow)
- Working experience with acceleration libraries (CUDA, RAPIDS, UCX)
We are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. If you're passionate, creative, and driven, we'd love to have you join the team. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.
The base salary range is 268,000 USD - 414,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Company Info.
NVIDIANVIDIA’s invention of the GPU sparked the PC gaming market. The company’s pioneering work in accelerated computing—a supercharged form of computing at the intersection of computer graphics, high performance computing and AI—is reshaping trillion-dollar industries, such as transportation, healthcare and manufacturing, and fueling the growth of many others.
-
IndustryCloud computing,Video games,Computer software,Semiconductors,Computer hardware,Consumer electronics,Artificial intelligence
-
No. of Employees22,473
-
Location2701 San Tomas Expressway, Santa Clara, CA 95050, USA
-
Website
-
Jobs Posted
Get Similar Jobs In Your Inbox
NVIDIA is currently hiring Senior Data Lake Architect Jobs in Champaign, IL, USA with average base salary of $268,000 - $414,000 / Year.
Similar Jobs View More
Applied AI & Deep Learning Research Intern, NeMo AI Applications
NVIDIASanta Clara, CA, USA
0-2 year
Senior Technical Program Manager, Deep Learning Enterprise Server Software
NVIDIASanta Clara, CA, USA
6-8 year
Senior Technical Program Manager, Deep Learning Enterprise Server Software
NVIDIAAustin, TX, USA
6-8 year
Senior Technical Program Manager, Deep Learning Enterprise Server Software
NVIDIAHillsboro, OR, USA
6-8 year
NVIDIA 2024 Internships: Artificial Intelligence Engineering Intern
NVIDIASanta Clara, CA, USA
4-6 year
Principal Software Engineer, Drive Context Fusion - Autonomous Vehicles
NVIDIABeijing, China
12-14 year
Principal Software Engineer, Drive Context Fusion - Autonomous Vehicles
NVIDIAShanghai, China
12-14 year
Principal Software Engineer, Drive Context Fusion - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
12-14 year
System Software Engineer Intern - Autonomous Vehicles Platform
NVIDIAShenzhen, Guangdong Province, China
0-2 year
Senior Technical Product Manager, GPU Programming Model - CUDA
NVIDIASanta Clara, CA, USA
10-12 year
Senior Software Engineer – Server Software ODM and OEM Architecture
NVIDIASanta Clara, CA, USA
6-8 year
Senior ASIC Verification Engineer, Coherent High Speed Interconnect
NVIDIASanta Clara, CA, USA
4-6 year
Senior ASIC Verification Engineer, Coherent High Speed Interconnect
NVIDIAWestford, MA, USA
4-6 year
Senior Systems Software Engineer, C++ and CUDA - Accelerated Apache Spark
NVIDIAChampaign, IL, USA
8-10 year
Senior Systems Software Engineer, C++ and CUDA - Accelerated Apache Spark
NVIDIASanta Clara, CA, USA
8-10 year
Senior Governance Infrastructure Platform Automation Engineer - NGC
NVIDIASanta Clara, CA, USA
8-10 year
SoC and Advanced Computing Platforms Innovation Intern - Summer 2024
NVIDIASanta Clara, CA, USA
0-2 year
SoC and Advanced Computing Platforms Innovation Intern - Summer 2024
NVIDIADurham, NC, USA
0-2 year
Senior Systems Software Engineer - Performance - Accelerated Apache Spark
NVIDIAChampaign, IL, USA
8-10 year
Senior Systems Software Engineer - Performance - Accelerated Apache Spark
NVIDIASanta Clara, CA, USA
8-10 year
Systems Software Engineer, AV Verification and Validation - Autonomous Vehicles
NVIDIAShanghai, China
2-4 year
Systems Software Engineer, AV Verification and Validation - Autonomous Vehicles
NVIDIABeijing, China
2-4 year
Systems Software Engineer, AV Verification and Validation - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
2-4 year
Director of Product Planning, Autonomous Driving
NVIDIAGuangzhou, Guangdong Province, China
16-18 year
Director of Product Planning, Autonomous Driving
NVIDIAShenzhen, Guangdong Province, China
16-18 year
Principal Product Manager - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
16-18 year
Senior Technical Marketing Engineer – Physics Based Machine Learning
NVIDIASanta Clara, CA, USA
8-10 year
Product Manager MBA Intern, Autonomous Vehicle Development Tools - Summer 2024
NVIDIARedmond, WA, USA
0-2 year
Product Manager MBA Intern, Autonomous Vehicle Development Tools - Summer 2024
NVIDIASanta Clara, CA, USA
0-2 year
Product Manager MBA Intern, Autonomous Vehicle Development Tools - Summer 2024
NVIDIAHolmdel, NJ, USA
0-2 year
Product Manager MBA Intern, Autonomous Vehicle Development Tools - Summer 2024
NVIDIANew York, NY, USA
0-2 year
Principal Planning Software Engineer, Parking - Autonomous Vehicles
NVIDIABeijing, China
12-14 year
Principal Planning Software Engineer, Parking - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
12-14 year
Principal Planning Software Engineer - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
10-12 year
Software Manager, Planning and Control - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
8-10 year
Senior Software Engineer, Planning and Control – Autonomous Vehicles
NVIDIAShanghai, China
6-8 year
Senior Software Engineer, Planning and Control – Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
6-8 year
Senior Planning Software Engineer, Parking - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
12-14 year
Principal ML Engineer, Planning and Prediction – Autonomous Vehicles
NVIDIAShanghai, China
12-14 year
Principal ML Engineer, Planning and Prediction – Autonomous Vehicles
NVIDIABeijing, China
12-14 year
Principal ML Engineer, Planning and Prediction – Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
12-14 year
Senior Technical Program Manager, Planning and Controls - Autonomous Vehicles
NVIDIAShanghai, China
8-10 year
Senior Technical Program Manager, Planning and Controls - Autonomous Vehicles
NVIDIABeijing, China
8-10 year
Senior Technical Program Manager, Planning and Controls - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
8-10 year
Principal Planning Software Engineer, Parking - Autonomous Vehicles
NVIDIAShanghai, China
12-14 year
Senior Planning and Control Software Engineer - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
4-6 year
Principal Systems Architect, Omniverse Developer Technologies
NVIDIASanta Clara, CA, USA
16-18 year
Principal Offensive Security Engineer – Data Center Systems
NVIDIASanta Clarita, CA, USA
12-14 year
PhD Research Intern, Generalist Embodied Agents Research - Summer 2024
NVIDIASanta Clara, CA, USA
0-2 year
PhD Research Intern, Generalist Embodied Agents Research - Summer 2024
NVIDIAUnited States
0-2 year
Senior Online Mapping Algorithms Engineer- - Autonomous Vehicles
NVIDIAGuangzhou, Guangdong Province, China
6-8 year
Senior Online Mapping Algorithms Engineer- - Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
6-8 year
System Software Architect, Programmable Vision Accelerator
NVIDIABengaluru, Karnataka, India
10-12 year
System Software Architect, Programmable Vision Accelerator
NVIDIAHyderabad, Telangana, India
10-12 year
System Software Architect, Programmable Vision Accelerator
NVIDIAPune, Maharashtra, India
10-12 year
Principal Online Mapping Algorithms Engineer- Autonomous Vehicles
NVIDIAGuangzhou, Guangdong Province, China
16-18 year
Principal Online Mapping Algorithms Engineer- Autonomous Vehicles
NVIDIAShenzhen, Guangdong Province, China
16-18 year
Governance and Infrastructure Platform and Automation Engineer
NVIDIASanta Clara, CA, USA
8-10 year
Governance and Infrastructure Platform and Automation Engineer
NVIDIASanta Clara, CA, USA
8-10 year
Senior Deep Learning Systems Software Engineer - AI Infrastructure
NVIDIASanta Clara, CA, USA
8-10 year
Senior Developer Technology Engineer - Large Language Models & Generative AI
NVIDIAWürselen, Germany
8-10 year
Senior Developer Technology Engineer - Large Language Models & Generative AI
NVIDIAStuttgart, Germany
8-10 year
Senior Developer Technology Engineer - Large Language Models & Generative AI
NVIDIAMunich, Germany
8-10 year
Senior Developer Technology Engineer - Large Language Models & Generative AI
NVIDIABerlin, Germany
8-10 year
Developer Technology Engineer - Large Language Models and Generative AI
NVIDIAWürselen, Germany
2-4 year
Developer Technology Engineer - Large Language Models and Generative AI
NVIDIAStuttgart, Germany
2-4 year
Developer Technology Engineer - Large Language Models and Generative AI
NVIDIAMunich, Germany
2-4 year
Developer Technology Engineer - Large Language Models and Generative AI
NVIDIABerlin, Germany
2-4 year
Applied Deep Learning Scientist Intern, Cheminformatics and Virtual Screening
NVIDIASanta Clara, CA, USA
4-6 year
Applied AI and Deep Learning Research Intern, NeMo AI Applications
NVIDIASanta Clara, CA, USA
4-6 year
Applied Deep Learning Scientist Intern, Protein Structure and Design
NVIDIASanta Clara, CA, USA
4-6 year
Developer Technology Engineer, AI - New College Graduate 2023
NVIDIASalt Lake City, UT, USA
2-4 year
North America Business Development Lead, Healthcare and Life Sciences
NVIDIASanta Clara, CA, USA
12-14 year
North America Business Development Lead, Healthcare and Life Sciences
NVIDIAUnited States
12-14 year
Principal Computer Vision and Deep Learning Engineer, 3D Reconstruction
NVIDIASanta Clara, CA, USA
16-18 year
Principal Computer Vision and Deep Learning Engineer, 3D Reconstruction
NVIDIAUnited States
16-18 year
Reliability, Availability and Serviceability Expert, Datacenter AI Products Development
NVIDIASanta Clara, CA, USA
12-14 year
Reliability, Availability and Serviceability Expert, Datacenter AI Products Development
NVIDIAAustin, TX, USA
12-14 year
Reliability, Availability and Serviceability Expert, Datacenter AI Products Development
NVIDIAHillsboro, OR, USA
12-14 year
Senior Scientific Machine Learning Software Engineer - Physics
NVIDIASanta Clara, CA, USA
10-12 year
Principal Machine Learning Engineer, Content Safety and ML Fairness
NVIDIASanta Clara, CA, USA
8-10 year
PhD Research Intern, Computer Vision & Deep Learning - Summer 2024
NVIDIASanta Clara, CA, USA
0-2 year
Senior Software Engineer - Chip Design Tools
NVIDIAAustin, TX, USA; Durham, NC, USA; Santa Clara, CA, USA; Westford, MA, USA
6-8 year
Senior Software Engineer, AI SDK Multimedia Platform
NVIDIABengaluru, Karnataka, India; Gurugram, Haryana, India; Hyderabad, Telangana, India; Pune, Maharashtra, India
10-12 year
Senior Software Engineer - RTL Design Tools
NVIDIAAustin, TX, USA; Durham, NC, USA; Santa Clara, CA, USA; Westford, MA, USA
6-8 year
Senior Software Engineer - HPC
NVIDIAAustin, TX, USA; Durham, NC, USA; Santa Clara, CA, USA; Westford, MA, USA
10-12 year
Senior Software Engineer – Build Tools
NVIDIAAustin, TX, USA; Durham, NC, USA; Santa Clara, CA, USA; Westford, MA, USA
6-8 year
Senior Developer Relationship Manager – Physics Informed Machine Learning
NVIDIASanta Clara, CA, USA
10-12 year
Software Engineer, cuDNN - Deep Learning
NVIDIAShanghai, China; Beijing, China; Shenzhen, Guangdong Province, China
0-2 year
PhD Research Intern, Computer Vision and Deep Learning - Summer 2024
NVIDIAShanghai, China; Beijing, China
0-2 year
Research Scientist, Computer Vision and Deep Learning - New College Grad 2024
NVIDIASanta Clara, CA, USA
0-2 year