AI Engineer & Researcher

Key Skills

C++, CUDA/GPU programming, JAX framework, Python Programming, Rust, Triton

Job Description

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.

Our team is small, highly motivated, and focused on engineering excellence. This is an organization for those who appreciate challenging themselves and who thrive on curiosity. Engineers are encouraged to work across multiple areas of the company, and as a result all engineers and researchers share the title “Member of Technical Staff”.

We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important.

All engineers and researchers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

xAI does not have recruiters. Every application is reviewed directly by a technical member of the team.

Tech Stack

• Rust
• Python
• JAX and XLA
• CUDA (C++ and Triton)

Focus

• Training trillion parameter neural networks at scale, as well as a variety of smaller specialized models.
• Mastering all data modalities: text, audio, images, video, etc
• Profiling, debugging, and optimizing multi-host GPU utilization.
• Rapidly implementing the latest state of the art methods from the deep learning literature.
• Inventing new algorithms and methods that bring us closer to our goal: Developing AI systems that can accurately understand the universe and create new knowledge

Ideal Experience

• Building distributed training systems for AI models in HPC clusters.
• Configuring and troubleshooting hardware and operating-systems for maximum performance.
• Working with JAX/XLA for multi-host training.
• Writing custom CUDA kernels in either C++ or via Triton.
• Digging into third-party source code for debugging and customization.