Software Engineer, Kernels & Performance

Key Skills

C Programming, C++, CUDA kernels, GPUs, Machine learning techniques, Python Programming

Job Description

About the role

We’re looking for a seasoned Research Engineer with expertise in GPU computing to design high-performance kernels for our training and inference workloads using CUDA/CUTLASS, C++, and Python.

Responsibilities:

• Using the capabilities of GPUs and other accelerators to the fullest extent to make our custom model architectures fast and efficient for training and inference

• Deliver and maintain high performance GPU and communication kernels that increase utilization and also work well in a distributed training and inference environment

• Collaborating closely with ML Engineers and Researchers to develop new architectures and algorithms that are aware of I/O & Hardware constraints

• Communicating with hardware vendors to advise on design of software or future hardware, while also making sure we are keeping up to date with the cutting edge

• Working on quantization or any form of low-precision arithmetic to increase throughput without degradation in performance

Requirements:

• Strong C/C++ and Python coding skills

• Deep understanding of GPUs or other accelerators, along with the ability to effectively profile and analyze existing or new kernels

• Experience with CUDA/CUTLASS (and experience with Triton-like compilers is a plus)

• 3+ years of relevant industry experience and experience working with hardware developers

• MS/PhD in Computer Science and Engineering with a specialization in Computer Architecture, Parallel Computing, Compilers or other System

Join our visionary team, on-site 3-5 days a week, at the forefront of next-generation AGI.

About Character.AI

Founded in 2021 by AI pioneers Noam Shazeer and Daniel De Freitas, Character is a leading AI company offering personalized experiences through customizable AI 'Characters.' As one of the most widely used AI platforms worldwide, Character enables users to interact with AI tailored to their unique needs and preferences.

Noam co-invented core LLM tech and was recently honored as one of TIME's 100 Most Influential in AI. Daniel created LaMDA, the breakthrough conversational AI now powering Google's Bard.

In just two years, we achieved unicorn status and were named Google Play's AI App of the Year – a testament to our groundbreaking technology and vision.