Research Engineer, Post-Training

Key Skills

Algorithms, Data pipelines, Design, Docker, Kubernetes-K8s, Machine learning techniques

Job Description

Joining us as a Research Engineer on the Post-Training team, you'll be diving into the exciting world of fine-tuning AI models, optimizing their performance, and ensuring they meet the highest standards of quality and efficiency. Your work will directly contribute to our groundbreaking advancements in AI, helping shape an era where technology is not just a tool, but a companion in our daily lives. At Character.AI, your talent, creativity, and expertise will not just be valued—they will be the catalyst for change in an AI-driven future.

About the role

The Post-Training team is responsible for developing our powerful pretrained language models into intelligent, engaging, and aligned products.

As a Post-Training Researcher, you will work across teams and our technical stack to improve our model performance and training methods, including data, compute and algorithms. You will get to shape the conversational experience of millions of users per day.

Example projects:

• Develop alignment algorithms and loss functions to improve data sample efficiency.

• Write data pipelines to process diverse web data into a format models can ingest.

• Identify quality signals to understand our model’s performance in the real world.

• Design sampling algorithms to improve serving efficiency of large generative models.

Job Requirements

• Write clear and clean production-facing and training code

• Experience working with GPUs (training, serving, debugging)

• Experience with data pipelines and data infrastructure

• Strong understanding of modern machine learning techniques (reinforcement learning, transformers, etc)

• Track-record of exceptional research or creative applied ML projects

Nice to Have

• Experience with product experimentation and A/B testing

• Experience training large models in a distributed setting

• Familiarity with ML deployment and orchestration (Kubernetes, Docker, cloud)

• Publications in relevant academic journals or conferences in the field of machine learning

Join our visionary team, on-site 3-5 days a week, at the forefront of next-generation AGI.

About Character.AI

Founded in 2021 by AI pioneers Noam Shazeer and Daniel De Freitas, Character is a leading AI company offering personalized experiences through customizable AI 'Characters.' As one of the most widely used AI platforms worldwide, Character enables users to interact with AI tailored to their unique needs and preferences.

Noam co-invented core LLM tech and was recently honored as one of TIME's 100 Most Influential in AI. Daniel created LaMDA, the breakthrough conversational AI now powering Google's Bard.

In just two years, we achieved unicorn status and were named Google Play's AI App of the Year – a testament to our groundbreaking technology and vision.