Research Scientist, Language and Scaling Laws Research

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

Our Language team's mission is to develop GPT advancements by exploring and forecasting future capabilities and resource needs. To do this, we seek a deep understanding of the scaling of our models across multiple orders of magnitude to optimize for best-case performance at the largest scale.

About the Role

Our Language team offers you a unique opportunity to make significant contributions at the limits of modern natural language processing on the largest scale. We are looking for people who want to discover simple, generalizable ideas that hold across multiple orders of magnitude.

Representative projects on the team include:

• We believe studying phenomena on a spectrum yields more insight towards powerful models. You will have the opportunity to improve our understanding of the science of scaling laws and their applications to our largest models.
• We believe aligning our most powerful models is a top priority for the deployment of transformative technology. You will have opportunities to explore the role pretraining plays in alignment and safety.
• We believe revolutionary results realize themselves through scale. You will have the opportunity to identify shortcomings of our models across scale and develop solutions that impact future GPTs.

We expect you to:

• Have a track record of solving important machine learning problems with new ideas or new insight on existing ideas, demonstrated by accomplishments such as first author publications or impressive projects
• Possess the ability to own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out long-running projects

Nice to have:

• Past experience in creating high-performance implementations of deep learning algorithms
• Past experience with large distributed machine learning projects

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Benefits and Perks

• Medical, dental, and vision insurance for you and your family
• Mental health and wellness support
• 401(k) plan with 4% matching 
• Unlimited time off and 18+ company holidays per year 
• Paid parental leave (20 weeks) and family-planning support
• Annual learning & development stipend ($1,500 per year)