Research Engineer, Safety Reasoning

Key Skills

Aartificial intelligence, Data management, Python Programming

Job Description

About the Role

To help API users monitor and prevent unwanted use cases, we developed the moderation endpoint, a tool for checking whether content complies with OpenAI's content policy. Developers can thus identify content that our content policy prohibits and take actions (e.g. block it). We seek a Research Engineer to help design and build a robust pipeline for data management, model training and deployment to enable a consistent improvement on the Moderation model.

In this role, you will:

• Conduct applied research to improve the ability of foundational models to accurately reason about questions of human values, morals, ethics, and cultural norms, and apply these improved models to practical safety challenges.
• Develop and refine AI moderation models to detect and mitigate known and emerging patterns of AI misuse and abuse.
• Work with policy researchers to adapt and iterate on our content policies to ensure effective prevention of harmful behavior.
• Contribute to research on multimodal content analysis to enhance our moderation capabilities.
• Develop and improve pipelines for automated data labeling and augmentation, model training, evaluation and deployment, including active learning process, routines for calibration and validation data refresh etc.
• Experiment and design an effective red-teaming pipeline to examine the robustness of our harm prevention systems and identify areas for future improvement.

You might thrive in this role if you:

• Are excited about OpenAI’s mission of building safe, universally beneficial AGI and are aligned with OpenAI’s charter
• Possess 5+ years of research engineering experience and proficiency in Python or similar languages.
• Thrive in environments involving large-scale AI systems and multimodal datasets (a plus).
• Exhibit proficiency in the field of AI safety, focusing on topics like RLHF, adversarial training, robustness, fairness & biases, which is extremely advantageous.
• Show enthusiasm for AI safety and dedication to enhancing the safety of cutting-edge AI models for real-world use.

Compensation, Benefits and Perks

Total compensation also includes generous equity and benefits.

• Medical, dental, and vision insurance for you and your family
• Mental health and wellness support
• 401(k) plan with 4% matching
• Unlimited time off and 18+ company holidays per year
• Paid parental leave (20 weeks) and family-planning support
• Annual learning & development stipend ($1,500 per year)

Annual Salary Range

$245,000—$440,000 USD

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.

For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.