Quality Engineer - AI

Key Skills

Algorithms, AWS, HTML, JavaScript, NoSQL, Python Programming, PyTorch, SQL

Job Description

Descript is looking for a methodical QA professional with a keen eye for details and experience in testing AI models to help ensure the overall quality and reliability of our AI-powered products that revolutionizes the way content creators work with audio & video. This is an opportunity to work directly in the fast-moving landscape of AI technology and integrate best-in-class quality practices into our product development framework.

What You'll Do

• Collaborate closely with the AI research team to understand project requirements, develop test plans, and conduct thorough testing of AI algorithms and features to identify issues and areas of improvements
• Establish baselines, benchmarks and quality rating systems that consistently represent model quality
• Develop and scale our standards for quantitative and qualitative evaluation of AI models
• Create and maintain clear documentation, including test plans, test cases, and bug reports
• Leverage internal and external resources for gathering preference test data
• Audit and communicate with third party service providers to determine if they meet our quality requirements
• Continuously enhance testing processes, methodologies, and tools to improve efficiency
• Mentor QA Engineers on other teams to test AI models and coordinate with cross-functional teams, including software engineers and product managers, to ensure seamless integration and a smooth user experience

What You Bring

• Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience
• 5+ years QA experience
• 2+ years experience leading testing or evaluation of AI models
• 2+ years experience as a test lead on a team, product area, or feature
• Ability to collaborate effectively with cross-functional teams and stakeholders

Nice to Have

• Experience working with AI research teams
• Experience writing SQL queries
• Experience using Python for scripting

The base salary range for this role is $138,000-$170,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.