Software Engineer in Test for AI Model Engineering

Key Skills

Aartificial intelligence, C++, Design, Large Language Models - LLMs, MATLAB Programming

Job Description

As a Software Engineer in Test for AI Model Engineering, you will play a key role in ensuring the quality of AI-powered capabilities in MATLAB, as well as the tools that empower our customers to build their AI systems. You will join the Text Analytics Toolbox and Generative AI Model Engineering team, which is responsible for building and validating AI features including MATLAB Copilot, large language model (LLM) integrations, and text understanding and natural language processing workflows, in this fast-changing field.

Responsibilities

• Design and implement test suites for AI-powered features, including probabilistic systems where outputs are non-deterministic
• Build and maintain evaluation datasets for model-driven features
• Define quality metrics beyond pass/fail (e.g., relevance, correctness, usefulness, latency, stability) for model training
• Driving testability through software architecture and unit testing
• Leading departmental projects to leverage Gen-AI for force-multiplying tooling

Minimum Qualifications

• A bachelor's degree and 6 years of professional work experience (or a master's degree and 3 years of professional work experience, or a PhD degree, or equivalent experience) is required.

Additional Qualifications

Qualifications:

• Test automation experience
• Familiarity and understanding of LLMs and Generative AI

Nice to have:

• Hands on experience with coding agents or AI assistants
• Experience with C++
• Experience with MATLAB