Senior AI Systems Engineer

Key Skills

Aartificial intelligence, Data Analytics, Data oriented design- DoD, Effective communication skills, Machine learning techniques, Natural Language Processing (NLP), Supply Chain Management

Job Description

The Department of Defense’s Chief Digital and Artificial Intelligence Office (CDAO) is the senior official responsible for the acceleration of the DoD’s adoption of data, analytics, and AI to generate decision advantage across, from the boardroom to the battlefield. 

The CDAO performs several critical functions in close coordination with the Services, Joint Staff, CIO, USD (R&E), and other digital leaders:

• Lead the Department’s strategy and policy on data, analytics, and AI adoption, as well as govern and oversee efforts across the Department.
• Enable the development of digital and AI-enabled solutions across the Department, while also selectively scaling proven solutions for enterprise and joint use cases.
• Provide a sophisticated cadre of technical experts that serve as a de facto data and digital response force able to address urgent crises and emerging challenges with state-of-the-art digital solutions.

CDAO enables Department of Defense (DoD) mission operations by enabling AI development and adoption. The Assessment and Assurance Directorate within the Algorithmic Warfare organization is responsible for the evaluation of each AI product developed by an Algorithmic Warfare Line of Effort (LOE). MITRE is the Program Assurance Lead and provides test, evaluation, and assessment expertise and support for multiple LOE initiatives within CDAO. MITRE also provides metrics definition and analysis in support of Joint All Domain Command and Control (JADC2) and Global Information Dominance Experiments (GIDE).

To provide Program Assurance support MITRE provides:

• Ensure that AI Requirement are testable and measurable
• Develop the metrics and measures and supporting metrics collection plan with evaluation criteria as appropriate for each initiative.
• Conduct performance evaluations (algorithmic, system, and operational) on the CDAO initiatives and write reports documenting its strengths and weaknesses
• Develop Test and Evaluation Master Plans (TEMPS, AI Test Plans, and AI Test Reports)
• Develop T&E Best Practices and document lessons learned
• Trusted and independent advisor to ensure the responsible use of AI-enabled technologies aligned with the Department’s values and code of ethics.

Roles and Responsibilities:

• The candidate will provide technical leadership and program assurance expertise and analysis to a wide variety of CDAO Program Assurance efforts.
• Tasks will require application of expertise in program assurance, machine learning evaluation, data and systems analysis, systems engineering and T&E (test and evaluation) best practices.
• Development and evaluation of metrics to support recommendations.
• Research emerging AI program assurance methods and tools.
• Provide recommendations on AI assurance across the CDAO AI supply chain to reliably assess, verify and communicate the trustworthiness of AI systems, allowing others in the DoD ecosystem to build justified trust and adoption of these systems.
• Assist in development of systems security and cybersecurity strategy development, system testing and evaluation, and verification and validation efforts.
• Develop data-driven lessons learned to continuously improve AI Assurance efforts and tools.

Minimum Qualifications:

• Typically requires a minimum of 5 years of related experience with a Bachelor’s in Information Technology, Computer Science degree; or 3 years and a Master’s degree; or a PhD with relevant experience who can immediately contribute at this job step; or equivalent combination of related education and related Space Domain/Systems experience.
• Active Secret with the ability to obtain and maintain a TS/SCI
• Knowledge of system architecture and its application to T&E activities
• Knowledge of emerging program assurance tools/products/technologies. 
• Self-starter and capable of work shaping and leading efforts.
• Proficiency in written communications skills. Must work collaboratively within a team, provide senior level leadership and guidance, and be capable of identifying, prioritizing, and solving difficult problems.

• Candidates must possess broad testing and systems engineering expertise related to Program Assurance. 
• Candidates will have excellent interpersonal and communications skills for interaction with customers, project leaders, team members, and other government agencies. Must have the ability to coordinate across teams and with representatives from a wide range of organizations including government, commercial, and international. 
• Proven ability to write technical reports detailing analytical work, including assumptions, objectives, explanation of analytical techniques/tools, sources of data, results, conclusions, and recommendations relating to context of the analysis.

Preferred Qualifications:

• Experience with Program Assurance best practices for AI to include computer vision, Natural Language Processing (NLP), and Course of Action (CoA) generation.
• Knowledge and understanding of DoD Joint Warfighting operations.
• Knowledge and understanding of Alliance and Coalition military operations.
• Experience with Large Language Model evaluation
• Active TS/SCI

This requisition requires the candidate to have a minimum of the following clearance(s):

Secret

This requisition requires the hired candidate to have or obtain, within one year from the date of hire, the following clearance(s):

Top Secret/SCI

Work Location Type:

Hybrid

MITRE is proud to be an equal opportunity employer. MITRE recruits, employs, trains, compensates, and promotes regardless of age; ancestry; color; family medical or genetic information; gender identity and expression; marital, military, or veteran status; national and ethnic origin; physical or mental disability; political affiliation; pregnancy; race; religion; sex; sexual orientation; and any other protected characteristics. For further information please visit the Equal Employment Opportunity Commission website EEO is the Law Poster and Pay Transparency.

MITRE intends to maintain a website that is fully accessible to all individuals. If you are unable to search or apply for jobs and would like to request a reasonable accommodation for any part of MITRE’s employment process, please email recruitinghelp@mitre.org.