AIML - Sr Engineering Program Manager, Evaluation- Special Projects

Key Skills

Aartificial intelligence, Large Language Models - LLMs, Machine learning techniques, Natural Language Processing (NLP), Openstack, Program Management, UI design, UX design, Workfusion

Job Description

This role offers the opportunity to have a significant impact on the quality and effectiveness of our AI models by leading efforts in both evaluation and user research, ensuring we meet the highest standards of performance and user satisfaction.

• Develop, implement, and refine robust evaluation frameworks that align AI model performance with user needs and goals. Collaborate closely with data scientists, engineers, and cross-functional teams to ensure comprehensive assessment across various modalities
• Lead and manage user research programs, leveraging diverse methodologies to gather actionable user insights. Work closely with UX researchers to ensure that user feedback is systematically integrated into model training and evaluation processes
• Design and execute large-scale data collection efforts, ensuring the acquisition of high-quality, diverse datasets critical for AI model development. Coordinate with engineering, operations, and data science teams to streamline data collection workflows
• Partner with key stakeholders, including designers, data scientists, and engineers to ensure that evaluation and data collection efforts are well-integrated into the overall AI model development lifecycle
• Stay at the forefront of AI evaluation and data collection techniques, continuously innovating and refining methodologies to maintain state-of-the-art model performance and user experience

Minimum Qualifications

• Proven track record in managing technical programs or projects related to AI/ML or software development
• Demonstrated ability to work with designers, data scientists, engineers, and operations teams
• Skilled in establishing priorities, developing plans, and driving complex projects from concept to completion
• Strong written and verbal communication skills with the ability to present complex technical concepts to all levels of the organization, and to influence stakeholders

Preferred Qualifications

• 7+ years of experience managing projects and programs with demonstrated leadership on larger projects
• Master’s or PhD degree in Computer Science, Data Science, Statistics, or related quantitative field
• Proven experience managing AI-powered solutions, particularly in the evaluation and user study domains

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $165,500 and $293,800, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.