ISE, SIML - Robustness Analysis & AI Safety ML Engineer

Key Skills

Aartificial intelligence, Analytical and Problem solving, Data science techniques, Effective communication skills, Large Language Models - LLMs, Machine learning techniques, Natural Language Processing (NLP), Planning and organization, Python Programming, PyTorch

Job Description

We are the Intelligence System Experience (ISE) team within Apple’s software organization. The team works at the intersection between multimodal machine learning and system experiences. System Experience (Springboard, Settings), Keyboards, Pencil & Paper, Shortcuts are some of the experiences that the team oversees. These experiences that our users enjoy are backed by production scale ML workflows. Visual Understanding of People, Text, Handwriting & Scenes, multilingual NLP for writing workflows & knowledge extraction, behavioral modeling for proactive suggestions, and privacy preserving learning are areas our multi disciplinary ML teams focus on. We have multiple ongoing efforts involving generative models, and we are looking for talented candidates to ensure that features built on top of such models are safe for deployment, and perform equally well for diverse customers within Apple's global user base. This is an exciting time to join us: grow fast, and have a positive impact on multiple key features on your first day at Apple!

Key Qualifications

• Good ML fundamentals
• Experience in training machine learning models (NLP or computer vision)
• Familiarity with challenges associated to building robust ML datasets and models: definition and coverage of target data distribution, potential biases, potential failure modes
• Demonstrated experience in accessing and addressing potential risks and ensuring the safety and fairness in generative models. Prior experience in LLM Safety is a big plus.
• Strong programming skills in Python to operate models and data at scale
• Familiarity with ML toolkits, e.g., PyTorch
• Excellent drive, problem solving skills and analytical approach
• Strong communication and collaboration skills in a cross-functional setting. Ability to work hands-on with multi-functional teams

Description

Apple’s commitment to deliver incredible experiences to a global and diverse set of users, in full respect of their privacy, has led to the development of a dedicated Robustness Analysis function. With the generative experience, creating a safe and robust platform is vital to our mission. Team’s responsibilities include monitoring ML model performance on relevant axes, and surfacing, measuring and mitigating ML failure modes, in order to improve overall user experience and reduce risks, with specific attention given to safety, inclusion and fairness. In this position, you will join a team of people passionate about leading RA operations for key future facing Apple features with focus on ensuring safety and robustness for generative models. THIS INCLUDES: -research and develop approaches to mitigate harmful and risk behaviors in generative models -define product-centered axes of analysis relevant to target feature, in collaboration with model DRI and feature DRI -develop processes (models, tools and data) to identify other potential biases or failure modes -when applicable, benchmark model using targeted public datasets -characterize potential biases in training set and model along chosen axes -request data collection efforts and/or implement automated pipelines based on advanced ML technology and humans/models in the loop to create test sets covering the various axes of investigation -report progress and issues found in technical and sponsor meetings -suggest mitigation options (data and/or model) and lead mitigation experiments, when issues are found

Education & Experience

M.S. or PhD in Computer Science, Data Science, Mathematics, Physics, or a related field (or equivalent practical experience)

Pay & Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $170,700 and $300,200, and your base pay will depend on your skills, qualifications, experience, and location.

  Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.