AIML - Sr. Software Engineer, On-Device Machine Learning, Foundation Models

Key Skills

Aartificial intelligence, API, C Programming, C++, Debugging, Deep Learning, Design, Effective communication skills, GPUs, Large Language Models - LLMs, Machine learning techniques, Neural Networks, Optimization, Software Development

Job Description

Help us bring state-of-the-art foundation models to the phone in your pocket, enabling the next generation of ML-based experiences in a privacy-preserving way! Our team is responsible for the core framework that launches neural-network workloads on Apple devices. We build the bridge between the compute resources available on Apple hardware and an entire universe of ML models, trained by feature teams throughout Apple and by our developer community. Your work on our team will enable increasingly sophisticated models throughout our products, from the computer vision models that process every camera frame in the Apple Vision Pro, to potential large language models that could transform how we interact with our computing devices. By developing the underlying representation and pipeline for these workloads, and the mechanisms for mapping them to the CPU, GPU, and Neural Engine, you will play a critical role in expanding what is possible in the Apple ecosystem.

Key Qualifications

• Excellent C/C++ programming and debugging skills
• Passion for API design and software architecture
• Outstanding verbal and written communication skills
• Experience with modern neural-network architectures and deep learning libraries
• Expertise with performance optimization (preferred)

Description

• Design and implement improvements to Apple’s Model Intermediate Language (MIL), the intermediate representation of neural-network workloads shared across the inference stack
• Develop the mechanisms for analyzing and transforming MIL workloads - Build the tightly integrated pipeline that optimizes and compiles models and then orchestrates their execution on device
• Collaborate with CPU, GPU, and Neural Engine hardware backends to push inference performance and efficiency
• Work closely with feature teams to facilitate and debug the integration of increasingly sophisticated models, including large language models

Education & Experience

• BS/MS/PhD in Computer Science or Electrical Engineering
• Solid industry experience (2+ years)

Pay & Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $170,700 and $300,200, and your base pay will depend on your skills, qualifications, experience, and location.