AIML - SW Engineer, Foundation Model Services

Key Skills

Aartificial intelligence, Azure, Deep Learning, Docker, GoLang, Kubernetes-K8s, Large Language Models - LLMs, Machine learning techniques, Natural Language Processing (NLP), Python Programming, PyTorch, TensorFlow

Job Description

• Work closely with product teams to build production grade solutions to launch models serving millions of customers in real time.

• Work along side Foundation Model Research team to prototype and develop inference for cutting edge model architectures.

• Build tools to understand bottlenecks in Inference for different hardwares and use cases.

• Mentor and guide engineers in the organization.

Minimum Qualifications

• 8+ years of experience leading and driving complex, ambiguous projects.
• Strong industry background and experience in ML technologies (LLMs, Machine Learning, NLP, Information Retrieval, Statistics).
• Rich experience with high throughput services particularly at supercomputing scale.
• Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes, Docker etc.
• Proficient in building and maintaining systems written in modern languages (eg: Golang, python)

Preferred Qualifications

• Familiar with one of the popular ML Frameworks like Pytorch, Tensorflow.
• Familiar with fundamental Deep Learning architectures such as Transformers, Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server etc.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,800 and $312,200, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.