Natural Language Generative Modeling Research Engineer - SIML, ISE

Key Skills

C Programming, C++, Large Language Models - LLMs, Machine learning techniques, Natural Language Processing (NLP), Python Programming, PyTorch

Job Description

The team comprises of domain experts in NLP, Computer Vision, and ML Fairness who contribute to significant system wide safety experience. Our team provides an opportunity to be part of an incredible research and engineering organization focusing on System Intelligent Machine Learning (SIML) within Apple. An ideal candidate will have solid ML fundamentals and ability to turn research contributions into products. Proven experience in Conversation Understanding and Synthesis, Reinforcement and Human Preference Learning, and Large Language Model Training are essential for this role. SELECTED REFERENCES TO OUR TEAM’S WORK: Communication Safety & Sensitive Content Warning https://www.apple.com/newsroom/2023/06/apple-announces-powerful-new-privacy-and-security-features/

Key Qualifications

• Strong ML and NLP fundamentals
• Hands on experience training LLMs
• Experience adapting pre-trained LLMs for downstream tasks & human alignment
• Familiarity with distributed training
• Proficiency in using ML toolkits, e.g., PyTorch
• Strong programming skills in Python, C and C++
• You're aware of the challenges associated to the transition of a prototype into a final product

Description

We are seeking a candidate with a proven track record in applied ML research. Responsibilities in the role will include training large scale language and multimodal models on distributed backends, deployment of compact neural architectures such as transformers efficiently on device, and learning policies that can be personalized to the user in a privacy preserving manner. Ensuring quality with an emphasis on fairness and model robustness would constitute an important part of the role. You will be interacting very closely with a variety of ML researchers, software engineers, hardware & design teams cross functionally. Your primary responsibilities will center on enriching conversation understanding capabilities through LLM and multimodal models. The user experience initiative would focus on enriching system safety experience.

Education & Experience

M.S. or PhD in Electrical Engineering, Computer Science or a related field ie, mathematics, physics or computer engineering with a focus on computer vision and/or machine learning or comparable professional experience.

Pay & Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $170,700 and $256,500, and your base pay will depend on your skills, qualifications, experience, and location.

  Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.