LLM Research/Engineering Intern

Key Skills

Commercial off-the-shelf - COTS tools, Deep Learning, Large Language Models - LLMs, Microsoft DeepSpeed

Job Description

Group Introduction:

The Microsoft DKI team is at the forefront of exploring cutting-edge research and applications of multimodal large models. We have developed multiple open-source projects such as Wizard, TaskWeaver, and UFO. Our work focuses on integrating innovative LLM technologies with cloud systems and data to serve various applications like automated fault handling, intelligent log analysis, Text2SQL, and code intelligence.

Job Type: Full-time Intern

Location: Beijing/Shanghai

Job Responsibilities (Choose between Engineering or Research):

Engineering Intern:

• Participate in the design and engineering development of next-generation Agent frameworks, including LLM Agent and GUI Agent.
• Engage in the collection, analysis, and processing of multimodal data to support Agent-specific model reasoning and training, and optimize the training pipeline.
• Facilitate the integration and application of the Agent framework in Microsoft products.

Research Intern:

• Fine-tune and deploy multimodal large models, involving technologies such as CoT, Agent, SFT, RLHF, DeepSpeed, and vllm.
• Contribute to prompt design, optimization, and compression for multimodal large models.
• Publish research findings in reputable journals or top academic conferences.

Qualifications:

• Proficient in training deep learning models with substantial hands-on project or deployment experience.
• Some project experience related to large language models (LLM).
• Prior experience with Agent-related projects is preferred.
• Strong engineering skills, diligent and responsible, with excellent communication abilities.
• Publications in top academic conferences or journals are an advantage.
• Must be available for a full-time internship for 6 months or more.

Internship Duration Requirements:

Must obtain permission from your academic advisor and commit to at least 6 months of internship.

Application Instructions:

Please send your English or Chinese resume (in PDF/Word format) to: intern_hiring@microsoft.com. Please include - LLM Research/Engineering Intern - in the email subject line.