Research Engineer

Key Skills

3D data processing, Aartificial intelligence, Big Data Technology, Large Language Models - LLMs, Machine learning techniques, NeurIPS, Python Programming, SPARK Programming

Job Description

IBM Research Engineers are charting the future of Artificial Intelligence, creating breakthroughs in quantum computing, discovering how blockchain will reshape the enterprise, and much more. Join a team that is dedicated to applying science to some of today’s most complex enterprise challenges, whether it’s building state of art LLMs, discovering new quantum algorithms and applications or advances in multi cloud computers.

Your Role and Responsibilities

We are seeking an engineer to refine and standardize our large language model training procedures. This role is crucial for enhancing our existing framework, encompassing a broad spectrum of tasks from dataset preprocessing to large-scale distributed training techniques such as fine-tuning, contrastive fine-tuning, instruct tuning, etc. The candidate will be instrumental in developing tools and scripts that streamline the entire alignment pipeline, ensuring efficiency and consistency.

The engineer will be responsible for supporting all tooling and software engineering efforts to standardize and optimize the instruction tuning pipeline. They should possess the ability to interpret machine learning research and translate it into reliable, maintainable software. Additionally, the role involves developing specialized pipelines for various tasks, such as building RLHF pipelines with unit test-based rewards for low-resource languages and creating effective LLM-generated data pipelines. The ideal candidate will have a passion for programming languages, enabling them to tailor data generation and training pipelines to specific languages, and if applicable, leverage webapp development skills for creating frameworks to collect human data and deploy models in user-centric platforms.

Required Technical and Professional Expertise

• A Master’s degree in computer science, AI or related fields from a top institution
• 1-3 years of experience working with modern ML techniques including but not limited to language models, data processing, instruction tuning, model training
• Experience with big data platforms like Ray, Spark etc
• Programming experience in one of the following: Python, web development technologies
• Growth mindset and a pragmatic attitude

Preferred Technical and Professional Expertise

• Peer-reviewed research at machine learning conferences like NeurIPS, CVPR, ICML, ICLR, ICCV/ECCV, IROS, ICRA
• Experience building software for machine learning systems
• Experience working with open source systems