Senior Machine Learning Engineer - LLM

Key Skills

Android, C++, Data Analytics, GoLang, HuggingFace, Large Language Models - LLMs, Machine learning techniques, PyTorch, Streaming APIs, TensorRT

Job Description

Moveworks is the copilot platform for automating employee support, empowering our customer’s workforce to converse with all of their business systems through natural language. Powered by the world’s most advanced LLMs and our proprietary MoveLM models, our copilot enables users to search information, automate tasks, and create content with generative AI.

Brands such as Databricks, Broadcom, DocuSign, and Palo Alto Networks leverage Moveworks to automate L1 support, enhance the employee experience, and navigate critical business initiatives.

Founded in 2016, Moveworks has raised $315 million in funding, at a valuation of $2.1 billion. We’ve been named to the 2023 Forbes Cloud 100 list as well as the Forbes AI 50 list for five consecutive years, while also earning recognition as the winner of the 2023 Edison Awards for AI Optimized Productivity, and as the Best Bot Solution at the 2022 AI Breakthrough Awards.

Moveworks has over 500 employees in six offices around the world, and is backed by some of the world's most prominent investors, including Kleiner Perkins, Lightspeed, Bain Capital Ventures, Sapphire Ventures, Iconiq, and more.

Come join one of the most innovative teams on the planet!

What you will do

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
• Build abstractions to automate various steps in different ML workflows
• Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
• Leverage your experience to drive best practices in ML and data engineering

What you bring to the table

• 2+ years of industry experience in Machine Learning, Infrastructure or related fields
• Experience with deep learning framework such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM.
• Experience with building and scaling end-to-end machine learning systems
• Experience building scalable micro services and ETL pipelines
• Expertise in Python and experience with performant language such as C++ or GoLang
• Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field.
• A love of research publications in the machine learning and software engineering communities
• Effective communicator with experience collaborating cross-functionally with other teams

Nice to have:

• Experience with ML Inference optimization using TensorRT.
• Experience with distributed training frameworks such as Deepspeed.
• Experience in managing and scaling GPU Inference services via Kubernetes

Base Compensation Range: $129,000 - $257,000

Our total compensation package includes a market competitive salary, equity for all full time roles, exceptional benefits, and, for applicable roles, commissions or bonus plans.

Ultimately, in determining pay, final offers may vary from the amount listed based on geography, the role’s scope and complexity, the candidate’s experience and expertise, and other factors.