Software Engineer (ML Platform)

Key Skills

Algorithms, Apache Flink, Apache Hadoop, AWS, Data structuring, Google Cloud Platform (GCP), JAX framework, Kubernetes-K8s, Machine learning techniques, PyTorch, Spark Core, TensorFlow

Job Description

About the role:

Anyscale is looking to hire strong engineers to build next generation high-performance machine learning serving systems (both our open source libraries and SaaS offering).

Much of the tooling used to serve ML models today is inherited from the previous generation of infrastructure, but emerging ML applications come with a new set of requirements: high compute requirements, the need for specialized hardware, and composing many different models along with business logic in a single request.

Our goal is provide a simple but powerful set of tools to make bringing complex ML applications to production a reality.

About the Platform team:

The Platform team’s mission is to build world class systems for serving ML models in production. Part of this work is building and maintaining the open source Ray Serve library, as well as contributing directly to the Anyscale platform used by our customers to run mission-critical applications.

Much of our work is user-facing: you’ll have the opportunity to collaborate with open source users and customers from small startups with lean ML engineering teams to industry-leading companies using Ray, such as Uber, Shopify, and ByteDance.

As part of this role, you will:

• Building a highly available service for ML model serving
• Improve Ray Serve and our other libraries to make authoring next-generation production ML applications as easy as possible
• Improve our autoscaling capabilities to drive performance improvements & cost savings
• Reduce latency and improve throughput for single- and multi-model serving

We'd love to hear from you if you have:

• Solid background in algorithms, data structures, system design
• Experience working with modern machine learning tooling (PyTorch, Tensorflow, JAX)
• At least 1+ year of relevant work experience

Bonus points!

• Experience building and maintaining an open source project
• Experience building and operating machine learning infrastructure in production
• Experience building highly available serving systems

Compensation

• At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.
• This role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following:
  Stock Options
• Healthcare plans, with premiums covered by Anyscale at 99%
• 401k Retirement Plan
• Wellness stipend
• Education stipend
• Paid Parental Leave
• Paid Time Off
• Commute reimbursement
• 100% of in office meals covered