Engineering Manager - ML Compute Platform

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

Are you passionate about driving ML developer productivity across an entire engineering organization? Do you want to work at the intersection of customer empathy, managing scalable compute resources, and ML use-cases? Yelp’s ML Compute team is at the center of this and is a key-enabler in achieving our company mission to connect people to great local businesses. We are looking for an Engineering Manager dedicated to fostering this part of Yelp’s ML platform.

We work on a wide variety of machine learning and big data use-cases, using Spark, Jupyter, Kubernetes, and AWS as foundational pieces to provide resources for our ML platform. Our platform launches on-demand, large-scale resources for ML model training or ETL batches. The platform directly supports over 40 teams and over 300 developers & analysts in a variety of environments from within Jupyterhub on dev to Spark batches on production.

We are looking for an Engineering Manager dedicated to fostering this part of our ML platform with compassion for our internal users. For some additional details, see these blogs on our spark infrastructure history and an overview of our ML platform.

We’d love to have you apply, even if you don't feel you meet every single requirement in this posting. At Yelp, we’re looking for great people, not just those who simply check off all the boxes.

Please note that this role will operate remotely and is open to all candidates in Ontario.

Where You Come In:

• Keep Yelp’s ML platform on the cutting-edge of machine learning technologies.
• Manage a team of engineers focused on building out Yelp’s ML platform compute capabilities.
• Collaborate with ML product teams to meet their needs for the platform.
• Collaborate with core infrastructure teams to best leverage their tooling into the platform.
• Coach, mentor, and grow engineers of all experience levels.
• Collaborate with other engineering teams on building centralized data & ML feature stores.

What it Takes to Succeed:

• Experience managing an infrastructure team with internal customers.
• Familiarity with Jupyter, Spark, Docker, Kubernetes, and Machine Learning.
• An interest in building tooling around Spark infrastructure in support of machine learning, data ETL, and ML feature store use cases.
• Desire to help the team stay productive by removing obstacles and optimizing team processes.
• Be a team player who lives the Yelp Valuesand thrives in a diverse and inclusive work culture.
• Collaborate with other engineering teams and product managers to help define the technical vision.
• Previous experience as a manager with a “people-first” approach; maintaining an inclusive team culture is your priority, and you lead through empathy.