Lead Data Engineer, Machine Learning Systems

Key Skills

Amazon EMR, Apache Airflow, AWS Sagemaker, Databricks, Docker, Kubernetes-K8s, Large scale data processing, Machine learning techniques, MLOps tools, Python Programming, SPARK Programming, SQL

Job Description

Course Hero is scaling! We are looking for a Lead Data Engineer, ML Systems to work alongside our Machine Learning engineers to develop machine learning models and deploy them to production to enhance the Course Hero service. You will build pipelines, scale machine learning training jobs, and enhance the platform used by the Machine Learning team.

Here are some ways you’ll make an impact:

• Help our Machine Learning team develop, test, and deploy advanced ML models to our high traffic application.
• Develop tools that make ML development more efficient, allowing ML Engineers to focus on modeling rather than technology platforms. 
• Collaborate across teams including Product Management, Machine Learning, Data Analytics and Engineering to plan projects that enhance the Course Hero user experience.

Requirements:

• Experienced with Spark on AWS EMR and/or Databricks 
• Abie to optimize execution of large scale distributed data jobs.
• Experienced with typical ML workflows and MLOps
• Fluent in Python and SQL

Bonus Points:

• Systems design and thinking
• Experience with Kubernetes and Docker
• Experience with Airflow
• Knowledgeable on the various AWS ML services, including Sagemaker and friends.
• Operational experience in areas such as permissions, secret management, observability, etc

Benefits & Perks:

• Competitive salary, annual bonus, and RSUs
• Medical coverage, including full dental and vision
• Life and disability benefits
• 401(k) program (US) / retirement savings plan (Canada) with company match
• One month paid sabbatical after 5 years at the company
• Education reimbursement
• Professional development workshops & industry conferences
• Paid parental leave
• Flexible work schedule
• Social responsibility program (volunteer time off and donation matching)
• Annual wellness stipend
• Monthly tech stipend
• Annual family planning stipend
• Monthly snack boxes delivered to your door
• Cell phone allowance

We are a virtual-first company and have employees dispersed throughout the United States and Canada. We have a market-based pay structure that varies by location. The base pay for this position is dependent on multiple factors, including candidate experience and expertise, and may vary from the amounts listed below. You may also be eligible to participate in our bonus program and may be offered an equity award, benefits, and other types of compensation.

This role is eligible for hire in the San Francisco Bay Area (US), Vancouver (Canada), and Toronto (Canada).

In accordance with California law, the base salary for this role if filled within California is $132,000 - $178,000.

Research shows that candidates from underrepresented backgrounds often don't apply for roles if they don't meet all the criteria. We strongly encourage you to apply if you're interested: we'd love to learn how you can amplify our team with your unique experience!