Lead Data Engineer (Data Product Engineering)

Key Skills

Apache Airflow, Apache Kafka, AWS, AWS Sagemaker, Continuous Integration & Continuous Delivery - CI/CD, Data Biuld Tool - dbt, Data Engineering, Data Governance, Data Modelling, Data science techniques, Database, Docker, DynamoDB, Effective communication skills, ETL frameworks, Git, Kubernetes-K8s, Leadership Skill, Machine learning techniques, Optimization, Pandas, Postgres, Product Management, PySpark, Snowflake, SQL

Job Description

We’re looking to add to our team as we prepare to launch a new array of game-changing technologies on our successfully adopted platform. If you’re interested in working within a startup-oriented environment, while having the backing of a very large company, please read on.

As a Lead Data Engineer, you will report to the Director, Data and Machine Learning, as well as continuously collaborate with key stakeholders across the business to solve the most important technical problems.

Responsibilities

• Take ownership for achieving objectives and key results for your team, allocate resources, oversee & own technical solutions, communicate schedule, status, and milestones

• Lead and manage a small team of data engineers by setting goals, supervising work, providing guidance, evaluating performance, removing barriers, cultivating career development, and promoting job satisfaction

• Collaborate with cross functional partners (Product Managers, Data Scientists, Machine Learning Engineers, Software Engineers, Business teams) to build data products

• Develop, optimize, and maintain complex ETL processes for moving and transforming data

• Champion code quality, reusability, scalability, security and help make strategic architecture decisions

• Implement processes and tools to ensure data quality, enforce data governance policies and engineering best practices

• Develop APIs and Microservices to expose and integrate data products with software systems

Required Experience & Skills

• Completed BS, MS, or PhD in Computer Science, Mathematics, Statistics, Engineering, Operations Research, or other quantitative field

• 7+ years of experience as a Data Engineer writing code to extract, process and store data within different types of data stores (Snowflake, Postgres, DynamoDB, Kafka, Graph databases)

• 2+ years of leading a cross-functional team to deliver data projects, including 1+ year of experience as a reporting manager of a small team

• Strong programming skills in Python and understanding of core computer science principles

• Experience with building batch and streaming pipelines using complex SQL, PySpark, Pandas, and similar frameworks

• Knowledge of relational and dimensional data modeling concepts to build data products

• Experience with data quality checks, data monitoring solutions

• Experience with orchestrating complex workflows and data pipelines using like Airflow or similar tools

• Experience with Git, CI/CD pipelines, Docker, Kubernetes

• Experience with architecting solutions on AWS or equivalent public cloud platforms.

• Experience with developing data APIs, Microservices and event driven systems to integrate data products

• Strong interpersonal and verbal communication skills

• Leadership experience and the ability to mentor and guide a team

Preferred Experience & Skills:

• Experience in assessing and implementing new data tools to enhance the data engineering stack

• Knowledge of data mesh concepts

• Knowledge in domains such as recommender systems, fraud detection, personalization, and marketing science

• Knowledge of vector databases, knowledge graphs, and other approaches for organizing & storing information

• Familiarity with Snowflake, RDS, DynamoDB, Kafka, Fivetran, dbt, Airflow, Docker, Kubernetes, EMR, Sagemaker, DataDog, PagerDuty, Data Cataloging tools, Data Observability tools and Data Governance tools

Our Core Values

• Be Humble: You’re smart yet always interested in learning from others.

• Work Transparently: You always deal in an honest, direct and transparent way.

• Take Ownership: You embrace responsibility and find joy in having the answers.

• Learn More: Through blog posts, newsletters, podcasts, video tutorials and meetups you regularly self-educate and improve your skill set.

• Show Gratitude: You show appreciation and return kindness to those you work with.

Perks

• Competitive salary.

• Competitive annual bonus targets.

• 401k with dollar for dollar match, up to 6% of eligible earnings (base, bonus). Plus additional company contribution.

• RSU grants (Long Term Incentives) for approved roles.

• Comprehensive medical, dental, vision and life insurance.

• 17 paid holidays per year, including 3 floating holidays.

• Annual Paid Time Off (PTO), with separate sick days

• 12 weeks paid Parental Leave

• Caregiver Leave

• Adoption and Surrogacy Assistance Plan

• Flexible workplace accommodations.

• Free gym membership for those in our Irvine, CA WeWork office.

• We celebrate our wins with opportunities to attend Lakers, Knicks, Anaheim Ducks, Anaheim Angels and NY Rangers games.

• Opportunities to attend concerts, festivals and other live entertainment events in recognition of delivering great work.

• Attend AWS Re:Invent in person (Las Vegas) or virtually each year.

• Tuition reimbursement.

• Attend a tech or marketing conference of your choice each year.

• A MacBook Pro and accompanying hardware to do great work.

• A modern productivity toolset to get work done: Slack, Miro, Loom, Lucid, Google Docs, Atlassian and more.

• Generous discounts on SkinMedica skin care products.

Applicable only to applicants applying to a position in any location with pay disclosure requirements under state or local law:

• The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position. Individual compensation paid within this range will depend on many factors including geographic location, and we may ultimately pay more or less than the posted range. This range may be modified in the future.

• We offer a comprehensive package of benefits including paid time off. (vacation, holidays, sick), medical/dental/vision insurance and 401(k) to eligible employees.

• This job is eligible to participate in our short-term incentive programs.

• This job is eligible to participate in our long-term incentive programs.

Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested and determinable. The amount and availability of any bonus, commission, incentive, benefits, or any other form of compensation and benefits that are allocable to a particular employee remains in the Company's sole and absolute discretion unless and until paid and may be modified at the Company's sole and absolute discretion, consistent with applicable law.

Compensation Range (Minimum - Maximum)

$125,500—$238,500 USD