Lead Data Engineer

Key Skills

Apache Airflow, Apache Hadoop, AWS, Big Data Technology, Data Analytics, Data Engineering, Data science techniques, Data Warehousing, ETL frameworks, Leadership Skill, Python Programming, Scala Programming, SLA, Snowflake, SPARK Programming, SQL

Job Description

Our Data and Analytics team for Disney Streaming Services (DSS), a segment under the Disney Entertainment & ESPN Technology (DE&ET) is looking for a Lead Data Engineer. Data is essential for all our decision-making needs whether it’s related to product design, measuring advertising effectiveness, helping users discover new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Engagement and Retention Data Engineering team is seeking a highly motivated Data Engineer with a strong technical background and passionate about diving deeper into Big Data to develop state of the art Data Solutions.

What You'll Do

• Contribute to the design and growth of our Data Products and Data Warehouses around Engagement and Retention Analytics and Data Science
• Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data environments (cloud, on-prem, hybrid)
• Our tech stack includes Hadoop, AWS, Snowflake, Spark and Airflow and languages include Python, Scala
• Help architect data solutions/frameworks and define data models for the underlying data warehouse and data marts
• Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions
• Maintain detailed documentation of your work and changes to support data quality and data governance
• Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)
• Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team

Key Qualifications

• At least 7 years of data engineering experience developing large data pipelines
• Strong SQL skills and ability to create queries to extract data and build performant datasets
• Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data
• Strong programming skills in Python, Java/Scala
• Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query)
• Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines
• Strong in Data Modeling techniques and Data Warehousing standard methodologies and practices
• Familiar with Scrum and Agile methodologies
• You are a problem solver with strong attention to detail and excellent analytical and communication skills
• Nice to have experience with Cloud technologies like AWS (S3, EMR, EC2)

Required Education

• Bachelor’s or Master’s Degree in Computer Science, Information Systems or related field

Additional Information

#DISNEYTECH

The hiring range for this position in California is $149,240 - $200,200 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

The hiring range for this position in Santa Monica, CA is $149,240 to $200,00 per year and in San Francisco, CA is $163,426-$219,230. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial and/or other benefits, dependent on the level and position offered.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise with the following business segments: Disney Entertainment, ESPN, Disney Parks, and Experiences and Products. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.