Lead Data Engineer

Key Skills

Amazon Elastic Compute Cloud-EC2, Amazon Simple Storage Service (S3), Apache Airflow, AWS, Data management, Data science techniques, Databricks, Effective communication skills, ETL frameworks, Python Programming, Snowflake, SQL

Job Description

The Decision Science Product team resides within the Disney Decision Science + Integration (DDSI) organization. DDSI provides internal consulting services for clients across The Walt Disney Company. The DDSI team sits at the intersection of business strategy, advanced analytics, and technology integration to help our partners explore opportunities for analytics, shape business decisions, and drive value. Our work includes conceptualizing new solutions, solution design, custom code engineering / application development, implementation and integration with business processes and technologies.

The successful candidate will be data-driven and business-minded, and will be passionate about solving business opportunities through data analysis and application development. In this position, you will transform data into meaningful business insights and recommended actions. The role will include working with analytically minded peers, where you are expected to contribute to and challenge the current knowledgebase. You will lead improvements of existing solutions or development of new solutions by scoping, implementing, and testing these solutions in order to address business problems. You should enjoy connecting with clients to brainstorm ways to better support business decisions, being a thought leader in analytical settings, solving high-value complex problems, and managing / improving software systems.

Responsibilities:

• Act as a Company-wide consultant leveraging knowledge of existing data structures and business knowledge to solve problems.
• Own the vision for analytical systems (or subsystems), be accountable for integrating these systems into existing business processes and software, and define and maintain the consolidated product roadmap for future ongoing evolution of these systems.
• Be an expert in the data; including source systems, design data integration solutions, data validation, and data testing processes.
• Be an expert in our applications; understand how our systems and applications receive data, how it is stored and used, and the underlying processes that leverage it.
• Be a problem solver; when presented with new challenges, you are expected to research and network to find solutions.
• Develop custom-code solutions that are production-ready; when a solution is needed for a specific business problem, support the full application lifecycle.
• Be a hands-on data expert who writes new/custom SQL and Python to extract, translate, and load data (ETL)
• Seek out answers to business problems, and look for opportunities to automate processes.
• Collaborate with partners in Data Engineering, App Engineering, and Decision Science throughout the development process to ensure products are built cohesively
• Proactively communicate with technical and non-technical stakeholders, seek to learn and understand, and potentially challenge existing processes in order to continuously seek improved efficiencies.

Required Qualifications:

• Must have 3+ years of progressively complex experience in software or data engineering - professional experience not just academic
• 3+ years experience with Python
• 4+ years experience with SQL
• 2+ years experience with cloud based technologies, preferably AWS EMR, EC2, and S3
• 2+ years leveraging, designing and/or building relational databases (preferably Postgres or Snowflake)
• 2+ years of experience using Gitlab/Github
• 2+ years of experience using Docker
• Experience working with large datasets and big data technologies, preferably cloud-based, such as Snowflake, Databricks, or similar
• Experience using Apache Airflow
• Proven ability to leverage best practices around data engineering application development processes

• Experience with cloud-based application development and deployment
• Demonstrated excellent written and verbal communication skills
• Demonstrated excellent interpersonal skills, including ability to partner with others and build consensus in a cross-functional team toward a desired outcome
• Proven ability to organize and prioritize work
• Ability to adapt to a rapidly changing business environment and priorities
• Advanced proficiency with multiple client- or internal systems and databases
• Experience delivering custom-written code across multiple product environments (Development to Production)
• Proficient in a variety of data science methods, scalable infrastructure setup, software development, and system architecture plus a basic understanding of system design / architecture

Preferred Qualifications:

• Knowledge of the fields of revenue management, advertising technology (AdTech), and/or pricing strategies
• Knowledge of Media Ad Sales (Linear and/or Digital)
• Strong understanding of advanced analytical methods
• Experience developing short- and long-term product roadmaps for implementation and sustainment
• Technical expertise applied to rapidly changing, highly agile requirements
• Proficiency in automating and improving existing processes
• Knowledge of machine learning methods
• Experience with Nielsen audience data or similar
• Experience with or understanding of Data Management Platforms

Required Education:

• Bachelor's degree in Computer Science, Engineering, Mathematics, Finance, Economics, Data Mining, Analytics, Statistics, or other quantitative field; Master's Degree preferred.

About The Walt Disney Company (Corporate):

At Disney Corporate you can see how the businesses behind the Company’s powerful brands come together to create the most innovative, far-reaching and admired entertainment company in the world. As a member of a corporate team, you’ll work with world-class leaders driving the strategies that keep The Walt Disney Company at the leading edge of entertainment. See and be seen by other innovative thinkers as you enable the greatest storytellers in the world to create memories for millions of families around the globe.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise with the following business segments: Disney Entertainment, ESPN, Disney Parks, and Experiences and Products. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.