Lead Data Engineer, Direct-to-Consumer, Video Quality

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

As part of the Direct-to-Consumer Quality and CDN Management team, the Lead Data Engineer will be responsible for creating and maintaining systems that ingest and store vast amounts of data from users and internal systems and CDNs. These systems must be scalable, robust, and affordable. In this role, the Lead Data Engineer will work with a variety of technologies that support the building of meaningful models, alerts, and visualizations from vast quantities of data.

Responsibilities include, but are not limited to:

• Lead development of user experience data pipeline
• Assist in cleansing, discretization, imputation, selection, generalization etc. to create high quality features for the modeling process
• Work with business stakeholders to define business requirements including KPI and acceptance criteria
• Use big data, relational and non-relational data sources to access data at the appropriate level of granularity for the needs of specific analytical projects
• Maintains up to date knowledge of the relevant data set structures and participate in defining necessary upgrades and modifications
• Collaborate with software and data architects in building real-time and automated batch implementations of the data science solutions and integrating them into the streaming service architecture
• Drive work on improving the codebase, striving for ultimate efficiencies in code and performance

Qualifications/Requirements

Basic Qualifications

• Minimum ten (10) years working with big data: ETL, pipeline building, analysis, code
• Experience in leading small teams or/and being a lead data engineer on large commercial projects
• Experience implementing scalable, distributed, and highly available systems using Google Cloud and/or AWS
• Experience with data visualization tools and techniques
• Expert-level proficiency in at least one programming language
• Strong skills in data processing using SQL

Eligibility Requirements

• Interested candidate must submit a resume/CV through www.nbcunicareers.com to be considered (note job #: )
• Must have unrestricted work authorization to work in the United States
• Must be 18 years or older
• Availability to travel as required
• It is the policy of NBCUniversal and NBCUniversal’ s affiliated businesses to consider all qualified applicants for employment without regard to race, color, religion, national origin, sex (including pregnancy) sexual orientation, age, disability, veteran status or other characteristics protected by law.

Desired Characteristics

• Experience with BigQuery or similar data service
• Experience with data visualizations
• Working experience with deep learning, particularly in the areas different form computer vision
• Experience with multi-billion record datasets and leading projects that span the disciplines of data science and data engineering
• Knowledge of enterprise-level digital analytics platforms (e.g. Adobe Analytics, Google Analytics, etc.)
• Experience building streaming data pipelines using Kafka, Spark or Flink
• Experience with large-scale video assets
• Team oriented and collaborative approach with a demonstrated aptitude and willingness to learn new methods and tools
• Pride and ownership in your work and confident representation of your team to other parts of NBCUniversal