Data Engineer IV - Media

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

Responsible for maintaining scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science by gathering and processing raw data at scale. Profiles data to measure quality, integrity, accuracy, and completeness and delivers solutions by developing, testing, and implementing code and scripts. Develop data set processes for data modeling, mining, and consumption.

MAJOR DUTIES AND RESPONSIBILITIES

• Actively and consistently supports all efforts to simplify and enhance the customer experience.
• Create and maintain scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science.
• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
• Use ETL processes in order to maintain, improve, clean, and manipulate data.
• Profile data to measure quality, integrity, accuracy, and completeness.
• Develop and implement tools, scripts, queries, and applications for ETL/ELT and data operations.
• Design, build, and automate Machine Learning Data Pipeline.
• Deliver solutions by developing, testing, and implementing code and scripts.
• Produce reports and uphold data delivery schedules.
• Manage life cycle of multiple data sources.
• Work closely with stakeholders on the data demand side (analysts and data scientists).
• Increase speed to delivery by implementing workload/workflow automation solutions.
• Perform other duties as assigned.

REQUIRED QUALIFICATIONS

Skills/Abilities and Knowledge

• Ability to use a wide variety of open source technologies and cloud services
• Adept coding/scripting experience using Python, R, shell scripts
• Adept experience with SQL, Tableau, ML Pipeline techniques, and ETL techniques
• Adept background in Linux/Unix/CentOS installation and administration; Windows experience preferred
• Adept knowledge in data storage that demonstrates knowledge of when to use a file system, relational database, or NoSQL variant
• Adept experience with Spark, and Hadoop/Hive
• Adept familiarity with JavaScript API, Rest API or Data Extract APIs
• Adept experience receiving, converting, and cleansing big data
• Adept experience with visualization or BI tools, such as Tableau
• Adept experience with data workflow/data prep platforms, such as Airflow, Infomatica, Pentaho, or Talend
• Ability to identify and resolve end-to-end performance, network, server, and platform issues
• Attention to detail with the ability to effectively prioritize and execute multiple tasks

EDUCATION

Bachelor's degree in an engineering discipline or computer science

RELATED WORK EXPERIENCE

• Hands-on working experience with RDBMS, SQL, scripting, and coding
• Linux/Unix/CentOS system admin

PREFERRED QUALIFICATIONS

• Adept coding/scripting experience using Python, R, shell scripts
• Adept experience with data workflow/data prep platforms, such as Airflow, Infomatica, Pentaho, or Talend
• Expert knowledge of best practices and IT operations in an always-up, always-available service
• Adept experience receiving, converting, and cleansing big data
• Adept experience with visualization or BI tools, such as Tableau
• Adept experience receiving, converting, and cleansing data
• Knowledge of best practices and IT operations in an always-up, always-available service
• Create proof of concept experiments for analytics, machine learning, or visualization tools that include hypothesis, test plans, and outcome analysis
• Leadership experience in advanced operational analytics