Senior Data Engineer, Streaming

Key Skills

Amazon RedShift, Apache Flink, AWS, Continuous Integration & Continuous Delivery - CI/CD, Data Biuld Tool - dbt, Data Engineering, Data Modeling, Data pipelines, Data science techniques, JVM, Machine learning techniques, Python Programming, Scala Programming, SPARK Programming, SQL

Job Description

About the Role:

With such a large catalog of content, data and machine learning are fundamental to Tubi's success, and Tubi's Data Platform is the cornerstone of all data and ML use. At Tubi, you will join a stellar team of engineers with a passion for solving the most challenging problems using cutting-edge technology. In this Lead Data Engineering role, you will be expected to be a hands-on leader, leading by example as you and your team build out real-time systems to handle data at massive scale. You will enable machine learning engineers to iterate and experiment faster than ever before. You will help data scientists take ideas to production in days or weeks, not months or years. And you will build tools to enable data analysis and modeling for even the least tech-savvy colleagues. In short, you will enable Tubi to be truly data-driven.

Responsibilities:

• Handle the collection and processing of large scale raw data.
• Building low latency and low maintenance data infrastructure that powers the whole company
• Develop and enhance our analytics pipeline by creating new tools and solutions to facilitate intuitive data consumption for stakeholders
• Constructs and improves infrastructure for data extraction, transformation, loading and cleaning from diverse sources using API’s, SQL and AWS technologies.
• Improving data quality by building tools, processes and pipelines to enforce, check and manage data quality at a large scale.
• Implement CI/CD pipelines for data operations ensuring efficient and smooth deployment of data models and applications.
• Address ad hoc data requests and core pipeline tasks

Your Background:

• 5+ years of experience building scalable batch and streaming data pipelines (Spark or Flink)
• 3+ years of experience designing and implementing pipelines for ETL and cleaning of data from a wide variety of sources using API’s, SQL, Spark and AWS technologies.
• Greenfield data warehouse modeling experience
• Strong knowledge of Streaming, distributed databases, and cloud storage (e.g., S3).
• Strong experience in JVM language (Scala is not required, but preferred)
• Prior experience with Kafka, Kinesis, or equivalent.

Pursuant to state and local pay disclosure requirements, the pay range for this role, with final offer amount dependent on education, skills, experience, and location is listed annually below. This role is also eligible for an annual discretionary bonus, long-term incentive plan, and various benefits, including medical/dental/vision, insurance, a 401(k) plan, paid time off, and other benefits in accordance with applicable plan documents.

California, New York City, and Westchester County, NY

$187,000 - $269,000 USD

Tubi is a division of Fox Corporation, and the FOX Employee Benefits summarized here, covers the majority of all US employee benefits. The following distinctions below outline the differences between the Tubi and FOX benefits:

• For US-based non-exempt Tubi employees, the FOX Employee Benefits summary accurately captures the Vacation and Sick Time.
• For all salaried/exempt employees, in lieu of the FOX Vacation policy, Tubi offers a Flexible Time off Policy to manage all personal matters.
• For all full-time, regular employees, in lieu of FOX Paid Parental Leave, Tubi offers a generous Parental Leave Program, which allows parents twelve (12) weeks of paid bonding leave within the first year of the birth, adoption, surrogacy, or foster placement of a child. This time is 100% paid through a combination of any applicable state, city, and federal leaves and wage-replacement programs in addition to contributions made by Tubi.
• For all full-time, regular employees, Tubi offers a monthly wellness reimbursement.

Tubi is proud to be an equal opportunity employer and considers qualified applicants without regard to race, color, religion, sex, national origin, ancestry, age, genetic information, sexual orientation, gender identity, marital or family status, veteran status, medical condition, or disability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider employment for qualified applicants with arrest and conviction records. We are an E-Verify company.