Data Engineer - Community

Twitch
Apply Now
  • Experience

  • Salary

    $90000-$100000
  • Location

    San Francisco, CA, USA
  • Job Function

    Data Engineer
  • Industry

    Information Technology
  • Qualification

    Degree in Computer Engineering

Key Skills

Apache Airflow, AWS, Big Data Technology, Amazon EMR, Apache Hadoop, Python Programming, R Programming, Amazon RedShift, Spark Core, SQL

Job Description

Data Engineer - Community

San Francisco, CA

You Will:

  • Design, build and maintain a set of trusted data assets for a product or a group of products. 
  • Act as our team’s thought leader for defining data telemetry, storage and ETL processes. 
  • Partner with the Central Data Platform & Analytics teams to standardize data storage, decrease redundancies and evangelize finalized data assets. 
  • Partner with Analytics, Product and Engineering teams to understand data needs.
  • Write software code and data solutions that are high quality and comprehensible. 
  • Have rigor around data architecture best practices: 
  • Create coherent logical data models that drive physical design. 
  • Balance customer requirements with technology requirements.
  • Be proficient in a broad range of data design approaches.
  • Be judicious about introducing dependencies. 
  • Create flexible data solutions without over-engineering. 
  • Understand how to be efficient with resource usage (e.g., system hardware, data storage, query optimization, AWS infrastructure etc.) 
  • Have knowledge of engineering and operational excellence best practices. Be able to make enhancements that improve data processes (e.g., data auditing solutions, management of manually maintained tables, automating, ad-hoc or manual operation steps). 

You Have:

  • 3+ years of industry experience as a data engineer or in a related role, preferably in the consumer internet or gaming space, or working with a high-velocity, high-growth product / business.
  • 3+ years experience in custom ETL design, implementation and maintenance.
  • Proficient in SQL -- comfortable working with complex joins, window functions and writing SQL for aggregations. 
  • Experience working with Amazon Webservices, S3, EMR, Redshift etc.
  • Experience building aggregates, optimizing data workstreams and maintaining data pipelines
  • Comfort working independently, prioritizing projects, and managing stakeholder expectations across teams.
  • Strong written and verbal communication skills.
  • Eager to shape the development of a growing team and contribute to the design of novel products that shape the community experience for millions of viewers and creators.
  • Obsessed with data quality and a strong belief in test driven development

Bonus Points

  • Strong familiarity with Twitch, our creators, and our community.
  • Masters degree (preferred, but not required).
  • Fluency in statistical analysis and programming using Python, R, or similar tools.
  • Prior experience building end-to-end pipelines for supporting experimentation with machine-learning systems (e.g. recommendations, spam & fraud detection, notifications).
  • Experience with a data orchestration framework such as Airflow, AWS Step etc.
  • Experience with big data processing tech such as Spark, Hadoop etc. 

Perks

  • Medical, Dental, Vision & Disability Insurance
  • 401(k), Maternity & Parental Leave
  • Flexible PTO
  • Commuter Benefits
  • Amazon Employee Discount
  • Monthly Contribution & Discounts for Wellness Related Activities & Programs (e.g., gym memberships, off-site massages, etc.),
  • Breakfast, Lunch & Dinner Served Daily
  • Free Snacks & Beverages

Apply Now

Company Info.

Twitch

Twitch is a one-of-a-kind collision of subcultures, games, communities, and streamers co-creating content around everything they’re into. This is more than just watching; this is multiplayer entertainment — unique, live, unpredictable, never-to-be-repeated experiences created by the interactions of many. Twitch brings the joy of co-op to everything gamers love, from anime marathons to esports competitions and more.

  • Industry
    Information Technology
  • No. of Employees
    10,979
  • Location
    San Francisco, CA, USA
  • Website
  • Jobs Posted

Get Similar Jobs In Your Inbox

Twitch is currently hiring Data Engineer Jobs in San Francisco, CA, USA with average base salary of $90000-$100000 per year.

Similar Jobs View More