Senior Data Engineer

Key Skills

3D data processing, Apache Airflow, Apache Beam, Apache Cassandra, Apache Flink, Apache Hadoop, AWS, Azure, Data Engineering, Data pipelines, Google Bigtable, Google Cloud Platform (GCP), Java Programming, Luigi, Machine learning techniques, Product Management, Python Programming, SPARK Programming

Job Description

We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational knowledge through vectors and representations of music content and users’ taste, which are key for Spotify teams to create personalized, engaging experiences. This is a unique opportunity to help develop and improve our next-gen user representations, and shape the way Spotify recommendations work. You’ll be able to grow your skills in engineering at scale, drive a ton of business impact, and join a high-energy, positive team environment!

Join us and you’ll keep millions of users listening to great recommendations every day.

What You'll Do

• Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Google Cloud Platform and the Apache Beam
• Develop, deploy, and operate Java services that impact millions of users
• Work on machine learning projects powering the experience that suits each user individually
• Collaborate with other engineers, product managers and stakeholders, taking on learning and leadership opportunities that will arise every single day
• Deliver scalable, testable, maintainable, and high-quality code
• Share knowledge, promote standard methodologies, making your team the best version of itself through mentorship and constructive accountability.

Who You Are

• You have Data Engineering experience and you know how to work with high- volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure
• You know Scala language well, and are interested in spreading this knowledge in the team
• You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, Flink etc
• You have hands-on experience with high-volume services in Java. Python experience is also a plus
• You might have worked with Docker as well as Luigi, Airflow, or similar tools
• You care about quality and you know what it means to ship high quality code
• You care about agile software processes, data-driven development, reliability, and responsible experimentation
• You understand the value of collaboration and partnership within teams
• If you have experience with (of interest in) product management, that would be a plus, but it’s not required

Where You'll Be

• We offer you the flexibility to work where you work best! For this role, you can be within the Eastern time zone as long as we have a work location.

The United States base range for this position is $156,275.00- 223,250 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future.

Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.