Data Platform Engineer, Streaming Compute

Key Skills

Java Programming, Python Programming, C++, GoLang

Job Description

We’re Coinbase. We’re the world’s most trusted way to join the crypto revolution, serving more than 89 million accounts in more than 100 countries.

Our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web 3.0 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who always lead the group project? That’s us.

There are a few things we look for across all hires we make at Coinbase, regardless of role or team. First, we look for candidates who will thrive in a culture like ours, where we default to trust, embrace feedback, and disrupt ourselves. Second, we expect all employees to commit to our mission-focused approach to our work. Finally, we seek people who are excited to learn about and live crypto, because those are the folks who enjoy the intense moments in our sprint and recharge work culture. We’re a remote-first company looking to hire the absolute best talent all over the world.

Who you are:

• You’ve got positive energy. You’re optimistic about the future and determined to get there. 
• You’re never tired of learning. You want to be a pro in bleeding edge tech like DeFi, NFTs, DAOs, and Web 3.0. 
• You appreciate direct communication. You’re both an active communicator and an eager listener - because let’s face it, you can’t have one without the other. You’re cool with candid feedback and see every setback as an opportunity to grow.
• You can pivot on the fly. Crypto is constantly evolving, so our priorities do, too. What you worked on last month may not be what you work on today, and that excites you. You’re not looking for a boring job.
• You have a “can do” attitude. Our teams create high-quality work on quick timelines. Owning a problem doesn’t scare you, but rather empowers you to take 100% responsibility for achieving our mission.
• You want to be part of a winning team. We’re stronger together, and you’re a person who embraces being pushed out of your comfort zone.

The Data Platform team builds and operates systems to centralize all of Coinbase's internal and third-party data, making it easy for teams across the company to access, process, and transform that data for analytics, machine learning, and powering end-user experiences. As an engineer on the team you will contribute to the full spectrum of our systems, from managing foundational processing and data storage, to building and maintaining scalable pipelines, to developing frameworks, tools, and internal applications to make that data easily and efficiently available to other teams and systems.

We have a number of open roles within the Data Platform team, each with a different focus area; read on to see if you’ll be a good fit for Streaming Compute!

What you’ll be doing:

• Support and operate our MSK clusters by integrating services and features as necessary to make it fully self-service and self-managing.
• Become an expert at operating and managing our Databricks clusters, ensuring it as a stable, secure platform for large volume streaming data processing and analysis.
• Build and maintain the infrastructure needed to support a wide range of streaming use cases both within the team and externally.
• Work closely with other teams to evangelize best practices through documentation, tutorials, examples, and complete implementations

To succeed in this role, we also look for:

• Extensive experience building streaming applications and streaming platforms, both as a client and as an operator. 
• Well-versed in industry best practices, and you are as comfortable discussing and communicating architectural designs and patterns as you are implementing them.
• Hands-on experience building streaming data systems using Spark on Kafka.
• Hands-on experience building change data capture pipelines using open-source systems such as Debezium and Databricks.
• Hands-on experience standing up, operating, and maintaining Kafka and Spark clusters.

Requirements:

• 3+ years of relevant work experience; 7+ years for a senior role.
• Strong Python or Java backend development skills.
• General experience working with data systems or data pipelines
• Leverage your Python, Airflow, and Looker expertise to scale our Airflow data pipelines to the next 10x level

Preferred (not required):

• Experience with core AWS services and concepts (S3, IAM, autoscaling groups), or devops experience.

Notice for Colorado applicants as required by sb19-085 (8-5-20). Target annual salary for this role performed in Colorado is either $140,250 or $175,000 + target bonus + target equity + benefits (including medical, dental, vision and 401(k)).

Benefits at Coinbase

• Health, Dental, and Vision insurance covered at 100% for employees and 80% for dependents
• HSA plan with company seed
• Disability and Life Insurance
• 401(k) plan with company match
• $260 monthly Commuter Benefit
• Monthly Gym Benefit
• Volunteer Time Off
• Fertility Counseling and Benefits
• Learning and Development stipend
• 18 weeks paid Parental Leave
• Meals and Snacks provided onsite
• The option of getting paid in digital currency