Data Engineer - Data Platform

Key Skills

AWS, AWS Kinesis, C++, Continuous Integration & Continuous Delivery - CI/CD, Data Biuld Tool - dbt, JavaScript, Looker, Python Programming, SQL

Job Description

Job Description

The role

We are looking for an ambitious Data Engineer to join our Data Platform Team. Our team’s mission is to build a world-class data platform that powers our products and analytics.

The Data Platform team ensures internal teams can easily collect, store, process and utilise data to build reports or products aiming to solve business problems. Our focus is on maximising the amount of time internal teams spend on solving business problems and minimising time spent on technical details around implementation, deployment, and monitoring of their solutions.

We're building for scale. As such, much of what we design and implement today will be the technology/infrastructure which will serve hundreds of teams and petabyte-level volumes of data.

How you’ll make an impact

• Build reliable infrastructure and data pipelines in AWS
• Work closely with cross-functional teams to understand their data needs and design solutions that meet their requirements
• Optimise our data stack for performance, scalability, cost-effectiveness and observability
• Increase governance of our datasets through the implementation and adoption of our schema registry, data cataloguing and data discovery solutions
• Monitor and troubleshoot data platform pipelines and proactively find opportunities for improvement
• Solve end-to-end data problems at scale

Qualifications

What we’re looking for

• Strong engineering background with an interest in data

• Creative problem solver with good attention to detail

• Experience working with SQL and Python

• Experience working with (cloud) data warehouses, preferably Snowflake

• Experience describing infrastructure as code using Terraform or similar

• Experience using, crafting, and implementing CI/CD pipelines

• Familiarity with Looker is a plus

• Familiarity with Stream Processing (Kafka or Kinesis) is also a plus

Working with Docker and container deployment is a nice to have

Working with workflow management solutions similar to Airflow as also a nice to have

Familiarity with Java/Scala/C# is a plus

Familiarity working with dbt (or similar SQL pipeline solution like dataform) is also a nice to have

Additional Information

Apply without meeting all requirements statement

If you don't meet all the requirements but think you might still be right for the role, please apply anyway. We're always keen to speak to people who connect with our mission and values.

We believe in equal opportunities

We work as one team. Wherever you come from. However you identify. And whichever payment method you use.

Our clients come from all over the world — and so do we. Hiring hard-working people and giving them a community to thrive in is critical to our success.

When you join our team, we’ll empower you to unlock your potential so you can do your best work. We’d love to hear how you think you could make a difference here with us.

We want to set you up for success and make our process as accessible as possible. So let us know in your application, or tell your recruiter directly, if you need anything to make your experience or working environment more comfortable. We’ll be happy to support you.