(Senior) Data Engineer, Customer Science - Global Data (f/m/d)

Key Skills

Java Programming, Python Programming, Framework, SQL, Scrum Agile Methodology, Machine learning techniques, Data science techniques, Google BigQuery, Apache Airflow, Docker, Kubernetes-K8s, Continuous Integration & Continuous Delivery - CI/CD, SPARK Programming, Github, Data pipelines

Job Description

The Customer Science Squad that you’ll be joining consists of expert data scientists, data engineers, machine learning engineers, and data analysts working together on leveraging customer knowledge, developing key insights and models that will improve the experience of the customers on our platforms.

Working with us you will deliver data products on a global scale (50+ countries) and solutions to different departments across the Delivery Hero group. You will get hands-on experience with the newest technologies on GCP, like VertexAI, and experience a multi-cloud production environment with AWS and GCP.

You will get domain expertise on Machine Learning topics and you will help to productionalize models and algorithms working closely with data scientists and machine learning engineers.

On a typical day, you will align with data scientists on the pipeline design and evaluate data availability (behavioral, segments, marketing, predictions, … ) and complexity with data analysts, or you will work on the pipeline implementation and cooperate with machine learning engineers on the model deployment. You will take responsibilities from the first day that will influence our solutions and create direct impact for stakeholders.

Your mission:

• Develop and deploy end-to-end streaming and batch data pipelines to enable training and serving of machine learning models.
• Navigate various data sources and efficiently locate data in a complex data ecosystem (including behavioral data).
• Develop measures of data and model quality, and automated tests of the quality of data powered features.
• Work closely with our data analysts and data scientists to build data models and metrics, and integrate their code into the data pipeline.
• Take care of data infrastructure and deliver highly available services to production.
• Setup best coding practices in the squad, ensure the quality of our products and enable them on a global scale.

Your heroic skills:

• BSc/MSc in Computer Science or related.
• At least 3 years of experience building and running highly resilient cloud data infrastructures in a professional working environment.
• Experience writing Python applications using coding standards, patterns, implementing test suites, and comfortably debugging existing applications.
• Expert knowledge of SQL (PL/SQL).
• Good understanding of distributed and highly scalable data processing pipelines.
• Experience with Apache Airflow or similar technologies.
• Experience using: Docker, Spark, k8s, Bigquery.
• Experience with CI/CD tools and frameworks like GitHub Actions and Travis.

Nice to have:

• Experience working in close collaboration with data analysts and data scientists on delivering data products.
• Experience working with Cloud environments: Google Cloud Platforms and/or Amazon Web Services
• General Data Science knowledge: basic AI and Machine learning concepts.
• Experience in an agile environment (Scrum)
• Infrastructure as code: Terraform