Data Engineer

Key Skills

Apache Airflow, Apache Kafka, Big Data Technology, Data science techniques, Database, ETL frameworks, Git, NoSQL, Python Programming, SPARK Programming, SQL

Job Description

We are looking for someone with experience in designing, building, and maintaining a scalable and robust Data Infra that makes data easily accessible to the Data Science team and the broader audience via different tools. As a data engineer, you will be involved in all aspects of the data infrastructure, from understanding current bottlenecks and requirements to ensuring the quality and availability of data. You will collaborate closely with data scientists, platform, and front-end engineers, defining requirements and designing new data processes for both streaming and batch processing of data, as well as maintaining and improving existing ones. We are looking for someone passionate about high-quality data who understands their impact in solving real-life problems. Being proactive in identifying issues, digging deep into their source, and developing solutions, are at the heart of this role.

JUNIOR: 

What you will do

• Maintain and evolve the current data lake infrastructure and look to evolve it for new requirements
• Maintain and extend our core data infrastructure and existing data pipelines and ETLs 
• Provide best practices and frameworks for data testing and validation and ensure reliability and accuracy of data
• Design, develop and implement data visualization and analytics tools and data products.

What you will need

• Bachelor’s degree in Computer Science, Applied Mathematics, Engineering or any other technology-related field
• Previous experience working in a data engineering project or role
• Fluency in Python
• Previous experience with ETL pipelines and data processing
• Good knowledge of SQL and no-SQL databases
• Good knowledge of coding principles, including Oriented Object Programming 
• Experience with Git

Nice to have

• Experience with Airflow, Google Composer or Kubernetes Engine
• Experience working with Google Cloud Platform
• Experiences with other programming languages, like Java, Kotlin or Scala
• Experience with Spark or other Big Data frameworks
• Experience with distributed and real-time technologies (Kafka, etc..)
• 1-2 years commercial experience in a related role 

MID:

What you will do

• Maintain and evolve the current data infrastructure and look to evolve it for new requirements
• Maintain and extend our core data infrastructure and existing data pipelines and ETLs 
• Provide best practices and frameworks for data testing and validation and ensure reliability and accuracy of data
• Design, develop and implement data visualization and analytics tools and data products.

What you will need

• Bachelor’s degree in Computer Science, Applied Mathematics, Engineering or any other technology-related field
• Previous experience working in a data engineering role
• Fluency in Python
• Previous experience with ETL pipelines
• Experience working with Google Cloud Platform
• In-depth knowledge of SQL and no-SQL databases
• In-depth knowledge of coding principles, including Oriented Object Programming 
• Experience with Git

Nice to have

• Experience with code optimisation, parallel processing
• Experience with Airflow, Google Composer or Kubernetes Engine
• Experiences with other programming languages, like Java, Kotlin or Scala
• Experience with Spark or other Big Data frameworks
• Experience with distributed and real-time technologies (Kafka, etc..)
• 2-5 years commercial experience in a related role 

SENIOR:

What you will do

• Maintain and evolve the current data lake infrastructure and look to evolve it for new requirements
• Maintain and extend our core data infrastructure and existing data pipelines and ETLs 
• Provide best practices and frameworks for data testing and validation and ensure reliability and accuracy of data
• Design, develop and implement data visualization and analytics tools and data products.

What you will need

• Bachelor’s degree in Computer Science, Applied Mathematics, Engineering or any other technology-related field
• Previous experience working in a data engineering role
• Fluency in Python
• Experience in both batch processing and streaming data pipelines
• Experience working with Google Cloud Platform
• In-depth knowledge of SQL and no-SQL databases
• In-depth knowledge of coding principles, including Oriented Object Programming 
• Experience with Git

Nice to have

• Experience with code optimisation, parallel processing
• Experience with Airflow, Google Composer or Kubernetes Engine
• Experiences with other programming languages, like Java, Kotlin or Scala
• Experience with Spark or other Big Data frameworks
• Experience with distributed and real-time technologies (Kafka, etc..)
• 5-8 years commercial experience in a related role 

STAFF:

What you will do

• Maintain and evolve the current data infrastructure and look to evolve it for new requirements
• Maintain and extend our core data infrastructure and existing data pipelines and ETLs 
• Provide best practices and frameworks for data testing and validation and ensure reliability and accuracy of data
• Design, develop and implement data visualization and analytics tools and data products.
• Play a critical role in helping to set up directions and goals for the team
• Build and ship high-quality code, provide thorough code reviews, testing, monitoring and proactive changes to improve stability
• You are the one who implements the hardest part of the system or feature. 

What you will need

• Bachelor’s degree in Computer Science, Applied Mathematics, Engineering or any other technology-related field
• Previous experience working in a data engineering role
• Fluency in Python
• Experience in both batch processing and streaming data pipelines
• Experience working with Google Cloud Platform
• In-depth knowledge of SQL and no-SQL databases
• In-depth knowledge of coding principles, including Oriented Object Programming 
• Experience with Git
• Ability to solve technical problems that few others can do
• Ability to lead/coordinate rollout and releases of major initiatives

Nice to have

• Experience with code optimisation, parallel processing
• Experience with Airflow, Google Composer or Kubernetes Engine
• Experiences with other programming languages, like Java, Kotlin or Scala
• Experience with Spark or other Big Data frameworks
• Experience with distributed and real-time technologies (Kafka, etc..)
• 8+ years commercial experience in a related role

COMPENSATION & PERKS

• Full-time salary based on experience and meaningful equity in an industry-leading company
• Hybrid model working from home & awesome office location in the heart of Paris 
• Unlimited vacation policy; work hard and take time when you need it
• Apple equipment
• The opportunity to be a key player and build your career at a rapidly expanding, global technology company in an emerging field
• Flexible work culture