Principal Data Engineer - QuantumBlack

Key Skills

Apache Airflow, Azure, Google Cloud Platform (GCP), Java Programming, PySpark, Python Programming, PyTorch, Scala Programming, SQL, TensorFlow

Job Description

WHO YOU'LL WORK WITH

You will be based in our Santiago or Bogota office as part of our Quantumblack team, serving clients from the LatAm region but also globally. 

You will work with other data scientists, data engineers, machine learning engineers, designers and project managers on interdisciplinary projects using math, statistics and machine learning to derive structure and knowledge from raw data across various industry sectors. 

WHAT YOU'LL DO

As a Principal Data Engineer you will partner with our clients, from data owners and users to C-level executives, to understand their needs and build impactful analytics solutions. 

You will use state of the art technologies to acquire, ingest and transform big datasets. You will design and build data pipelines to support data science projects following software engineering best practices, mapping data fields to hypothesis, as well as curating, wrangling and preparing data to be used in advanced analytics models. You will create and manage data environments in the cloud or on premise, and ensure information security standards are maintained at all times. In addition, you will contribute to cross-functional problem-solving sessions with your team and deliver presentations to colleagues and clients. You will also gain the opportunity to contribute to R&D and internal asset development projects.

This role will require you to be flexible to travel to our clients' offices to deliver presentations, gather information or share knowledge. 

Our tech stack

While we advocate for using the right tech for the right task, we often leverage the following technologies: Python, PySpark, SQL, Airflow, Databricks, our own OSS called Kedro, container technologies such as Docker and Kubernetes, cloud solutions such as AWS, GCP or Azure, and more!

What you'll benefit from:

• Real-World Impact– No project is ever the same. We work with top-tier clients across multiple sectors, providing unique learning and development opportunities internationally.
• Fusing Tech & Leadership– We work with the latest technologies and methodologies and offer first class learning programs at all levels.
• Multidisciplinary Teamwork- Our teams include data scientists, engineers, project managers, UX and visual designers who work collaboratively to enhance performance.
• Innovative Work Culture– Creativity, insight and passion come from being balanced. We cultivate a modern work environment through an emphasis on wellness, insightful talks and training sessions.
• Striving for Diversity– With colleagues from over 40 nationalities, we recognize the benefits of working with people from all walks of life.

Visit ourCareers siteto watch our video and read about our interview processes and benefits.

QUALIFICATIONS

• Master's degree or PhD level in a relevant field such as computer science, machine learning, applied statistics, or mathematics
• 10+ years of relevant experience
• Ability to write clean, maintainable and robust code in Python, Scala, Java or similar languages
• Strong knowledge of software engineering concepts and best practices
• Familiarity with the latest OSS, cloud, container, query languages and database technologies
• Experience building data pipelines in production and ability to work across structured, semi-structured and unstructured data
• Experience preparing data for analytics and following a data science workflow
• Commercial client-facing or senior stakeholder management experience
• Strong command of both English and Spanish