Data Engineer - Metering Platform

Key Skills

Apache Airflow, Apache Hive, Dagger2, Framework, JavaScript, Luigi, Python Programming, Snowflake

Job Description

Metering Platform creates the data processing pipelines that measure our customers’ usage across all Datadog products, providing vital insights to a broad variety of users and internal stakeholders. The team is at the leading edge of any new product we release at Datadog. As a Data Engineer you will use Python and Spark to create highly reliable, verifiably-accurate batch data processing pipelines for a large-scale mission-critical process. Each day we’re processing trillions of data points and petabytes of data to enable critical decision making processes for Datadog and our users.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do:

• Design, build and operate our high-volume data pipelines that power the Metering Platform
• Work cross-functionally across Engineering, Product, and Analytics to help solve their data and product needs
• Work across the data stack, moving fluidly between programming languages: Scala, Python, SQL and more
• Build tooling and automation to run our infrastructure with minimal human intervention
• Join the Data Engineering community at Datadog and help create and set standards and systems that allow sustainable and organic growth
• Own meaningful parts of our processing infrastructure, have an impact, grow with the company

Who You Are:

• You have a BS/MS/PhD in a Computer Science, Engineering or related scientific field or equivalent professional experience
• Significant backend programming experience in one or more languages (Python, Go, Scala, Java, SQL)
• Experience writing data pipelines using a distributed data framework (Spark, Trino, Hive, Snowflake, etc.)
• Knowledge of working with workflow management tools (Luigi, Airflow, Temporal, or Dagster, etc.)
• Skilled in wrangling huge amounts of data and enjoy exploring new data sets
• Someone who values code simplicity and performance
• Interested in working in a fast-paced, high growth environment that respects its engineers and customers

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.

Benefits and Growth:

• Competitive global benefits
• New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
• An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)

Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.

#LI-ER1

About Datadog:

Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.

Equal Opportunity at Datadog:

Datadog is an Affirmative Action and Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.