Senior Data Engineer

Key Skills

Aartificial intelligence, Ansible, Apache Airflow, Apache Kafka, AWS, Azure, Data Architecture, Data Engineering, Data science techniques, Database, ETL frameworks, Google Cloud Platform (GCP), Infrastructure as code, Machine learning techniques, Optimization, Python Programming, Snowflake

Job Description

Anaconda is seeking a talented Senior Data Engineer to join our rapidly-growing company. This is an excellent opportunity for you to leverage your experience and skills and apply it to the world of data science and machine learning.

What You’ll Do:

• Create and manage tooling and infrastructure for Anaconda’s data platform.
• Identify and implement process improvements: designing infrastructure that scales, automating manual processes, etc.
• Drive database design and the underlying information architecture, transformation logic, and efficient query development to support our growing data needs.
• Implement testing and observability across the data infrastructure to ensure data quality from raw sources to downstream models.
• Write documentation that supports code maintainability.
• Take ownership of the various tasks that will allow us to maintain high-quality data; ingestion, validation, transformation, enrichment, mapping, storage, etc
• Work closely with Product teams to anticipate and support changes to the data.
• Work with Strategic Operations and Platform teams to build reliable, scalable tooling for analysis and experimentation.
• Values collaboration and is very comfortable with pair programming

What You Need:

• 6+ years of relevant experience as a data engineer or significantly related work
• Foundation & proficiency in Python
• Experience in building, optimizing, and maintaining data architectures
• Experience building ELT pipelines
• Experience with Airflow, Prefect, or other orchestration tools
• Cloud experience, i.e. AWS, Azure, GCP
• Experience with Infrastructure as code, Terraform or CloudFormation, Ansible
• Database experience with relational and non-relational data stores
• Experience working with large data sets, and an understanding of how to write code that leverages the parallel capabilities of Python and database platforms
• Strong knowledge of database performance concepts like indices, segmentation, projections, and partitions
• Experience leading projects with Engineering and Product teams from start to finish
• Team attitude: “I am not done, until WE are done”

Embody our core values: 

• Ability & Humility
• Innovation & Action
• Empathy & Connection
• Care deeply about fostering an environment where people of all backgrounds and experiences can flourish

What Will Make You Stand Out:

• Experience with Kafka or other event-streaming technologies
• Experience with Snowflake
• Experience working in a fast-paced startup environment
• Experience working in an open-source or data science-oriented company

Why You’ll Like Working Here:

• Unique opportunity to translate strong open-source adoption and user enthusiasm into commercial product growth
• Dynamic company that rewards high performers
• On the cutting edge of enterprise application of data science, machine learning and AI
• Collaborative team environment that values multiple perspectives and clear thinking
• Employees-first culture
• Flexible working hours
• Medical, Dental, Vision, HSA, Life and 401K
• Paid parental leave - both parents
• Monthly productivity stipend
• Pre-IPO stock options
• Open vacation policy
• Quarterly Snake days (company-wide bonus day off)
• 100% remote

Perks based on region

Anaconda's compensation philosophy is driven by market analysis based on location. To best ensure pay equity, we typically bring in new hires near the middle of the market band for your region. The recruiter you work with can provide more details on this philosophy.

FTE employees based on your region

An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.

Anaconda, Inc. (“We”, “Us”) are committed to protecting and respecting your privacy. This Privacy Notice sets out the basis on which the personal data collected from you, or that you provide to Us, will be processed by Us in connection with Our recruitment processes. By clicking “Submit Application”, you acknowledge you have read our Privacy Policy and that Anaconda can retain your application data for up to 1-year, unless otherwise stated. For the purpose of the General Data Protection Regulation (“GDPR”) ”) and the version of the GDPR retained in UK law (the “UK GDPR”) the Data Controller is Sydney Artt.