Staff Software Engineer - Core Data Engineering

Key Skills

Apache, Big Data Technology, Data Biuld Tool - dbt, Data Lake, Data Warehousing, Database, ETL frameworks, Machine learning techniques, Pandas, Snowflake, Spark Core, SQL

Job Description

About the Role

You’ll be a key member of our Core Data Engineering team. You’ll be owning changes to our common code and standard schemas to fit the company’s product needs (i.e. new products and features), and creating tools to help increase our customer integration velocity. If you're interested in building software to support our mission, we hope you'll join us!

• Design, build, scale, and deploy fast and reliable ETL pipelines in Python, Pandas, Spark, SQL, and DBT, - across our data platforms (powered by Databricks, Postgres, Snowflake, and Delta Lakes) - to process billions of data points from US retail stores and to power our recommendation engine and ordering system
• Collaborate with an interdisciplinary team of experts in Go-To-Market, machine learning, data science, product, and product engineering to understand how to properly transform customer data and to implement solutions
• Monitor and analyze data, and work with internal stakeholders to either create dashboards, clearly escalate high-priority issues back to the customer, or find novel workarounds to extract the signal we need from customer data
• Develop standard tools that help increase the velocity at which we can integrate new customers and release new product features

Skills and Experience

The following represents attributes our ideal candidate possesses. We encourage all highly-qualified candidates to apply, even if they do not fulfill all the listed criteria.

• Ability to identify a problem or area of improvement, design, solution, and see it through to implementation
• Strong understanding and experience with various data stores (databases, data warehouses, key/value stores, etc.). Experience with Apache Spark, Pandas, SQL, or other Big Data frameworks and cloud infrastructure preferred
• Experienced with architecture & design of data driven solutions
• Strong problem-solving ability and ability to work through ambiguity and incomplete specifications
• Dedication to code quality, testing, design processes, automation, and operational excellence
• An active stakeholder in engineering tools discussions and help us build and design for future growth
• Excellent written communication, verbal communication, and collaboration skills.