Big Data Engineer

Key Skills

Amazon RedShift, ETL frameworks, Github, JavaScript, KNIME, Python Programming, Snowflake, SQL

Job Description

What You’ll Do:

• Design and implement a scalable data platform including data management and governance, and integrate structured, and unstructured data using cloud-based services.
• Design and implement solutions on a cloud platform utilizing Infrastructure as code (Terraform).
• Configure custom data pipelines within AWS/Databricks for ingestion into Data Mart
• Maintain, support, and develop within the HR Data Mart Snowflake instance, including code build/review, auditing, performance tuning, and security.
• Create and maintain technical documentation and models for the Data Mart
• Obsess about data integrity, accuracy, and understanding of complex/evolving HR data relationships.
• Partnering with our Enterprise People Analytics team, grow our data infrastructure to support stakeholder insight goals.

What You’ll Need:

• 5+ years of experience in building data engineering solutions utilizing AWS services (S3, Kinesis, Lambda, Glue, SNS) or Data platforms like Databricks/Cloudera.
• 5+ years of experience in building scalable data pipelines from a variety of sources such as APIs, databases, and processing semi-structured and unstructured data.
• Highly skilled and hands-on team member to design, and develop data pipelines using Python, Spark, Spark streaming and Kafka.
• Experience working with Infrastructure as Code preferably Terraform.
• 5+ years' experience with relational databases (Snowflake, Redshift etc.) and SQL
• Proficient in at least one of the programming languages such as Python/Java/GO.
• Experience in data integration and building complex ETL pipelines using ETL tools, including Informatica, Datastage, Clover DX, AWS Glue, Knime.
• Experience with Web Service testing tools such as SoapUI and Postman
• Understanding of Agile methodology, GitHub and CI/CD pipelines

Bonus (if applicable):

• AWS solution architect certification a huge plus
• Experience managing HR data a plus.
• Strong background working with and maintaining database security and access.

Chewy is committed to equal opportunity. We value and embrace diversity and inclusion of all Team Members. If you have a disability under the Americans with Disabilities Act or similar law, and you need an accommodation during the application process or to perform these job requirements, or if you need a religious accommodation, please contact CAAR@chewy.com.