Lead Data Engineer (P3370)

Key Skills

Amazon EMR, Apache Cassandra, Apache Hadoop, Apache Hive, Azure CosmosDB, Business Analytics, Continuous Integration & Continuous Delivery - CI/CD, Data Architecture, Data Modeling, Data science techniques, Data Warehousing, Databricks, ETL frameworks, HDFS, Java Programming, MongoDB, NoSQL, Oracle, PowerBI, PySpark, Python Programming, Scala Programming, SPARK Programming, SQL, Tableau

Job Description

84.51° is a retail data science, insights and media company. We help the Kroger company, consumer packaged goods companies, agencies, publishers and affiliated partners create more personalized and valuable experiences for shoppers across the path to purchase.

Powered by cutting edge science, we leverage 1st party retail data from nearly 1 of 2 US households and 2BN+ transactions to fuel a more customer-centric journey utilizing 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.

Join us at 84.51°! 

As a Lead Data Engineer, you will cultivate strategies and solutions to ingest, store and distribute our big data. Our data engineers use Python, Hadoop, PySpark, Hive, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.

Responsibilities

Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities:

• Lead design of Hadoop and SQL based solutions
• Perform development of Hadoop and SQL based solutions
• Execute unit and integration testing
• Collaborate with senior resources to ensure consistent development practices
• Provide mentoring to junior resources
• Bring new perspectives to problems and be driven to improve yourself and the way things are done

Requirements

• 5+ years proven ability of professional Data Development experience
• 5+ years proven ability of developing with Hadoop/HDFS and SQL (Oracle, SQL Server)
• 3+ years of experience with PySpark/Spark
• 3+ years of experience developing with either Python, Java, or Scala 
• 1+ years of experience with Databricks 
• Full understanding of ETL concepts and Data Warehousing concepts
• Exposure to VCS (Git, SVN)
• Strong understanding of Agile Principles (Scrum)
• Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)

 Preferred Skills – Experience in the following

• Experience with Azure 
• Exposure to NoSQL (Mongo, Cassandra)
• Exposure to Service Oriented Architecture
• Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.) 
• Proficient with Relational Data Modeling and/or Data Mesh principles
• Experience with CI/CD - Continuous Integration/Continuous Delivery