Staff Data Engineer

Key Skills

Java Programming, Python Programming, SQL, XML-JSON, Azure, Scala Programming, SPARK Programming, Databricks, Avro

Job Description

Albertsons Companies is at the forefront of the revolution in retail. With a fixation on innovation and building culture, our team is rallying our company around a unique vision: forging a retail winner that is admired for national strength, deep roots in the communities we serve, and a team that has passion for food and delivering great service.

Albertsons is one of the largest retail employers, providing approximately 300,000 jobs across 2,200 stores, 22 distribution centers, 20 food and beverage plants and various support offices. We operate in 34 states and the District of Columbia under the Albertsons banner, as well as Safeway, Tom Thumb, Jewel Osco, Shaw’s and many more recognizable names.

What you will be doing

This individual would have the opportunity to work specifically in the Customer Loyalty area. The Data Engineering team at Albertsons is looking for a candidate who will be responsible for designing, developing, testing, and managing large scale, high-performance data processing systems (batch and/or streaming) in a Multi Cloud environment to provide a robust analytical pipeline. The candidate will have a background in computer science or a related technical field with experiences working with high volume, message-based data integration technologies. A successful candidate will be technically strong, self-starter and business savvy, with a passion to make an impact through creative storytelling and timely actions. This position is located in Pleasanton, California.

Main responsibilities

• Provide technical guidance, leadership, and work in conjunction with other augmented staff to ingest data from varying technologies including internal and external sources.
• Collaborates with the Enterprise Architect (EA) and data modelers, business and the project team to understand business requirements and strategies, ensures completeness of requirements and create suitable solutions to support those needs
• Responsible for leading and mentoring the technical team assigned to a project, on-shore, off-shore and near-shore through all stages of the software development lifecycle
• Responsible for the quality and delivery of the engineering software activities, including adherence to development standards, software design and code reviews, security standards
• Provide input on ways to improve processes, create standards and best practices/policies. 

What we are searching for

• BS in Computer Science, Information Systems, Engineering or Mathematics
• 7+ years proven experience in developing and deploying data pipelines, preferably in the Cloud; Azure and Snowflake experience is a plus
• 5+ years proven experience in SQL, Stored procedures, Relational and Non-relational databases, Data Modeling
• 5+ years proven expertise in creating pipelines for real time and near real time integration
• Extensive experience with technologies like Spark, Databricks, Azure Data Factory or Dataflow to build data pipelines
• 5+ years of experience with at least one programming language like Python, Java, or Scala
• Extensive experience in data transformations for various business use cases
• Knowledge for handling exceptions and automated re-processing and reconciling
• Passion for Data Quality with an ability to integrate these capabilities into the deliverables
• Experience in working with different data sources - flat files, XML, JSON, Avro files and databases
• Knowledge of Jenkins for continuous integration and End-to-End automation for application build and deployments
• Proven experience and ability to work with cross functional teams across the organization
• Proven capabilities for strong written and oral communication skills
• Ability to integrate into a project team environment and contribute to project planning activities
• Experience in developing implementation plans and schedules and preparing documentation for the jobs according to the business requirements

Physical Environment:

• Work may be performed in a temperature-controlled environment.
• Must sit, stand, or walk for extended periods of time.
• May spend long periods of time at desk or computer terminal.
• Will use keyboards, telephone, and other office equipment during the course of normal workday.
• Stooping, bending, twisting, and reaching may be required in completion of job duties.
• Work day is fast paced; some evening and weekend work may be required.