Sr Software Data Engineer

Key Skills

Java Programming, Python Programming, MongoDB, Database, SQL, XML-JSON, Azure, Big Data Technology, Apache Kafka, Scala Programming, Apache Cassandra, NoSQL, Continuous Integration & Continuous Delivery - CI/CD, HDFS, Apache NiFi, PySpark, Sqoop, SPARK Programming, HBase, Databricks

Job Description

Albertsons Companies is at the forefront of the revolution in retail. With a fixation on innovation and building culture, our team is rallying our company around a unique vision: forging a retail winner that is admired for national strength, deep roots in the communities we serve, and a team that has passion for food and delivering great service.

Albertsons is one of the largest retail employers, providing approximately 300,000 jobs across 2,200 stores, 22 distribution centers, 20 food and beverage plants and various support offices. We operate in 34 states and the District of Columbia under the Albertsons banner, as well as Safeway, Tom Thumb, Jewel Osco, Shaw’s and many more recognizable names.

What you will be doing

Help to build Albertsons Digital Fulfillment platforms and deliver on a multi-year roadmap that delivers new and optimized fulfillment solutions. Albertson's Companies is looking for people who are interested in re-imagining the grocery experience by harnessing the power of digital technologies. The right candidate will be part of a fast moving and highly visible team and will pave the way in building a scalable platform for delivering a wide variety of data engineering and analytic solutions.

The role will be responsible for the operation, continuous improvement and innovation of the E-commerce Fulfillment platform and footprint for delivering a wide variety of data and analytic solutions for various business stakeholders. The individual in this role will provide input on ways to improve our processes, incorporate best practices and policies. Must have strong communication skills with the ability to discuss and present information and issues across a wide variety of individuals and groups (inside and outside of IT). In addition, this individual must have a proven track record of working successfully with cross-functional teams delivering high quality and complex solutions within the IT space. This position is in Pleasanton, California.

Main responsibilities

• Responsible for leading the technical team assigned to a project, on-shore, off-shore and near-shore through all stages of the software development lifecycle.
• Provides technical guidance, training and mentoring to development teams on Solution and Technical designs.
• Collaborates with the Enterprise Architect (EA) and Solution Architects, business and the project team to understand business requirements and strategies, ensures completeness of requirements and create suitable software solutions to support those needs.
• Responsible for the quality and delivery of the App Dev software activities, including adherence to development standards, software design and code reviews, security standards.
• Leverages existing and participates in the creation and augmentation of new and existing reusable service components and patterns.
• Defines the structure of systems, their interfaces, and the principles that guide its organization, software design and implementation.
• Ensures Integration Requirements & Designs are supported by defined Development Patterns and if required augments them as new patterns emerge.
• Ensures that the solution design align with the Target Architecture for the project.
• Use Agile SCRUM to deliver solutions with high level of flexibility and adaptability.
• Foster a culture of innovation in the team and encourage creative solutions
• Defines and supports reusable application components from a business and technology perspective.
• Contributor to application development principles and patterns.
• Partners with other Tech Leads and Architects in driving modular, services-oriented integration and solutions architectures.
• Ensure Target solutions are achievable and are accountable for ensuring that the Solution design strategy can be implemented working along a sequence of events/steps in achieving the Target Architecture
• Has a mindset and believes in CI/CD, Automation in developing modern software.
• Direct a team of project managers, architects, engineers, analysts, and others in delivering big data capabilities.
• Invest time in coaching and mentoring team members.
• Provide timely and honest feedback and assessments.
• Deliver clear messages that provide recognition and foster improvement.
• Know people in your team as individuals.
• Encourage the team to innovate and to be creative.
• Delivery the necessary forecast for the resources and funding that is needed to achieve the work plans.

What we are searching for

• Bachelor's or master's degree in Computer Science or equivalent
• 7+ plus years of specialization with data, big data and analytics platforms.
• 4+ years proven experience in developing and deploying data pipelines , preferably in the Cloud; Azure and Snowflake experience is a plus.
• 2+ years of proven expertise in creating pipelines for real time and near real time integration.
• Preferred experience working with Azure databricks, Azure data factory, pyspark and other relevant technologies in Azure Microsoft Azure cloud.
• Industry experience in software development, data engineering, business intelligence, data science, or related field with experience in manipulating, processing, and extracting value from datasets .
• Proven experience with Spark SQL, Spark Streaming and using Core Spark API to explore Spark features to build data pipelines.
• Strong experience with at least one programming language like Python, Java or Scala
• Expert in writing SQL statements.
• Hands-on experience in productionizing and deploying Big Data platforms and applications. Hands-on experience working with: Relational/SQL, distributed columnar data stores/NoSQL databases (MongoDB or Cassandra), graph databases, timeseries databases, HDFS, HBase, Map Reduce, NiFi, Spark streaming, Kafka, Sqoop, Hive, Oozie, Avro, and more
• Databricks and Delta table knowledge is a plus.
• Extensive experience in data transformations for Retail business use cases will be a plus.
• Knowledge for handling exceptions and automated re-processing and reconciling
• Passion for Data Quality with an ability to integrate these capabilities into the deliverables.
• Prior use of Big Data components and the ability to rationalize and align their fit for a business case.
• Experience in working with different data sources - flat files, XML, JSON, Avro files and databases.
• Proficiency in techniques for slowly changing dimensions.
• Knowledge of Jenkins for continuous integration and End-to-End automation for application build and deployments
• Ability to integrate into a project team environment and contribute to project planning activities.
• Experience in developing implementation plans and schedules and preparing documentation for the jobs according to the business requirements.
• Lead ambiguous and complex situations to clear measurable plans.
• Proven experience and ability to work with people across the organization and skilled at managing cross-functional relationships and communicating with leadership across multiple organizations.
• Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights visually in a meaningful way.
• Proven capabilities for strong written and oral communication skill with the ability to synthesize, simplify and explain complex problems to different audiences.

Physical Environment:

• Work may be performed in a temperature-controlled environment.
• Must sit, stand, or walk for extended periods of time.
• May spend long periods of time at desk or computer terminal.
• Will use keyboards, telephone, and other office equipment during the course of normal workday.
• Stooping, bending, twisting, and reaching may be required in completion of job duties.
• Work day is fast paced; some evening and weekend work may be required.

What it is like at Albertsons?

Albertsons Culture Principles

• Compassion: We always treat each other with kindness and respect
• Team: We always support and recognize each other
• Inclusive: We always value everyone’s perspective
• Learning: We always strive to grow and develop ourselves and others
• Competitive: We always act with integrity to win over the customer
• Ownership: We always take actions to drive our success