Lead Engineer - Data Ops

Key Skills

Amazon Elastic Compute Cloud-EC2, Amazon Simple Storage Service (S3), AWS, AWS Glue, Cloud computing, CloudFormtion, Continuous Integration & Continuous Delivery - CI/CD, Data pipelines, DataOps, DevOps, JIRA, Lambda, Leadership, Linux Operating system, Python Programming, Spark Core, SQL, Terraform

Job Description

There’s never been a more exciting time to join United Airlines. We’re on a path towards becoming the best airline in the history of aviation. Our shared purpose – Connecting People, Uniting the World – is about more than getting people from one place to another. It also means that as a global company that operates in hundreds of locations around the world with millions of customers and tens of thousands of employees, we have a unique responsibility to uplift and provide opportunities in the places where we work, live and fly, and we can only do that with a truly diverse and inclusive workforce. And we’re growing – in the years ahead, we’ll hire tens of thousands of people across every area of the airline. Our careers include a competitive benefits package aimed at keeping you happy, healthy and well-traveled. From employee-run Business Resource Group communities to world-class benefits like parental leave, 401k and privileges like space available travel, United is truly a one-of-a-kind place to work. Are you ready to travel the world?

We believe that inclusion propels innovation and is the foundation of all that we do. United's Digital Technology team spans the globe and is made up of diverse individuals all working together with cutting-edge technology to build the best airline in the history of aviation. Our team designs, develops and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.

Key Responsibilities:

Overview

United Airlines is seeking dedicated people to join the Data Engineering team. The organization is responsible for driving data driven insights & innovation to enable the Data Engineering and Machine Learning needs for commercial and operational projects with a digital focus. This role will frequently collaborate with business partners, data scientists and ML engineers. This role will design and enable key subsystems of the Data Platform, optimize operational critical metrics, and establish processes and best practices. As part of the platform team, this role will work in innovative cloud technologies from AWS and other ecosystems, including but not limited to Airflow, OpenTelemetry, OpenLineage, Marquez, Great Expectations, and others.

Responsibilities

• Partner with development teams and other department leaders/stakeholders to provide innovative technical solutions that enable business capabilities.
• Participate and lead in design and development of innovative batch and streaming data applications using AWS technologies. Support large scale data pipelines in a distributed and scalable environment. Enable and optimize production AWS environment for data infrastructure and frameworks.
• Set up containers and Serverless platform with cloud infrastructure.
• Provide the team technical direction and approach to be undertaken and guide them in resolution of queries/issues.

United values diverse experiences, perspectives, and we encourage everyone who meets the minimum qualifications to apply. While having the desired qualifications make for a stronger candidate, we encourage applicants who may not feel they check ALL of those boxes! We are always looking for individuals who will bring something new to the table!

Qualifications

What’s needed to succeed (Minimum Qualifications):

• Bachelor’s degree and 8+ years of professional experience
• 4+ years of professional experience managing infrastructure and data pipelines using Cloud Formation, Terraform, PySpark, Airflow, or similar technologies
• 2+ years of experience in leading a team that engineers, architects, or support solutions on AWS
• Working knowledge of common AWS technologies – EC2, S3, IAM, Lambda, Glue, SNS, others
• General awareness of other AWS technologies
• Working knowledge with CI/CD tools, SQL, Python, Spark, Version control system, JIRA.
• Hands on experience with any object-oriented programming language
• Must be legally authorized to work in the United States for any employer without sponsorship.

What will help you propel from the pack (Preferred Qualifications):

• AWS Certification – Solutions Architect, DevOps Engineer or similar
• Experience with Data Quality tools – Great Expectations, Deequ, or similar
• Excellent knowledge and experience in Linux operating system or Windows

United Airlines is an equal opportunity employer. United Airlines recruits, employs, trains, compensates and promotes regardless of race, religion, color, national origin, gender identity, sexual orientation, physical ability, age, veteran status and other protected status as required by applicable law. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions. Please contact JobAccommodations@united.com to request accommodation.