Principal Big Data Engineer

Key Skills

Java Programming, Design, Python Programming, SQL, Azure, AWS, Apache Hadoop, Data Modeling, Apache Hive, Google Cloud Platform (GCP), Data Analytics, SPARK Programming, Terabyte scale datasets

Job Description

Join AT&T and reimagine the communications and technologies that connect the world. We’re committed to those who seek to discover the undiscoverable and dare to disrupt the norm. Bring your bold ideas and fearless risk-taking to redefine connectivity and transform how the world shares stories and experiences that matter. When you step into a career with AT&T, you won’t just imagine the future – you’ll create it.

The Principal Big Data Engineer will be responsible for interpreting the requirements of various Big Data Analytic Use Cases and scenarios and driving the design and implementation of specific data models to ultimately help drive better business decisions. This role is also accountable for developing the necessary enablers and data platform in the Big Data Environment consisting of Snowflake and Databricks and has the responsibility of maintaining its integrity during the life cycle phases with a particular emphasis on Query Optimization.

The Principal Big Data Engineer will create and automate data pipelines in a cloud environment to build data products. Will be experienced working with both structured and unstructured data as well as handling real time data. Work with users to help them understand the best practices in addition to being a mentor to provide guidance to junior members of the team. Advise teams to optimize the spend in Azure and Snowflake. Utilize CI/CD pipelines to ensure that Cloud resources are brought up using code with all the dependencies in a scripted fashion.

Qualifications

• Preferred Bachelor of Science in Computer Engineering, Computer Science, Applied Science, Electrical Engineering, or Math.
• Developer or Data Analytics nanodegree; or equivalent experience.
• Resident AT&T Business Knowledge, Requirements Gathering, and Business Ready Datasets (BRD) Design.
• Typically requires 8-10- years experience.
• Snowflake (Snowsql, Snowsight, Snowpark, Clustering, Search Optimization, warehouse sizing, Query optimization, evaluation Query profiles)
• Databricks (Working with Python, Spark, Databricks SQL and optimization)
• Experience creating and optimizing SQL queries in Snowflake and Databricks is a plus.
• Conceptual, logical, and physical data modeling experience
• Understanding Cloud concepts such as Compute options and Blob Storage and experience with Cloud infrastructure management with Infrastructure as Code, Certifications that demonstrate Cloud knowledge in any major Cloud (AWS, Azure, GCP)
• Deep understanding of Databases, Datawarehouse’s in general
• The ideal candidate should have at least 8+ years of experience in IT in addition to the following:
• 8+ years of experience working with Data and Analytics
• 5+ Years of working experience with Snowflake
• 5+ years of experience working with Databricks or Hadoop in the Cloud (Hive, Python, Spark etc.)

A career with us, a global leader in communications and technology, comes with big rewards. As part of our team, you’ll lead transformation surrounded by trailblazing industry leaders like you. You’ll be empowered to go above and beyond – making a difference through company-sponsored initiatives or connecting and networking through one of our many employee groups. And regardless of where you’re at in your career trajectory, you’ll be rewarded by the impact that comes with making a difference in the lives of millions. With AT&T, you’ll be a part of something greater, do incredible things and be rewarded with a chance to change the world.