Principal-Big Data Software Engineer

Key Skills

Aartificial intelligence, Apache Hadoop, Apache Hive, Apache Kafka, Apache Pig, Azure, Big Data Technology, Data Lake, Data pipelines, Databricks, Hubspot, Machine learning techniques, MLOps tools, MongoDB, NoSQL

Job Description

Principal-Big Data Software Engineer needed by AT&T Services Inc. in Dallas, Texas [and various unanticipated locations throughout the U.S.; may work from home] to lead big data software engineering development and decisions. Develop high performance, distributed computing tasks using Big Data technologies such as Hadoop, NoSQL, text mining, and other distributed environment technologies. Collaborate with clients concerning business solutions needs with data science involving AI and machine learning.

• Work with clients to asses requirements and understand business needs to communicate solutions and work across teams to find solutions. Drive archetypical, software engineering, and big data usage decisions to independently drive decisions.
• Utilize Big Data programming languages and technology, write code, complete programming and documentation, and performs testing and debugging of applications. Analyze, design, program, debug, and modify software enhancements and/or new products used in distributed, large scale analytics and visualization solutions.
• Interact with data scientists and industry experts to understand how data needs to be converted, loaded, and presented.
• Work in a highly agile environment. Utilize JVM-based function languages including Scala and Clojure, use Hadoop query languages including Pig, Hive, Scalding, Cascalog, and PyCascading. Compute frameworks including Spark and STORM. Develop, design, and generate solutions on Azure Cloud for Online & Offline Feature Store Solutions.
• Develop, design, and generate solutions using Pyspark to create Databricks pipeline for Feature Store.
• Employ H2O DAI, and MLOPS for Data Science and Machine Learning.
• Responsible for Databricks Delta Lake table and Hive tables for offline Feature Store.
• Preform spark Streaming using Kafka and Event Hub. Utilize No SQL DB MongoDB for Metadata, ANSISQL to query data from Feature Store.

REQUIREMENTS:

Requires a Bachelor’s degree, or foreign equivalent degree, in Electrical Engineering and 5 years of progressive, post-baccalaureate experience in the job offered, or 5 years of progressive, post-baccalaureate experience in a related occupation utilizing JVM-based function languages including Scala and Clojure; using Hadoop query languages including Pig, Hive, Scalding, Cascalog, and PyCascading; computing frameworks including Spark and STORM; developing, designing, and generating solutions on Azure Cloud for Online & Offline Feature Store Solutions; and developing, designing, and generating solutions utilizing Pyspark to create Databricks pipeline for Feature Store, H2O DAI, and MLOPS for Data Science and Machine Learning, Azure Databricks Delta Lake table and Hive tables for offline Feature Store, Spark Streaming using Kafka and Event Hub, No SQL DB MongoDB for Metadata, and ANSISQL to query data from Feature Store.

Our Principal-Big Data Software Engineers earn between $164,806 - $254,300 yearly. Not to mention all the other amazing rewards that working at AT&T offers.

Joining our team comes with amazing perks and benefits:

• Medical/Dental/Vision coverage
• 401(k) plan
• Tuition reimbursement program
• Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
• Paid Parental Leave
• Paid Caregiver Leave
• Additional sick leave beyond what state and local law require may be available but is unprotected
• Adoption Reimbursement
• Disability Benefits (short term and long term)
• Life and Accidental Death Insurance
• Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
• Employee Assistance Programs (EAP)
• Extensive employee wellness programs
• Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone