Lead Data Engineer

Key Skills

AWS, Azure, Continuous Integration & Continuous Delivery - CI/CD, Data Analysis, Data Lake, Data Modeling, Data pipelines, Data Warehousing, ETL/ELT technologies, Google Cloud Platform (GCP), KSql, Leadership Skill, PySpark, Python Programming, SQL

Job Description

Job Purpose

This is an exciting opportunity to lead, design and develop highly scalable and extensible data pipelines that enable collection, storage and distribution, modeling and analysis of large data sets from a variety of channels.

What you'll do

• You will be a part of performing complex analysis, design, development, testing, and debugging of computer system application software for a large utility company that is digitizing and modernizing the grid!
• You will work on software design, operating architecture integration, and selection of computer systems. You will be a large part of architecture conversations. 
• You will apply knowledge of one or more technologies, and of one or more platforms and programming languages. (ex: Python, PySpark).
• You'll apply integration and custom development expertise in industry standard programming languages to convert functional and technical requirements into business solutions.

What you'll need

• 4 year college degree or equivalent combination of education and experience. An academic background in Computer Science, Mathematics, Statistics, or a related technical field is a plus!
• 8+ years of technical contribution in a structured team environment
• 2+ years of experience leading projects and mentoring engineers
• You’ll have 3+ years having experience with data lakes/data warehouse concepts and data modeling concepts
• You have 3+ years of SQL skills, Python and Spark, and experience with Snowflake
• You are familiar with any cloud platform GCP, AWS or Azure is a huge plus and will be helpful in this role
• Experience with features like KSQL
• Azure cloud knowledge and experience in architecting, configuring and deploying with Advanced Kubernetes and AKS
• Experience with designing and building ETL/ELT data pipelines, data analysis, CI/CD
• Architected and led the development of complex enterprise systems
• Excellent problem solving and troubleshooting skills
• Experience using SQL queries as well as writing and perfecting SQL queries in a business environment with large-scale, complex datasets
• Experience architecting with Change Data Replication (CDC) and Qlik is a nice to have
• Experience with analytics systems like Snowflake is a nice to have

More Information

Our organization follows a hybrid work structure in our service territory (NY & MA and adjacent states) where employees can work remotely or from the office, as needed. Working from the office is encouraged when working on tasks that require a high degree of collaboration. We work with our employees to foster a work schedule that fits your flexible schedule.

Join us!

At National Grid, we keep the lights on and homes warm. But it’s so much more than that. We keep people connected and society moving. This is no easy feat, and it takes all of us. But National Grid supplies us with the environment to make it happen. As we generate momentum in the energy transition for all, we don’t plan on leaving any of our customers in the dark. So, join us and help bring energy to life. 

Salary

$133,000 - $187,000 a year

This position has a career path which provides for advancement opportunities within and across bands as you develop and evolve in the position; gaining experience, expertise and acquiring and applying technical skills. Candidates will be assessed and provided offers against the minimum qualifications of this role and their individual experience.