Senior Principal Data Engineer

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

What's the role?

As a Senior Principal Data Engineer, you will be the key technical expert overseeing the deployment of Shell's Data Platforms, Data & Analytics products and drive a strong vision for how data engineering can proactively create a positive impact on the business.

You'll be empowered to create & lead a strong natural team of data engineers who build data pipelines into various source systems, rest data on the Shell Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company.

As a member of the data engineering technical community, you will help lead the development of very large and complex data applications into public cloud environments directly impacting the design, architecture, and implementation of Shell’s flagship data products around topics like customer, asset, finance functions, new energies and subsurface,. You will work closely with process owners, product owners and business users. You'll be working in a hybrid environment with in-house, on-premise data sources as well as cloud and remote systems. You will be expected to lead the definition of standards, best practices and increase usage of Inner Source and DevKit within our Data Engineering and Data Science communities

As a senior technical leader in our Information, Data & Analytics practice, you will lead the management of our Technical Ladder and work with staff & leaders on Technical Ladder assessments and progressing staff through our technical ladder.

Additionally, you will also lead the development of Skills and Capabilities across our various capability areas and working with our technology suppliers and learning partners to develop skills development curriculum taking into account Shell's unique needs. In this capacity, you will be the Capability Development Lead for Information, Data & Analytics

More specifically, your key accountabilities include:

• Provide leadership and management to a team of data engineers, managing processes and their flow of work, vetting their designs, and mentoring them to realize their full potential.
• Define the skills and capabilities development roadmap and deliver on upskilling and reskilling targets
• Act as a subject matter expert across different digital projects.
• Manage our internal Technical Ladder process to progress staff through technical maturity and drive the development of Data Engineering as a technical discipline
• Oversee work with internal clients and external partners to structure and store data into unified taxonomies and link them together with standard identifiers.
• Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality and performance.
• Responsible for implementing best practices around systems integration, security, performance and data management.
• Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape.
• Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions.
• Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects and strategic internal and external partners.
• Prototype new approaches and build solutions at scale.
• Research in state-of-the-art methodologies.
• Create and audit reusable packages or libraries.

What we need from you

Technical Skills:

• Substantial technology experience that includes hands-on software development, data engineering, and systems architecture experience.
• Proven track record in Data Lake Infrastructure, Data Warehousing, and Data Analytics tools.
• Strong experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.).
• Relevant experience in cloud data engineering experience in at least one cloud (Azure, AWS, GCP).
• Fluent with Azure and AWS cloud services. Certifications are a plus.
• Experience scaling and managing a team of engineers.
• Experience with integration of multi cloud services with on-premises technologies.
• Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines.
• Experience with data profiling and data tools like Collibra, Informatica MDM etc.
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
• Experience with at least one MPP database technology such as Redshift, Synapse or SnowFlake.
• Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes.
• Experience with version control systems like Github and deployment & CI tools.
• Experience with Azure Data Factory, Azure Databricks and Azure Machine learning tools.
• Experience with Statistical/ML techniques is a plus.
• Experience with building solutions Energy domain is a plus
• Understanding of metadata management, data lineage, and data glossaries is a plus.
• Working knowledge of agile development, including DevOps and DataOps concepts.
• Familiarity with business intelligence tools (such as PowerBI).
• BA/BS in Computer Science, Math, Physics, or other technical fields.

Skills, Abilities, Knowledge:

• Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management.
• Proven track record of leading, mentoring, hiring and scaling data teams.
• Strong change manager. Comfortable with change, especially that which arises through company growth. Able to lead a team effectively through times of change.
• Ability to understand and translate business requirements into data and technical requirements.
• High degree of organization and ability to manage multiple, competing projects and priorities simultaneously.
• Positive and flexible attitude to enable adjusting to different needs in an ever-changing environment.
• Strong leadership, organizational and interpersonal skills; comfortable managing trade-offs.
• Foster a team culture of accountability, communication, and self-management.
• Proactively drives impact and engagement while bringing others along.
• Consistently attain/exceed individual and team goals
• Ability to lead others without direct authority in a matrixed environment.

Company Description

An innovative place to work

There’s never been a more exciting time to work at Shell.

Join us and you’ll be adding your talent and imagination to a business with the ambition to shape the future – whether by investing in oil, gas and renewable energy to meet demand, exploring new ways to store energy, or developing technology that helps the world to use energy more efficiently, everyone at Shell does their part.

An inclusive place to work

To power progress, we need to attract and develop the brightest minds and make sure every voice is heard. Here are just some of the ways we are nurturing an inclusive environment – one where you can express your ideas, extend your skills, and reach your potential.

• We’re creating a space where people with disabilities can excel through transparent recruitment process, workplace adjustments and ongoing support in their roles. Feel free to let us know about your circumstances when you apply, and we’ll take it from there.
• We’re closing the gender gap – whether that’s through action on equal pay or by enabling more women to reach senior roles in engineering and technology.
• We’re striving to be a pioneer of an inclusive and diverse workplace, promoting equality for employees regardless of sexual orientation or gender identity.
• We consider ourselves a flexible employer and want to support you finding the right balance. We encourage you to discuss this with us in your application.

A rewarding place to work

Combine our creative, collaborative environment and global operations with an impressive range of benefits and joining Shell becomes an inspired career choice.

We’re huge advocates for career development. We’ll encourage you to try new roles and experience new settings. By pushing people to reach their potential, we frequently help them find skills they never knew they had, or make career moves they never thought possible.