Sr Lead Data Engineer

Key Skills

Azure, Continuous Integration & Continuous Delivery - CI/CD, Data Analysis, Data Analytics, Data Modeling, Data Warehousing, Databricks, DevOps, ETL frameworks, Informatica, Leadership, PowerBI, PySpark, Python Programming, QlikView, Scrum Agile Methodology, Shell Scripting language, Snowflake, SQL, Tableau, Teradata, Unix Operating system

Job Description

The Novelis Corporate Digital team is seeking a Data Engineer. The ideal candidate will be responsible for the delivery of the analytical solution for the functional area(s) assigned to them. These functions include Procurement, Supply Chain, Finance, Commercial, Operations and others. This role will take the ownership of the Functional Data Domain, gather business/functional knowledge and provide analytical solutions. This position will drive and develop the data solution by manipulating and aggregating the disparate data sources into a format that is easily digestible by end-users, data scientists and statistically adept colleagues. Their core responsibility will be to combine large volumes of disparate complex data across multiple sources, conduct quality checks on the data and implement quality improvement algorithms, transform the data to match business rules and, ensure continuous access to a clean format of the operational data for the data science team and other partners. In addition, they will develop, deploy and support the data pipeline to ensure ongoing data collection, consolidation, management and smooth operations. They will further be responsible for enhancing and carrying out the development standards and bring the changes to the tools/technologies and methodologies as the Data Engineering matures in Novelis and in the industry.

Novelis is the world leader in aluminum rolling and recycling, producing an estimated 19 percent of the world's flat-rolled aluminum products! We work alongside our customers to provide innovative solutions to the aerospace, beverage can, automotive and high-end specialty markets.

Responsibilities:

• Drive the implementation of the analytical solution by working with Functional team to understand requirements, data sources and business rules; and leading the development team to build, test and deploy the solution.
• Take ownership of the Functional Data Domain assigned to the Data Engineer. Gather knowledge of the business, functions, and their data analysis needs along with business’s relationship with the Data.
• Identify, Analyze and Profile the data across various source systems to understand and ensure that data fits the business requirements. Raise any data anomalies and work with the functional users to close any anomalies or data gaps.
• Analyze data based on business rules and identify relationships across multiple source systems; and create reference data with the help of data stewards. Help functional owners to create Data Quality (DQ) rules.
• Design the Dimensional Data Model, Data Engineering Pipelines, Data Quality and Validation rules based on the business requirements and rules that would include any error handing, exception management and data quality routines to expose the anomalies in the data.
• Finalize the technical Source-to-Target mapping to develop the data pipelines from source systems to the dimensional model.
• Work with and Lead the team of Developer(s) for the technical implementation of the Data Pipelines. Ensure that the Unit and Integration tests complete successfully. Drive the QA/UAT with the Functional users and ensure a deployment to higher environments.
• Designs and jointly develops the data architecture and identifies gaps and implements solutions for data security, quality and automation of development and maintenance processes
• Capture sophisticated requirements across business strategy, identify gaps and build standards and best practices to create quality solutions that satisfies long-term business needs and supports business strategy
• Support in creation and execution of Data Engineering roadmaps and architectures to help the analytics driven organization achieve its goals.

Minimum Qualifications:

• Minimum of Bachelor of Science BS/MS degree in Computer Science, Engineering, and/or Background in Mathematics and Statistics
• Minimum of 7 years of hands-on experience in the Data Analytics areas such as Data Engineering (ETL), Data Warehousing and Business Intelligence, Dimensional Data Modeling, Information Architecture and Master Data Management (MDM)
• Solid experience on cloud data Platform for data transformation using Databricks (PySpark) and/or Informatica DEI for ETL, data quality, and data wrangling. Experience in Snowflake, Teradata or equivalent technologies is considered.
• Deep solid understanding of SQL for data analysis and data pipeline development
• Experience with reporting and analytics like PowerBI, Tableau or QlikView
• Solid understanding of Azure DevOps for Agile development and CI/CD framework

Preferred Qualifications:

• Master’s degree with computer science concentration or other advanced degree in the related field
• Experience with Databricks Unity Catalog, Collibra or other data cataloging tools
• Experience with Agile/Scrum methodology with the Product based implementation approach
• Experience with programming languages like UNIX shell scripting, Python etc.

What We Offer:

This role offers a hybrid schedule. Novelis is committed to a Flex Work approach that empowers employees to maintain work-life balance while enjoying the benefits of a collaborative office environment.

Novelis benefits say a lot about how we care for each other. Our employees and their families have many different needs. As a result, our benefits offer choices on many levels and are high in quality, competitive in the marketplace, and affordable. These are a few of the benefits we offer to support you and your family’s well-being:

• Medical, dental and vision insurance
• Health savings accounts – Company Funded Health Savings Account (HSA) and Health Reimbursement Account (HRA)
• Company-paid basic life insurance and Additional voluntary life coverage
• Paid vacation and flexible personal time off
• 401(k) savings plan with company match
• Retirement savings plans – medical and prescription drug coverage through private exchange
• Employee assistance programs – available 24/7 to you and your family
• Wellness and Work Life Support - career development and educational assistance