Lead Data Engineer

Key Skills

Java Programming, Analytical and Problem solving, Python Programming, Database, SQL, DevOps, AWS, Apache Kafka, NoSQL, Tableau, Amazon RedShift, SPARK Programming, IBM Cognos, ETL frameworks

Job Description

With us, you’ll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it — we want you to grow and make a difference at one of the world's leading digital banking and payments companies. We value what makes you unique so that you have an opportunity to shine.

Come build your future, while being the reason millions of people find a brighter financial future with Discover.

Job Description

As part of our Enterprise Data Management team, you’ll:

• Responsible for designing and developing data driven platforms and next generation analytic technologies.

How You’ll Do It

• Designs and develops data ingestion frameworks leveraging open source tools and data processing frameworks.
• Designs and develops complex and critical data projects.
• Develops, implements, and supports application codes and analytical models.
• Creates and enhances data solutions that enable seamless integration and flow of data across the data ecosystem.
• Designs and develops real time processing solutions.

Qualifications You’ll Need 

The Basics:

• Bachelor's degree in Information Technology
• 4+ years of experience Data Platform Administration / Engineering or related

Bonus Points If You Have

Key Skills:

• Strong knowledge and experience in designing/using of DW Cloud Database : Snowflake is preferred or Redshift
• Strong knowledge and experience in designing and development of complex Data Warehouse methodologies
• Experience in processing of huge dataset of hundreds of millions of records in Cloud and as well as in on-premise.
• Strong knowledge of ETL technologies – Ab Initio on Cloud is preferred, or – DataStage, Informatica.
• Experience in on-premise ETL development using Data Warehouse DB as backend – Teradata is preferred.
• Experience in performance tuning - both in ETL processes and Database objects
• Experience in Reporting technologies – Cognos, Jaspersoft, Tableau are preferred.
• Experience in end to end DevOps – CI/CD
• Experience in creating technical design plans/STT, solutioning, designing and delivering complex DataWarehouse projects
• Experience in working closely with Business teams to get the understanding of their requirements.
• Experience in grooming, mentoring the teams in self-managed teams
• Experience in supporting live systems and business continuity.

Desired Skills

• Knowledge in AWS and any AWS certifications are preferred.
• Knowledge in Kafka, Python, Spark and NoSQL
• Knowledge in streaming data processing
• Experience in Agile based environment
• Expertise in open-source, ETL scripting and related tools.
• Strong team player and willing to collaborate
• Strong analytical and problem solving skills
• Strong communication and decision making skills