Data Engineer with Big Data Skills

Key Skills

Big Data Technology, Apache Kafka, Scala Programming, Apache Hive, SPARK Programming, Parquet, Data Lake

Job Description

Analyst, Big Data Engineer, Consumer Banking & Core Engine (C2E)

Business Function Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble, and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.

Requirements:

• Master or bachelor’s degree in computer science or a related field.
• 4+ year experience in working on IT / software projects/programs.

• Hands on experience on dealing with live streaming datasets using Kafka/Spark Streaming.
• Excellent oral and written communication skills, On-time delivery and good team player.

Roles & Responsibilities:

• As a Data Engineer should be able to understand the Business requirements, Functional and Technical requirements and translate them effectively using the Spark/SCALA Framework.
• Should be able to extract the data from source systems (Open/Mainframes) to Data Lake (Hive/Parquet).
• Understand the complex transformation logic and translate them to Hive/Spark-SQL queries to load them onto Enterprise Data Domain tables.

Primary Location: India-Telangana-Hyderabad - DAH2

Job: Data Technology

Schedule: Regular

Employee Status: Full-time