Data Engineer

Key Skills

Amazon EMR, AWS, AWS Glue, Business Intelligence, Data Modeling, Data Visualization, Data Warehousing, ETL/ELT technologies, JIRA, MySQL, Oracle, PowerBI, Python Programming, RDBMS, Scrum Agile Methodology, Snowflake, Spark Core, SQL, SQL Server, Unix Operating system

Job Description

• Division: Digital Enterprise (DE)
• Department: Analytics Centre of Excellence (ACE)
• Job Location: Gurgaon
• Job Role: Data Engineer
• Level in the organization: Deputy Manager
• Educational Qualification(With Specialization): Bachelor of Technology (B.Tech) or equivalent
• Work Experience (Years): 3-6

Job Responsibilities:

• Data engineers will be responsible for coding, designing, deploying, and debugging and productionizing large scale data pipeline solutions using Python and Spark. 
• Experience of developing scripts Unix, Python etc.
• 3-4 years of hands on experience with building productionized data ingestion and processing pipelines using Spark, Python
• 3-4 years of hands on experience designing and implementing production data pipeline solution using AWS Technologies like AWS Glue, Amazon EMR, Database migration services, data sync etc.
• Excellent SQL writing skills with great experience in sql optimization and analytical functions
• Excellent presentation and communication skills, both written and verbal, Ability to problem solve in an environment with unclear requirements.
• Experience of working in Agile environments
• Well versed with JIRA or equivalent project tracking tool

Competencies / Skills

• Experience of working on Talend, Informatica and Mulesoft would be preferred
• Experience with designing and implementing production data pipeline solution using Azure/ GCP Tools/Technologies