ArtificiaI Intelligence Lead

Key Skills

Amazon Athena, Amazon RedShift, AWS Glue, AWS Kinesis, Big Data Technology, Database, ETL frameworks, Java Programming, Lambda, NoSQL, Python Programming, SQL

Job Description

• Requirement Name / Title AWS ETL
• Band B3
• No of Positions 5
• Experience 8+Yrs
• Location Bangalore,Pune, Chennai
• Shift
• Mandatory Skills AWS Glue, S3, Redshift , Lambda Functions,SQL, Python
• Preferred Skills Athena, Kinesis, NoSQL , EMR

Roles & Responsibilities (in Detail)Primary responsibility

• Design and implement data pipelines/ETL using AWS services.
• Test and debug data pipelines involving Big Data
• Improve functionality/ performance of existing data pipelines
• Implement security and data quality.
• Implement Data pipelines using CI/CD concepts.
• Lead and technical guidance to the team of Junior Data Engineers.
• Coordinate with internal teams to understand user requirements and provide technical solutions

Skills & Experience:

• Should have experience in designing ETL/Data Pipelines using AWS.
• Should have hands-on experience with AWS services like AWS Glue, Step functions, AWS S3, Redshift, Lambda ,Athena, Kinesis DataStream, Kinesis Firehose, etc.
• Excellent Python and SQL Skills
• Experience with databases, data warehousing, or data science
• 8+ years of experience working in IT / consulting environment
• Minimum 3-5 years on AWS/ETL development experience
• Leading a team of junior data engineers.
• Problem solving skills that apply to a big data environment
• Good Communication skills

Good to have:

• Experience in streaming Data pipelines would be added advantage.
• AWS Certification in Data Engineering area. (Data Analytics-Specialty)
• Experience/Knowledge of NoSQL databases