Data Engineer

Key Skills

Agile methodologies, Apache Hadoop, Apache Hive, Azure, Data Analytics, Data Mining, Database, Design, ETL frameworks, ETL/ELT technologies, Java Programming, Linux Operating system, Project management, Python Programming, RDBMS, Scala Programming, Spark Core, SQL, Unix Operating system

Job Description

• Office location: ​Chennai, Mumbai. (Remote work)
• Job Type:​ Full-time
• Experience:​ 2 to 4 years

Job Description:

We are looking for data engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.

To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.

If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.

Job Requirements:

• Extensive experience in data integration tools to analyse root cause and provide a fix for production and development issues.
• Design, build and integrate data from various sources.
• Skillful in ETL processes.
• Good in Understanding of Hive, Spark, Hadoop architecture and optimization.
• Experience of Spark/ Pyspark or Spark /Scala is a must.
• Good expertise on SQL.
• Experienced in Shell Scripting(Unix/Linux).
• Hands-on Experience in RDBMS.
• Good to have hands on any of the Programming Languages Java/Python/Scala.
• Knowledge of Cloud (Azure) Technologies would be a bonus.
• Possesses in-depth functional knowledge of Retail Domain.
• Automate the existing ETL pipeline/activity wherever needed.
• Working closely with data scientists and a variety of end-users.
• Needs to Maintain/Deploy the ETL code and follow the Agile methodology.
• Needs to work on optimization wherever applicable.
• Need to Handle service delivery tickets and provide support to ETL tools.
• Good oral, written and presentation skills.

Essential Qualifications:

• Degree in Computer Science, IT, or similar field; a Master’s is a plus.
• Hands-on experience with SQL database design.
• Great numerical and analytical skills.
• Technical expertise with data models, data mining, and segmentation techniques.
• Strong project management and organizational skills.