Data Engineer

Key Skills

Java Programming, Design of Experiment, Python Programming, Framework, SQL, AWS, SPARK Programming

Job Description

We are looking for a Data Engineer that can apply subject matter knowledge to solve a variety of common business issues. Works on problems of moderately complex scope. Acts as an informed team member providing analysis of information and limited project direction input. Exercises independent judgment within defined practices and procedures to determine appropriate action. Follows established guidelines and interprets policies. Evaluates unique circumstances and makes recommendations.

Responsibilities

• Designs limited enhancements, updates, and programming changes for portions and subsystems of data pipelines, repositories or models for structured/unstructured data.
• Analyzes design and determines coding, programming, and integration activities required based on specific objectives and established project guidelines.
• Executes and writes portions of testing plans, protocols, and documentation for assigned portion of application; identifies and debugs issues with code and suggests changes or improvements.
• Participates as a member of a project team of other data science professionals to develop reliable, cost effective and high-quality solutions for assigned data system, model, or component.
• Collaborates and communicates with project team regarding project progress and issue resolution.

Knowledge & Skills

• Good amount of experience with data engineering tools, languages, frameworks to mine, cleanse and explore data.
• Strong experience in Apache Spark.
• Strong experience in programming languages(Python preferred)
• Strong Knowledge of SQL.
• Good to have AWS solution architect certification
• Good to have knowledge on Analytics Services offerings of AWS
• Strong decision-making skills in terms of data analysis
• Agile and scrum methodologies is a must to know

Scope & Impact

• Collaborates with peers, junior engineers, data scientists and project team.
• Typically partners with high-level Individual Contributors and Managers.
• Supports projects requiring data engineering solutions expertise.

Education & Experience

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.
• Typically 2-4 years’ experience.