Lead Data Engineer - AWS

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

As a valued colleague on our team, you will provide expert advice and guidance to the team regarding the development of data infrastructures and pipelines to capture, integrate, organize, and centralize data while testing and ensuring data is readily accessible and in a usable state, including quality assurance.

THE IMPACT YOU WILL MAKE

The Lead Data Engineer - AWS role will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:

• Assess customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.
• Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.
• Lead the team to organize and integrate data into readily available formats while maintaining existing structures and govern their use according to business requirements.
• Lead the analysis of new data sources and monitoring of performance, scalability, and security of data.
• Analyze the initial analysis and deliver the user interface (UI) to the customer to enable further analysis.

Qualifications

THE EXPERIENCE YOU BRING TO THE TEAM

Required Experiences:

• 4-6 Years Experience
• Technical Expertise in Python, Java, and AWS Technologies
• Experience with AWS Elastic MapReduce (EMR)
• Experience and familiarity with Hadoop / Spark information architecture, Data Modeling, Machine Learning (ML),
• ETL Experience and data process automation on large datasets
• Excellent collaboration & communication skills

Desired Experiences:

• Bachelor degree or equivalent
• Experience working in Finance, Mortgage, or Banking verticals
• Experience working with DevOps Engineers and understanding of DevOps best practices
• Experience working with Amazon Redshift

Skills

• Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
• Adept at managing project plans, resources, and people to ensure successful project completion
• Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
• Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
• The group of skills related to Programming including coding, debugging, and using relevant programming languages
• Experience helping an organization to plan and manage change in effort to meet strategic objectives
• Skilled in cloud technologies and cloud computing
• Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data

Tools

• Skilled in Python
• Skilled in Java
• Skilled in DevOps
• Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
• Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
• Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
• Skilled in AWS Analytics such as Athena, EMR, or Glue
• Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
• Skilled in Hadoop / Spark