Data Engineer, Amazon Forecasting Core Data Engineering

Key Skills

Java Programming, Analytical and Problem solving, Python Programming, Database, SQL, AWS, Big Data Technology, Apache Hadoop, Data Modeling, Apache Hive, Amazon RedShift, Amazon EMR, HBase, Amazon Simple Storage Service (S3), ETL frameworks, AWS Glue, Data Warehousing

Job Description

Job summary

Come and be a part of Amazon's amazing growth story! Amazon.com's Forecasting group is searching for a Data Engineer to join our team. We are pioneers in the fields of demand analysis and forecasting. If you want to learn how to leverage technology to predict the future, this is the team for you.

As a member of the Demand Forecasting team, you'll play a key role in solving some of the world's most complex technical challenges associated with Forecasting. You will apply Large-scale computing, Distributed systems, Data mining, Scalability, Machine learning and Statistical Algorithms techniques - just to name a few.

Our Data Engineer needs to be able to gather and understand data requirements, present it to software engineers, and work in the team to achieve high quality data ingestion goals. You need a passion for complex problems, and enjoy the challenge of operating complex and mission critical systems under extreme loads. Do you think you are up to the challenge? Would you like to learn more and stretch your skills and career?

In this role, you will be a technical expert with significant scope and impact. You will work closely with a group of Software Development Engineers, Product Managers, Data Scientists, and Business Intelligence Engineers to create the data infrastructure and pipelines necessary to drive our team’s initiatives.

Successful candidates should come from a strong data engineering background. You need to have experience with structured data, and being able to analyze/transform the data using various tools. Although SQL is a strong requirement, being flexible enough to work in a scripting environment is a must. Often, the pace of innovation and change implies a need to move to new data sources, and our Data Engineers get to participate in deep diving business data in order to understand/measure sources of disparity. Your analytical skills and knowledge of schema metadata will be essential.

Key job responsibilities

Create and maintain data transformation logic, create scalable data solutions, use data clusters of 50+ nodes.

BASIC QUALIFICATIONS

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical discipline. Master's degree is a definite plus.
• 4+ years of industry experience in Software Development, Data Engineering, Business Intelligence or related field with a solid track record of manipulating, processing, and extracting values from large datasets.
• Hands-on experience and highly advanced knowledge of SQL, Data Modeling, ETL Development, and Data Warehousing.
• Experience with working with multi-node data clusters
• Solid experience using big data technologies (Redshift, Hadoop, Hive, Hbase, Spark, EMR, etc.).
• Knowledge and experience with Data Management and Data Storage best practices.
• Strong customer focus, ownership, and ability to deliver results.
• Excellent communication and collaboration skills
• Effective analytical, troubleshooting, and problem-solving skills.

PREFERRED QUALIFICATIONS

• Masters in computer science, mathematics, statistics, economics, or other quantitative fields.
• Experience working with AWS big data technologies (Redshift, S3, EMR, Glue).
• Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy.
• Experience providing technical leadership and educating other engineers for best practices on data engineering.
• Background in Big Data, non-relational databases, Machine Learning and Data Mining is a plus.