Senior Data Engineer, ICON (Intelligent Cloud Hosting)

Key Skills

Java Programming, Python Programming, Database, SQL, AWS, Big Data Technology, Apache Hadoop, Apache Hive, Amazon RedShift, Amazon EMR, Amazon Elastic Compute Cloud-EC2, SPARK Programming, Lambda, Amazon Simple Storage Service (S3), Data Engineering, Data pipelines, ETL frameworks, Terabyte scale datasets, Data Warehousing

Job Description

Do you want to ensure a delightful shopping experience for millions of Amazon.com customers everyday? The Intelligent Hosting (ICON) team is looking for a Senior Data Engineer that is passionate about Amazon's ecommerce platform technologies that host Amazon's Global websites. The ICON team hosts Amazon websites and backend platform services that power the customer experience. We abstract and centralize infrastructure management from service teams, bring agility to business processes, and operate 100s of Tier-1 services on behalf of our internal customers. ICON is an early adopter of Amazon’s product offerings and automates the management and operational activities on behalf of developers to strengthen services’ posture towards security, availability, and efficiency so that service developers can innovate on behalf of Amazon’s end customers.

The ICON team is located within the Intelligent Control (ICC) organization who owns connecting our worldwide websites and other consumer experiences such as Kindle, Amazon Video, and Alexa to the internet, as well as ensuring the highest level of availability, security and privacy of the web services that power the experience we deliver to our customers worldwide.

The Role

ICON is looking for a Senior Data Engineer to lead our Data and Reporting strategy and architecture to support Project Compass. Our global team has sites in Seattle, New York, Dublin, Bangalore, and Hyderabad. In this role, your metrics, reports, and data will influence the building, automating, and operating of Amazon’s current and next generation Intelligent Cloud Hosting technologies used to manage our highly distributed hosting infrastructure.

BASIC QUALIFICATIONS

• 5+ years of experience as a Data Engineer or in a similar role
• Experience with data modeling, data warehousing, and building ETL pipelines
• Experience in SQL
• Excel in the design, creation, and management of very large datasets
• Skilled with writing, tuning, and troubleshooting SQL queries
• Experience with Big Data technologies such as Hive, Spark, Hadoop, NoSQL, AWS EMR, Glue, Lambda, Kinesis, Redshift.
• Proficiency with Python, Java, or Scala (Scala preferred)
• Excellent grasp of software development life cycle and/or agile development environment
• Strong organizational and planning skills with attention to detail
• Experience in understanding system limitations, scaling factors, boundary conditions, and the reasons for architectural decisions
• Experience in Designing and building scalable data pipelines

PREFERRED QUALIFICATIONS

• 7-10 years of industry experience as a Data Engineer or related specialty (e.g. Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets
• Detailed knowledge of data warehouses, architecture, infrastructure components, ETL and reporting tools and environments
• Experience with orchestration tools such as Step Functions.
• Experience with Massively Parallel Processing (MPP) databases - Redshift, Teradata etc.
• Experience with distributed systems and NoSQL databases
• Experience directing medium to large-scale data warehousing and BI projects, including using AWS technologies – Redshift, S3, EC2, Data-pipeline and other big data technologies
• Excellent communication skills and able to work with business owners to develop and define key business questions and to build data sets that answer those questions
• Experience providing technical direction and mentorship of engineers and scientists on best practices in the data engineering space
• Be self-motivated and show ability to deliver on ambiguous situations and projects