Senior Big Data Engineer, Worldwide Revenue Analytics

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

The AWS World Wide Revenue Operations (WWRO) Revenue technology team is responsible for publishing Daily Estimated Revenue (DER) and

monthly Amortized Sales Revenue (ASR). DER and ASR are used by downstream customers in AWS Finance, Accounting, Sales Operations, Segmentation & Planning (S&P), Data & Analytics and Compensation to set quotas, manage sales goals, forecast, and derive business insights. We collect and process billions of usage and billing transactions every single day and relate it to the largest data feed supported by Salesforce.com. We transform this raw data into actionable information in the Data Lake and make it available to our internal service owners to analyze their business and service our external customers.

We are truly leading the way to disrupt the big data industry. We are accomplishing this vision by bringing to bear Big Data technologies like Elastic Map Reduce (EMR), Spark in addition to data warehouse technologies like Spectrum to build a data platform capable of scaling with the ever-increasing volume of data produced by AWS services.

Key job responsibilities

• Lead a team of Data Engineers to deliver cross-functional data solutions for the Revenue team.
• Establish and communicate organizational vision, goals and success measures.
• Collaborate with product teams, stakeholders and customers to develop the product roadmap.
• Build, Own, Prioritize, Lead and Deliver roadmap for large and complex multi-functional projects and programs.
• Own and manage the Revenue data infrastructure to keep the security and cost intact.
• Own and manage the Revenue technology stack to scale to the organizational growth and adhere to the policies and standards.
• Build data solutions by sourcing data from various upstreams, delivering critical business insights to the Revenue customers.

A day in the life

As a Data Engineering Manager, you will be leading a team of Data Engineers, act as a thought leader and direct the team with your experience to solve complex business problems. You collaborate with stakeholders, product managers, customers, and cross-teams to implement scalable data solutions that simplify the complexities and enable customers to query data seamlessly. You build data platforms and solutions following the industry best practices around security, scalability, availability and cost. You steer the team to architect for the future scale, growth and complexity by embracing the latest technologies and AWS cloud services. Your passion for data and innovation will help the team deliver valuable data insights and products to the customers.

BASIC QUALIFICATIONS

• This position requires a Bachelor's Degree in Computer Science or a related technical field, and 5+ years of related employment experience.
• 5+ years of work experience with ETL, Data Modeling, and Data Architecture.
• Experience in hiring and managing Data Engineers or Business Intelligence (BI) engineers.
• Expert-level skills in writing and optimizing SQL.
• Experience with Big Data technologies such as Hive/Spark.
• Proficiency in one of the scripting languages - python, ruby, linux or similar.
• Experience operating very large data warehouses or data lakes.

PREFERRED QUALIFICATIONS

• A Master's degree or foreign equivalent in Computer Science, Engineering, Statistics, Mathematics or related field.
• 7+ years of relevant engineering experience.
• 3+ years of people management experience, managing engineers.
• Experience building data products incrementally and integrating and managing datasets from multiple sources.
• Experience with AWS services (EMR, Redshift, DynamoDB, S3, EC2) or other cloud services.
• Experience providing technical leadership and mentor other engineers on data engineering best practices.
• Advanced knowledge and expertise with Data modeling skills, advanced SQL with Oracle, MySQL, and Columnar Databases.
• Demonstrated industry leadership in the fields of Database and/or Data Warehousing, Data Sciences and Big Data processing.