Senior Big Data Platform Engineer

Key Skills

AWS, Big Data Technology, Data Engineering, Effective communication skills, Google Cloud Platform (GCP), Infrastructure-as-code-IaC

Job Description

You will design and build data warehouses on cloud, to provide efficient analytical and reporting capabilities across Apple’s global and regional sales and finance teams. You will develop highly scalable data pipelines to load data from various source systems, use Apache Airflow to orchestrate, schedule and monitor the workflows. Build generic and reusable solutions meeting data warehousing design standards for complex business requirements. You will be required to understand existing solutions, fine-tune them and support them as needed. Data quality is our goal and we expect you to meet our high standards on data and software quality. We are a rapidly growing team with plenty of interesting technical and business challenges to solve.We seek a self starter, who is willing to learn fast, adapt well to changing requirements and work with cross functional teams.

Minimum Qualifications

• 3+ years of related hands-on data modeling and data engineering experience.
• Strong expertise in Big data Platform development in Public Cloud (such as AWS, GCP, Ali Cloud, Tencent Cloud, etc.)
• Experience in scheduling system development, deployment, and tuning (such as Airflow, etc)
• Familiar with the Hadoop ecosystem, including Hive, Spark and customize at least one system at code-level
• Familiar with using infrastructure-as-code(IAC) and configuration management tools such as Terraform.

Preferred Qualifications

• Database design and development experience with relational and non-relational DB.
• Analytical and mathematical mind, capable of evaluating and solving various complex problems
• Ability to work individually or as part of a team
• Ability to learn quickly in a fast-paced environment
• Excellent oral and written communication skills

Education & Experience

• BS or MS in Engineering/ Computer Science