Data Engineer Lead

Key Skills

Data security, ETL frameworks, ETL/ELT technologies, Git, GitLab, Java Programming, Jenkins, Leadership, Linux Operating system, Mentoring, MySQL, Python Programming, RDBMS, Scala Programming, Scrum Agile Methodology, Spark Core, SQL, Unix Operating system

Job Description

• Lead a team of 4-8 individuals: Drive work through the team, review code as required, and ensure the overall success of the team. 
• Design and develop robust end-to-end data solutions for structured and unstructured data including, but not limited to, ingestion, parsing, integration, auditing, logging, aggregation, normalization, modeling, and error handling.
• Interact directly with end users to gather requirements and consult on data integration solutions. Regularly have their best interests in mind and proactively recommend value added items – even if not requested.

Maintain, support, and enhance most elements of Tokopedia’s Information Management Systems with minimal assistance from peers. 

• Collaborate with a cross functional team to resolve data quality and operational issues.
• Identify opportunities for team standardization in coding, deployments, documentation, cost optimization and other related areas and create said standards.
• Provide mentoring / coaching to junior and senior developers in the team.
• Educate the team in emerging related technologies and identify value add opportunities for their implementation
• Timely delivery of project
• Work with the Product Manager to define incoming project and resource requirements.
• Migrate code across environments and leverage a source code management system.
• Create jobs to perform auditing and error handling.
• Report and communicate project deliverables to Senior Management.

Skill Sets:

• Proficiency in traditional RDBMS with an emphasis on Postgres, and MySQL.
• General understanding of ETL/ELT frameworks, error handling techniques, data quality techniques and their overall operation
• Generally proficient in performing data transformations via scripting, stored procedures, or an ETL framework.
• Proficient in developing and supporting all aspects of a big data cluster: Ingestion, Processing, integration (Python, Spark, Scala), data cleansing, workflow management (OOZIE and ActiveBatch, Airflow), and querying (SQL).
• Proficiency in at least one of the following programming languages: Java, Python, Go and Scala.
• Experience in writing Apache Spark or Apache Beam including an understanding of optimization techniques.
• Proficient in Unix and Linux operating systems
• Proficient in Agile or Scrum methodologies
• Capable of navigating and working effectively in a DevOps model including leveraging related technologies: Jenkins, GitLab, Git etc…
• Proficient in Data Management concepts like Data Security, Data Quality, Data Lifecycle, Data Governance

Job Requirement

• A Bachelor’s Degree in Computer Science or related field required.
• 5+ years of Data Integration experience
• 5+ years of hands on experience with one of the following technologies: Hadoop, Apache Spark, Redis, SQL, Redshift, PostgreSQL
• 2+ years experience with Cloud Environment like AWS, GCP or Azure
• Having experience in GCP Product like Bigquery, Dataflow, PubSub, Bigtable, Composer, GCS is a big plus
• 3+ years of experience in developing REST APIs
• 3+years of experiencein using complex SQL
• 3+ years of experience in People Management

About GoTo Group

GoTo Group is the largest digital ecosystem in Indonesia with its mission to “Empower Progress’ by offering technological infrastructure and solutions for everyone to access and thrive in the digital economy. The GoTo ecosystem consists of on-demand transportation services, e-commerce, food and grocery delivery, logistics and fulfillment, as well as financial and payment services through the Gojek, Tokopedia and GoTo Financial platforms.It is the first platform in Southeast Asia that hosts these crucial cases in a single ecosystem, capturing the majority of Indonesia’s vast consumer household.

About Gojek 

Gojek is Southeast Asia’s leading on-demand platform and pioneer of the multi-service ecosystem with over 2.5 million driver partners across the regions offering a wide range of services such as transportation, food delivery, logistics and more. With its mission to create impact at scale, Gojek is committed to resolving consumer problems and raising standards of living by connecting consumers to the best providers of goods and services in the market.

About GoTo Financial

GoTo Financial accelerates financial inclusion through its leading financial services and merchants solutions. Its consumer services include GoPay and GoPayLater and serve businesses of all sizes through Midtrans, Moka, GoBiz Plus, GoBiz, and Selly. With its trusted and inclusive ecosystem of products, GoTo Financial is open to new growth opportunities and aims to empower everyone to Make It Happen, Make It Together, Make It Last.

About Tokopedia

Tokopedia is an Indonesian technology company with a mission to democratize commerce through technology. It has been a driving force behind Indonesia's digital development since its foundation in 2009, with more than 99% of districts and empowered around 12 million merchants listed nationwide. With Nakama ranging all across Indonesia, Tokopedia aims to simplify the lives of many to #FindYourPurpose together.