Senior Data and Platform Technical Lead

Key Skills

Java Programming, Design, Python Programming, Database, SQL, AWS, Big Data Technology, Product Management

Job Description

As part of the Corporate Affairs Engineering team, you will design and lead the implementation of a data pipeline to support the needs of Networking Academy, and develop and evolve the platform for various application to support CSR initiatives. You will create designs for components of the platform, to meet the platform’s goals of achieving scale and extensibility, and will work with a team of engineers to build these components and owns the end-to-end delivery. This role requires an understanding of various technology choices and a deep understanding of SQL/NoSQL technologies, distributed computing framework, and search and information retrieval techniques to make right tools and technology choices and then create modules and programs using those technologies.

Your responsibilities will include:

• Collaborate with Product Management to assist with data-related technical issues and support their data infrastructure needs.
• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Keep data separated and secure across national boundaries through multiple data centers and AWS regions.
• Create data tools for analytics and data science team members to assist them in building and optimizing our offer.
• Select frameworks and tie those together to build a platform that applications can be built on.
• Develop application-agnostics APIs to consume platform services.
• Evaluate open-source components for potential use in the platform.
• Design, build and maintain a relational database and/or data repository.
• Design and develop the core data integration platform from end to end.
• Establish good software practices within the team.