Talend Developer: Pyspark/Collibra

Key Skills

Python Programming, Scala Programming, C++, Java Programming, Machine learning techniques, Data science techniques, SQL, Apache Hadoop, MapReduce, TensorFlow, PyTorch, R Programming

Job Description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

If you are passionate about working on business problems that can be solved using structured and unstructured data at large scale, we would like to talk to you.

Responsibilities

• Analyse, design, and actively develop analytics frameworks, data lakes, and other cloud-based data solutions in AWS.

• Work with both technical and business stakeholders to understand current state, future needs and develop solution alternatives
• Identify, recommend and implement ETL process and architecture improvements.
• Expected to build prototypes to hand over to developers.
• Ensure process compliance in the assigned module, and participate in technical discussions or review.
• Looking for a team player who is open to working with newer technologies and with cross-functional teams.

Requirements

• Strong Experience in developing and implementing new data pipelines reusable frameworks for Big data.
• Experienced in working with enterprise data platforms, data lakes using big data technologies (AWS, Azure).
• Strong Apache Spark design and development experience using Python (PySpark)
• Must have strong experience on these Talend Modules – TAC, TMC, Data Integration, Data Quality, API Design and Services and Big Data Frameworks.
• Experience working on Public API enabling users to manage Talend Management Console (TMC) from an external system
• Knowledge of CICD (Github, Jenkins).
• Knowledge of Cloud Talend integration.
• Has experience with using Collibra as the Data Catalog platform and integration aspects of Talend with Collibra
• Strong experience in ETL methodology for performing Data Profiling, Data Migration, Extraction Transformation and Loading using Talend
• Experience in delivering quality work on time with multiple, competing priorities.