Data Architect (Abinitio)

Key Skills

Amazon Athena, Amazon Simple Storage Service (S3), Apache Airflow, Apache Hadoop, Apache Hive, Continuous Integration & Continuous Delivery - CI/CD, Data science techniques, Framework, Github, Jenkins, Shell Scripting language, SQL

Job Description

About the Role:

Our Cloud Data Services Team is looking for a skilled Data Architect (Abinitio) for a customer-facing role. In this position, you will work with cutting-edge technologies and tools to build, optimize, and maintain large-scale data processing frameworks on the cloud. You'll collaborate with customers to design and deliver efficient, scalable data solutions.

Key Responsibilities:

• Leverage AWS services (S3, EMR, Athena, Glue) or equivalent cloud platforms for data storage and processing.
• Proficiency with AbInitio product suite , including experience in PDL, Meta-programming, Conduct>It, Express>It, and GDE-based development.
• Implement and maintain CI/CD pipelines using tools like Jenkins and GitHub.
• Work with schedulers such as Apache Airflow to automate workflows and data pipelines.
• Automate tasks and processes using Python, shell scripting, and other relevant programming languages.
• Develop, troubleshoot, and optimize PL/SQL queries for complex data workflows.
• Work extensively on Big Data platforms like Hadoop and Hive to process large datasets.
• Drive the development of large-scale, self-service enterprise data frameworks.
• Exposure to open table formats like Iceberg is highly desirable.