Module Lead - AWS Data Pipeline

Key Skills

Apache, Apache Hadoop, Applied Machine Learning, AWS, Azure, C Programming, C++, Data Analytics, Data Architecture, ETL frameworks, Google Cloud Platform (GCP), Graph OLTP, Java Programming, OLAP, PySpark, Python Programming, Rust, SPARK Programming, SQL, TypeScript

Job Description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, were a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire AWS Data Pipeline Professionals in the following areas :

• Our Digital Service Line is currently looking for industry-leading seasoned AWS Data professionals with hands-on experience.
• The shortlisted candidate should have the ability to analyze technical needs and work with the customers to develop project scope of work documents and Project Plans.
• The responsibilities are primarily technical, although there is a strong element of functional understanding of the business process.

You are required to have skills in the following areas :

The ability to easily find, access, and analyze data across an organization is key for every modern business to be able to efficiently make decisions, optimize processes, and to create new business models.

As a Sr Data Engineer in the Healthcare Digital Data - Data Governance & Architecture team you will work hands-on to deliver and maintain the pipelines required by the Healthcare business functions to derive value from their data. For this, you will bring data from a varied landscape of source systems into our cloud-based analytics stack and implement necessary cleaning and pre-processing steps in close collaboration with our business customers. Furthermore, you will work closely together with our Data Governance and Quality Compliance teams to ensure that all data assets are governed according to the FAIR principles. To keep the engineering team scalable, you and your peers will create reusable components, libraries, and infrastructure that will be used to accelerate the pace with which future use-cases can be delivered.

*What we offer*

You will be part of a team dedicated to delivering state-of-the-art solutions for enabling data analytics use cases across the Healthcare sector of a leading, global Science Technology company. As such, you will have the unique opportunity to gain insight into our diverse business functions allowing you to expand your skills in various technical, scientific, and business domains. Working in a project-based way covering a multitude of data domains and technological stacks, you will be able to significantly develop your skills and experience as a Data Engineer.

Who you are

• MSc./PhD in Computer Science or related field and 8+ years of work experience in a relevant capacity
• Experience in working with cloud environments such as, Hadoop, AWS, GCP, and Azure.
• Experience with enforcing security controls and best practices to protect sensitive data within AWS data pipelines, including encryption, access controls, and auditing mechanisms.
• Agile mindset, a spirit of initiative, and desire to work hands-on together with your team
• Interest in solving challenging technical problems and developing the future data architecture that will enable the implementation of innovative data analytics use-cases
• Experience in leading small to medium-sized teams
• Experience in creating architectures for ETL processes for batch as well as streaming ingestion
• Knowledge of designing and validating software stacks for GxP relevant contexts as well as working with PII data
• Familiarity with the data domains covering the Pharma value-chain (e.g. research, clinical, regulatory, manufacturing, supply chain, and commercial)
• Strong, hands-on experience in working with Python, Pyspark R codebases, proficiency in additional programming languages (e.g. C/C++, Rust, Typescript, Java, ) is expected
• Knowledge of database technologies for OLTP and OLAP workloads and a firm grasp of SQL
• Experience working with Apache Spark and the Hadoop ecosystem
• Working with heterogenous compute environments and multi-platform setups
• Experience in working with cloud environments such as, Hadoop, AWS, GCP, and Azure
• Basic knowledge of Statistics and Machine Learning algorithms is favorable

The ability to easily find, access, and analyze data across an organization is key for every modern business to be able to efficiently make decisions, optimize processes, and to create new business models. The Data Architect plays a key role in unlocking this potential by defining and implementing a harmonized data architecture for Healthcare. Together with a team of Data Engineers, the Data Architect is responsible for the delivery and maintenance of reliable data pipelines for the ingestion of data from a heterogenous ecosystem as well as the creation of specialized, cloud-based data processing and analytics stacks. He/she will work hand in hand with our Data Governance team to ensure that all data assets are covered by our governance process. During the process the Data Architect will collaborate closely with our business, corporate functions, as well as out IT organization, in order to gather requirements and shape a global framework of engineering best practices.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture