Data Science Specialist

Key Skills

AWS, Azure, Business Intelligence, Data Engineering, Data pipelines, Data science techniques, Databricks, Design, Effective communication skills, ETL frameworks, Google Cloud Platform (GCP), Python Programming, SQL

Job Description

Data engineer with intermediate skills in Databricks, experience in creating and managing data pipelines using Databricks, as well as solid knowledge of Python. Responsible for developing and maintaining efficient and scalable data pipelines, as well as collaborating closely with multidisciplinary teams to meet the organization's data analysis needs.

Responsibilities

• Develop and maintain data pipelines using Databricks for data ingestion, transformation and loading from multiple sources.

• Collaborate with engineering and data analysis teams to understand requirements and design effective solutions.

• Optimize the performance and efficiency of data pipelines to ensure system scalability and reliability.

• Perform extensive testing and debugging to ensure data integrity and quality.

• Automate repetitive tasks and improve processes using tools and scripts in Python and SQL.

• Document and maintain relevant technical documentation related to data pipelines and ETL processes.

• Collaborate with other teams to develop dashboards/front ends, reports and analyzes based on the processed data.

Requirements

• Completed bachelor's degree in Computer Science, Software Engineering, Computer Engineering or related field
• Previous work experience of at least 1 year in similar roles, preferably in data analysis or business intelligence environments
• Demonstrable experience creating and managing data pipelines using Databricks
• Solid programming knowledge in Python for script development and task automation.
• Experience designing and optimizing SQL queries to manipulate and extract data from relational databases.
• Familiarity with cloud computing concepts and data storage platforms such as AWS, Azure or Google Cloud Platform.
• Ability to work autonomously and as a team in a dynamic and constantly changing environment.
• Excellent verbal and written communication skills, with the ability to explain technical concepts clearly and concisely.
• Results orientation and ability to manage multiple tasks and projects simultaneously.
• English level: Intermediate-advanced