Data Engineer Manager

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

Data Integration Engineer - Manager

Here at Music Tribe, we are looking for an experienced and skilled Data Integration Engineer to join our global community.

The role will be predominantly remote, with the occasional commute to one our local offices in Europe and Asia.

Role & Responsibilities:

• Responsible for delivering a detailed roadmap on data integration and automation based on business goals.
• Responsible for the effort to design, develop, implement, manage, and support enterprise level ELT/ELT processes and environment.
• Build and maintain data integration processes using SQL Services and other ETL / ELT processes and scripting tools as well as ongoing requests and projects related to the data.
• Designing the infrastructure/architecture of big data platform.
• Developing, creating and maintaining reliable data pipeline and schemas that feed other data processes.
• Leverage Agile, CI / CD and DevOps methodologies to deliver high quality product on-time.
• Setting up and managing streaming flows to leverage transactional data, IoT devices and hardware sensors. ?
• Responding to errors and alerts to correct and re-process data. Investigate data mismatches and apply solutions. Data scrubbing and analysis to troubleshoot data integration issues and determine root cause.

Essential Skills:

• Hands-on experience using Synapse or related tool with cloud-based resources (e.g. Stored Procedures, ADF, NoSQL Databases, JSON/XML data formats)?.
• Hands-on experience with Azure Functions, Azure Data Factory data integration techniques?.
• Knowledge of Data Modelling concepts, monitoring, designs and techniques?.
• Knowledge of Data Warehouse project lifecycle, tools, technologies, best practices?.
• Demonstrative ability to develop complex SQL queries and Stored Procedures.
• Hands on with DWH, APIs (RESTful)/postman, Spark APIs, FTP protocols, SSL, SFTP, PKI (public Key Infrastructure) and Integration testing.

Qualifications & History:

• Bachelor’s degree or equivalent in an engineering/numerate subject; or equivalent combination of education and experience?.
• Full-stack development and applying it to build science products. E.g. could include some or all Python/R, Linux scripting, SQL, Docker coupled with front ends such as HTML, Javascript, web front ends.

Tools & Methodology:

Full stack of Azure: Azure Datalake Gen-2, Azure Synapse, Azure Data Factory, Power BI, Power Automate, Azure Storage Explorer, Azure Cosmos DB, Azure Databricks, Azure Data Studio), Python/R, MDM Profisee (a plus), Azure D365, Apache Spark

Why work for us?

• Annual leave provision, plus public holidays
• Pension / retirement fund contributions
• Health Care
• Hybrid & remote working options in some locations
• We measure our People Engagement
• We run quarterly team building events
• We are invested in learning & development
• We reward daily through digital recognition systems