Azure Data Engineer

Key Skills

Azure, Data Engineering, Data Lake, Data science techniques, Data Warehousing, Databricks, Design, DevOps, Effective communication skills, Machine learning techniques, Python Programming, SPARK Programming, SQL

Job Description

Responsibilities

In your role as an Azure Data Engineer, you will be responsible for expanding and optimizing data and pipeline architectures, and for optimizing data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data delivery architecture is put in place throughout ongoing projects.

• Design and implement data pipelines using Azure technologies such as Azure Data Factory, Azure Stream Analytics, and Azure SQL Database
• Migrate on-premises data stores to Azure cloud platforms
• Implement data transformations using Azure Databricks
• Collaborate with data scientists to design and implement machine learning models using Azure Machine Learning
• Optimize data pipelines for performance and scalability
• Monitor and troubleshoot data pipelines within Azure Data Factory
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
• Participates in the testing process through test review and analysis, test witnessing and certification of software.
• Work with technical resources to ensure accurate translation of specifications into workable application code. Work with outside vendors and sister companies on coordinating data capture.

Qualifications

• 1+ years of experience as a data engineer
• Strong experience with Azure cloud technologies, including Azure Data Factory, Azure Data Bricks, Azure Synapse Analytics, and Azure SQL Database, T-SQL, SSIS, and SSAS Tabular
• Experience with data transformation and manipulation using Azure Databricks or similar tools
• Experience working in an Agile development environment
• Familiar with a variety of the field’s concepts, practices, and procedures and a strong focus on data integrity.
• Demonstrates strong written and oral communications skills. Ability, desire, and focus to meet deadlines Demonstrates ability to work with all levels of individuals.
• Demonstrates organizational skills while working on multiple projects; and communicate effectively within the team.
• Experience with machine learning is a plus

Education Requirement

• Bachelor's degree in Computer Science, Information Technology, or a related field

Technology Stack

• Azure SQL Data Warehouse
• Azure Data Factory
• Azure Data Lake
• Azure Analysis Services
• Azure Synapse Analytics
• Azure DevOps
• Databricks/Spark-SQL
• Python
• Azure Functions and Logic Apps
• Serverless Architecture

Additional Company Details

We do not accept unsolicited resumes from third party recruiting agencies or firms.

Sponsorship Details

Sponsorship not Offered for this Role