Data Engineer - Data Architecture & Engineering

Key Skills

Azure, Data science techniques, Database, Effective communication skills, Machine learning techniques, Python Programming, R Programming, Scala Programming, SQL

Job Description

As a consultant in the Data and Analytics Practice you will be responsible for delivering quality solutions using the Microsoft’s Azure suite of tools, focusing specifically on the Synapse ecosystem. This is a senior position with extensive experience in data engineering and development, focused on database technologies, with specific experience with Azure Synapse. You will use your experience creating and optimizing star schema models in a dedicated SQL pool on Synapse to create effective structures to ingest data for analysis. You will also work with Table Distribution and Index types and understand partitioning strategies to update large tables. You will also use PolicyBase and Azure Data Factory to help ingest data. Your experience with Synapse Dynamic Management Views will help you to monitor and manage Azure Synapse Analytics. If you are an individual who is highly interested in Azure and Databricks technologies, you may be just who we are looking for to join our team.

Responsibilities

• Understand Azure Synapse Analytics architecture
• Be able to identify performance bottlenecks
• Monitor Azure Synapse Analytics using Dynamic Management Views
• Build performing data with Table Distribution and Index types
• Partition tables using partitioning strategy
• Creating and optimizing star schema models in a Dedicated SQL Pool
• Configure and manage workload classification and resource classes
• Build ingestion pipelines with PolyBase and ADF to load and export data (best practices)

Qualifications

• Bachelor’s Degree desired in Computer Science, Information Technology, or related field
• Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
• Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and tuning
• Knowledge of relational and dimensional database structures, theories, principles, and practice
• Expertise in working with Synapse and related technologies

Professional Skills:

• Eagerness to contribute in a team-oriented environment
• Desire to work in an information systems environment
• Excellent communication (written and oral) and interpersonal skills for both technical and non-technical teams
• Passionate about learning new technologies
• Analytical approach to problem-solving; ability to use technology to solve business problems
• Ability to work in a fast-paced environment

Additional Preferred Experience:

• Predictive, Prescription, and Descriptive Analytics using Data Science tools and technologies including Azure ML Studio/Services, R programming language
• Other Azure development expertise including Azure Databricks, Python, Scala, R
• Other Azure technologies including storage (DataLake, DeltaLake, Blob Storage)
• Knowledge of relational and dimensional database structures, theories, principles, and practice
• Certifications are a plus