Senior Azure Data Engineer

Key Skills

Aartificial intelligence, Azure, Big Data Technology, Data Engineering, Data Warehousing, Databricks, Design, Effective communication skills, ETL frameworks, IaaS, IT, Machine learning techniques, PaaS, PowerBI, PySpark, Python Programming, R Programming, Scala Programming, SPARK Programming, SQL, SQL Server

Job Description

Responsibilities:

• Develop data pipelines for data ingestion and ETL processes from SQL sources or Big Data technologies
• Identify, design, and implement internal process improvements, including the automation of manual processes, optimization of data delivery, and the redesign of infrastructure for enhanced scalability
• Provide leadership and assistance to technical teams, engaging in discussions with senior management to communicate the business impact
• Utilize project management and business analyst skills to gather requirements, lead and manage projects, and ensure timely project delivery
• Consolidate data from diverse sources to create comprehensive data sets for reporting, covering areas such as data mining, staging, and production
• Conduct thorough assessments and discovery processes to identify bottlenecks and gaps in infrastructure. Recommend and implement improvements to enhance efficiency
• Communicate effectively about technical projects and their business implications to both technical and non-technical stakeholders, including management
• Oversee the service and delivery of technical engagements, ensuring exceptional quality and client satisfaction
• Uphold high-quality standards for the delivery of business proposals and technical documentation
• Develop analytics dashboards and automate reports containing key performance indicators (KPIs) to facilitate data-driven decision-making in the business

Qualifications, Skills & Experience:

• Formal education in IT, Computer Science, Computer Engineering, or a related field, and 5-8 years of experience in a Data Engineering role
• Intermediate to Expert level experience with Azure Data Factory, Azure Databricks, Azure Analysis Service, Azure Synapse, and PySpark
• Familiarity with cloud deployment models: IaaS, PaaS, Hybrid
• Solid experience with SQL Server; familiarity with logical SQL statements, functions, triggers, and stored procedures
• Expertise in data modeling
• Hands-on technical expertise in Big Data or Data Warehouse technologies
• Demonstrated ability to optimize data access for speed, reliability, and velocity as required by the business
• Proven track record of implementing and leading multiple cloud migration engagements
• Proficient in scripting and automating repetitive day-to-day tasks to optimize efficiencies
• Energetic and results-oriented, with a demonstrated ability to leverage technology to achieve objectives and enhance efficiency
• Able to work independently in a fast-paced environment and take the initiative to drive continuous optimization and improvement in the business
• Exceptional client-facing communication skills (both written and verbal), including the ability to collaborate with onshore and offshore teams

Nice to Have:

• Either AZ-300 or DP-200/201
• Agile experience or Certification
• Experience with Microsoft Power BI 
• Proficiency in Python, R, Scala, or Spark scripting
• Experience with Azure Networking or Security

About Adastra

For more than 20 years, Adastra Corporation has been hyper-focused on data and the infrastructures to support it. We are an international consulting company working work with businesses and IT Leaders to extract value through data and analytic solutions in the domains of Cloud, Data Management, Analytics, AI and ML, Governance, Hyper Automation, and Enterprise Application Development. Our team of experts, combined with our worldclass data management platform, helps provide trusted insights, establish frameworks, enforce best practices, and streamline processes for around-the-clock global coverage. Adastra has a proven track record of helping organizations of all sizes – from SMEs to Fortune 1000s – achieve their data transformation goals, whether that be accelerating innovation, improving operational excellence, or creating unforgettable customer experiences.

What We Offer

• Opportunity for advancement and career progression
• Competitive compensation package
• Comprehensive benefits plan
• Successful referral program
• The opportunity to work with one of Canada’s 50 Best Managed Companies
• Satisfaction of working for a reputable company 
• A flexible, dynamic, and diverse workplace

Equal Opportunity Employer

In our commitment to promote fair and equitable treatment of all employees and applicants, Adastra Corporation provides equal employment opportunities for all individuals regardless of age, sex, disability, race, ethnic origin, citizenship, creed, sexual orientation, marital status, or any other ground as described in the Ontario Human Rights Code. In addition, accommodation will be provided during the hiring process. Adastra Corporation’s implementation and support of employment initiatives, encourage diversified labour force participation and equal access to opportunities based on merit and performance.