Big Data Lead

Key Skills

Azure, Big Data Technology, Data cleaning / Data cleansing, Data Migration, Data Modeling, Database, Databricks, Flax Programming Language, MS Visual Studio, MySQL, PaaS, PowerShell Programming, Python Programming, SQL

Job Description

Job Skills

Cloud–Databricks, Databricks, BI/BA

• High-quality data engineering work, helping to ensure project timelines are met, and providing informal mentoring / training to junior members of the team
• Leading the delivery of data quality reviews including data cleansing where required to ensure integrity and quality
• Owning the delivery of data models, data storage models and data migration to manage data within the organization, for a small to medium-sized project
• Resolving advanced design and implementation issues with moderate to high complexity
• Analyzing the latest industry trends such as cloud computing and distributed processing and beginning to infer risks and benefits of their use in business
• Providing technical expertise to maximize value from current applications, solutions, infrastructure and emerging technologies and seek to continuously improve internal processes
• Developing working relationships with peers across other engineering teams and beginning to collaborate to develop leading data engineering solutions

Driving adherence to the relevant data engineering and data modelling processes, procedures and standards

TECHNICAL SKILLS:

• Cloud Computing Services –MS Azure
• Distributed Systems – Databricks
• ETL Tools –Azure Data Factory
• Programming Languages – PowerShell, Python, Visual Studio

Relational SMP Databases – Azure SQL PaaS OR MySQL or SQL Server