UKI Data Engineer

Key Skills

Azure, Big Data Technology, Continuous Integration & Continuous Delivery - CI/CD, Data Lake, Data science techniques, Data Warehousing, Databricks, Design, DevOps, Java Programming, PowerBI, Python Programming, R Programming, SPARK Programming, SQL

Job Description

Development and automation of ingestion flows, data curation and access layers 

o Define technical solutions and take part in the development and deployment of applications in accordance with central standard and guidelines

o Contribute to the improvement of standards, compliance and processes to guide Data Lake evolution

o Design, develop, test and deploy data ingestion flows, data marts and core target data components

o Implement tools and end-to-end monitoring to ensure high availability of production data processing, data quality and reliability

• Maintenance of data transformation routes in the Data Lake

o Maintenance of BAU including reporting regularly on performance, risks and issues

o Demonstrate proactivity and pragmatism in solving issues and problems

• Support and work collaboratively within multi-disciplinary data team and data consumers
• Contribution to the development of the UK&I data roadmap, in coordination with other teams/customers

o Engage with data scientists, analysts and the business to define extraction, transformation, load approaches

o Collaborate with data providers or other data engineers of other data teams for data lake project and BAU tasks

o Support to others in the data community though knowledge sharing, technical demonstrations and upskilling

Your Profile

Technical/ Functional Knowledge, Skills and Abilities 

• You have experience working within multi-disciplinary data teams
• You are fluent with the Big Data stack in cloud environment (ADLS, Databricks, ADF, Azure DevOps etc)
• You have knowledge and experience of reporting solution design including Azure platforms, Pegasus, Attunity, Wax, R, SQL, Python, Spark, Power BI, Business Objects
• You have a deep understanding of data lake technologies, interrogation of structures and unstructured data, data warehouse and data schema design for optimised reporting performance
• You have a very good understanding of spark processes
• You are fluent in multiple development languages 
• You have a good understanding of the software development process (git, ci/cd etc.)
• Entrepreneurial, team and can-do spirit, able to work unsupervised and with problem-solving skills, constantly striving for effective solutions 
• Creativity, innovation mindset and ability to correctly take into account technologies low stacks
• Customer-centric with quick reactivity on issues or changing requirements to deliver high-level of service
• Working with Agile mindset in an international, multicultural and complex environment (English is mandatory)

Interpersonal skills 

• Self-starter with desire to continuously improve 
• Understanding the motivation levers for key stakeholders
• Accustomed to working with distributed teams, including international teams
• Builds constructive working relationships across organisational boundaries and irrespective of reporting lines
• Flexible and adaptable; able to perform effectively in ambiguous situations
• Resilient and tenacious with a strong propensity to persevere in a moving environment