Data Science Engineer

Key Skills

Apache Hive, Apache Impala, Azure, Big Data Technology, Cloudera, Continuous Integration & Continuous Delivery - CI/CD, Databricks, DevOps, ETL/ELT technologies, Git, Java Programming, Kubernetes-K8s, Python Programming, SPARK Programming, SQL

Job Description

Are you looking for opportunities to work on high profile rail projects and advanced technology alongside experts from the around the globe? Come and join the fastest growing rail business in the world!

Hitachi Rail is a fully integrated, global provider of rail solutions across rolling stock, signalling, service & maintenance, digital technology and turnkey. With a presence in 38 countries across three continents and over 13,000 employees, our mission is to contribute to society through the continuous development of superior rail transport solutions. We are working to Inspire the Next – and this is your chance to be part of it.

Your new role

Hitachi Rail Limited is seeking an experienced Data Engineer to join the Maintenance Technology Systems team that are based predominantly in central London. Although this role can be based at any of our UK locations with flexible hybrid working.

The BI Engineer will be responsible for the following deliverables:

• Coordinate with the supplier team and work alongside them to guide and deliver the Change Requests and work on the high priority incidents.
• Responsible for supporting the existing Data Platform in Cloudera ,the data pipelines(PDI) and reporting(PBA)
• Interact closely with Supplier to coordinate and support the Migration Program of the existing fleets from On Premise Data Platform i.e CDH to Cloud Platform using CDP.
• Interact closely with Supplier to coordinate and support the Phoenix Program of on-boarding new fleets in Azure Data Platform.
• Work alongside the BI Architect and the Data Science Team to work on various POC’s as well as the development stream as a part of new requirements
• Test the overall solutions against functional and non-functional requirements.
• Provide support to do various documentation and maintain the enhanced knowledge repository.

In addition to the duties and responsibilities listed, the job holder will be required to perform other duties assigned by the manager from time to time, as may be reasonably required of them.

About you

Key Skills & Experience

It is our expectation that successful applicants should be able to demonstrate all of the experience and skills listed below:

Essential Requirements:

• Experienced in Azure (provisioning resources, monitoring and managing services).
• Proficient with Git (source control for infrastructure and code, pull request workflows).
• Proficient setting up CI/CD pipelines and Infrastructure as code (ideally via ARM).
• Experienced with working with container technologies, particularly Kubernetes.
• Competent at writing and debugging SQL.
• Good experience at writing clean and performant code in Python/Java or other backend language.
• Capable of developing and deploying services/tools for data generation and transformation.
• Good communicator, quick to respond to queries and reaching out for help when facing issues.
• Keenness to continuously learn and strive to be the best, finding solutions to difficult problems.
• Excellent analytical skills.
• A knack for independence and group work alongside supplier.
• Scrupulous approach to duties.
• Capacity to successfully manage a pipeline of duties with minimal supervision.

Qualifications

• Bachelor's degree in data engineering, big data analytics, computer engineering, or related field.

Desirable Requirements

• Experience and knowledge of train to shore systems and communications, preferable knowledge of train systems and architecture
• Experience with Azure DevOps
• Experienced with designing and operating ETL jobs on DataBricks at scale, and general ‘LakeHouse’ approach or equivalent
• Experience with data warehousing
• Experience of using Cloudera / Apache stack including Hive, Impala, Spark