Lead Enterprise Data Architect

Key Skills

Java Programming, Python Programming, SQL, DevOps, Azure, PowerBI, REST API, Big Data Technology, Apache Kafka, Data science techniques, Business Intelligence, Continuous Integration & Continuous Delivery - CI/CD, Amazon Athena, Amazon RedShift, Amazon RDS, SPARK Programming, Streaming APIs, Lambda, AWS Kinesis, Amazon Simple Storage Service (S3), Data pipelines, ETL frameworks, AWS Glue

Job Description

Hitachi Vantara is looking for an experienced Lead Enterprise Data Architect to be a part of Customer Success, the Enterprise Data Architecture Group, which is an assembly of the industry's top-tier architects that deliver our highest level of service to ensure successful outcomes. The Enterprise Data Architect will be building and testing data pipeline architecture within cloud environments, as well as identifying, design, and implement internal process improvements for automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability. For this role, the Lead Enterprise Data Architect will be highly focused on working on data ingestion, extracting data from different sources, and taking that data and unloading the data into our systems, using Python and other tools. Additionally, this role will largely support new initiatives and development, as well as support current production systems. If you enjoy working within data and cloud environments, apply today!

What You Will Be Doing

• Build, and test an optimal data pipeline architecture (preferably on any cloud environments -AWS experience is a must)
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud-based big data technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Working knowledge of REST and implementation patterns pertaining to Data and Analytics.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Working knowledge of message queuing, stream processing, and highly scalable big data stores (Kafka, Kinesis, Storm) and ETL orchestration tools such as Airflow.
• Working on cloud-based big data automation and orchestration solution AWS/Azure DevOps - CI/CD.

What You Bring To The Team (Qualifications)

Mandatory Requirements:

• 8+ years of progressive IT or enterprise architecture experience.
• Programming - experience with Python, Spark, and SQL.
• AWS - experience with S3, Athena, Glue/Streamsets, Redshift/RDS.
• Data ingestion/Extraction - experience in extracting data from different sources (On-Prem/Cloud), different data types (structured/semi structured/unstructured) using APIs/Lambda/Ingestion tools

Nice to Have Requirements:

• A Bachelor's in Computer Science, Computer Engineering, Information Technology
• Experience in ETL, Data Warehousing & hands on experience on reporting tools i.e. Power B
• Understand and implement practices to comply with PHI, GDPR and other emerging data privacy initiatives.
• Understanding of Business Intelligence and Data Warehousing concepts and methods.
• Fully conversant with big-data processing approaches and schema-on-read methodologies. Preference for deep understanding of Spark, Databricks and Delta Lake, and applying them to solve data science and machine learning business problems.

Our Company

Hitachi Vantara is part of the Global Hitachi family. We balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.

Our people are our biggest asset, they drive our innovation advantage as we strive to offer a flexible and collaborative workplace where they can thrive. Diversity of thought is welcomed, and our employee base is represented by several active Employee Resource Group communities. We offer industry leading benefits packages (flexible working, generous pension, and private healthcare) and promote a creative and inclusive culture. If driving real change gives you a sense of pride and you are passionate about powering social good, we'd love to hear from you.