Data Engineer II

Key Skills

Java Programming, Python Programming, SQL, AWS, Big Data Technology, Apache Hadoop, Apache Kafka, Scala Programming, Data science techniques, Presto, Apache Hive, MapReduce, Apache Airflow, YARN, Apache NiFi, SPARK Programming, HBase, Apache Oozie, ETL frameworks, VR/AR frameworks

Job Description

The Global Wafer Systems Group is a highly technical team responsible for the design, development, and deployment of systems for RHG Process Engineering and the Wafer organization’s systems initiatives. The Global Wafer Systems Groups have teams located in Bloomington, MN; Northern Ireland, UK; and in Penang, Malaysia - with significant collaboration between the teams. 
 

With a portfolio that includes AI-powered solutions, ML algorithms, best in class visualizations, and rapid deployment, this team has won industry awards due to its innovation, best in class systems, and value delivery. 
 

About the role - you will:

• Work to architect and develop big data solutions for smart factory, including operational data, parametric data, sensor data and image storage, processing and retrieval, and then utilize such data for machine learning
• Extract, transform and load (ETL) from source systems to Hadoop utilizing Spark/Sqoop/Nifi, HDFS flat files
• Maintain and develop Oracle PL/SQL procedures and Packages
• Use Spark/Hive for queries and ETL

About you:

• You are flexible and adaptive in learning new technologies and languages
• Must be comfortable with data wrangling to solve issues
• Able to collaborate with data scientists and applications developers in data architecture, and be able to run models and perform machine learning tasks as assigned, and scale solutions as needed

Your experience includes:

• Experience in big data or statistics - data management, data processing, data testing, data governance and analysis
• Strong working knowledge of SQL and the ability to write, debug, and optimize distributed SQL queries
• Demonstrated familiarity with industry-leading Big Data ETL practices
• Fluent in at least one of the following programming languages: Scala, Python, Java
• Demonstrated strength in data modeling, ETL development, and data warehousing
• Extract Transform Load (ETL) development
• Oracle's Procedural Language/Structured Query Language (PL/SQL) 
• Linux and shell scripting
• Hadoop Ecosystem - HDFS, MapReduce, YARN, Hive, Hbase, Oozie 
• Spark ETLs - Python Preferred 
• AWS technologies - EMR, Presto
• Bachelor's Degree in (Computer Science, Engineering, Data Science or a related field) and 3+ years experience, or Master’s Degree in (Computer Science, Engineering, Data Science or a related field) and 0+ years experience or equivalent education and experience
   

You may also have:

• Strong familiarity with batch processing and workflow tools such as Airflow, NiFi 
• Build Ingestion frameworks
• Streaming technologies - Spark, Kafka

Location:

In response to COVID-19, this position may temporarily begin and be performed virtually. Seagate is actively evaluating the virus and our employees' health and safety are our top priority. In the future, this position will report to and be performed at one of our primary locations.

Most of the team works in a hybrid setting with most days working remotely but going into the office occasionally for meetings.

Our Normandale campus spans two suburbs, Edina and Bloomington, and serves as the Recording Head development and manufacturing arm of Seagate. Located in the heart of a bustling community, Seagate offers an on-site café, or if you prefer, you can drive to one of many restaurants just minutes away. Need to grab a gift over lunch time? Shopping is abundant in the area. If working out is your thing, the on-site fully equipped fitness center hosts wellness programs, outdoor activities, tournaments and group workouts. Looking for something more laid back? Reset in one of our meditation rooms, or simply take a walk around our indoor walking path. On-site cultural festivals, celebrations and community volunteer opportunities also abound.