Data Engineer Sr

Key Skills

Apache Hadoop, Apache Hive, Apache Kafka, Apache NiFi, Bash scripting, Big Data Technology, HDFS, Python Programming, Server architectures, SparkML, SQL

Job Description

As a key member in the Advanced Data Analytics team, the Data Analyst will work with this and a cross-functional team to develop and execute the data analytics strategy and apply to Oshkosh Corporation products. Advanced Data Analytics wok encompasses the acquisition, processing and machine learning of engineering or service data and application to preventive maintenance and intelligent control of on or off-road vehicles.

ESSENTIAL DUTIES AND RESPONSIBILITIES: 

These duties are not meant to be all-inclusive and other duties may be assigned.

• Design and develop scalable ETL solutions to deliver data from source systems to analytics platforms (structured and unstructured; bath and streaming).
• Responsible for testing and validation in order to support the accuracy of data transformations and data verification used with enterprise-wide analytics.
• Assist in ensuring proper data governance (quality security, etc. within the data lake and enterprise data warehouse systems across all business segments.
• Assist with performance-tuning data processes as well as troubleshooting data processing issues.
• Collaborate, coordinate, and communicate across disciplines, departments and segments.
• Develop rapid prototyping and design processes for fast solution delivery to the business.
• Maintain reference architecture and documentation for the purposes of architectural governance and application roadmap.
• Assist in education others on best practices surrounding data work (i.e. data modeling, database design, ETL design, job scheduling and monitoring, etc.).
• Assist or direct feasibility studies and project estimates (manpower, budget development, and timelines, etc.) on proposed research and development projects.
• Follow the directors of the supervisory very efficiently and provide feedback on the technical hurdles and progresses with clarity and assess the priorities based on business needs.
• Complete the tasks under the guidance on mutually agreed schedule between the candidate and the supervisor/program manager with minimum mentoring.

MINIMUM QUALIFICATIONS:

• Bachelor’s degree in computer science, data science or a related field with five (5) or more years of working as a data engineer, ETL developer and/or data warehouse DBA.

PREFERRED QUALIFICATIONS:

• Experience with big data tools and architectures, such as Cloudera Hadoop, HDFS, Hive, and Spark.
• Working knowledge of telematics interfaces and streaming solutions (MQTT, NiFi, Kafka, etc.).
• Automotive or heavy duty on or off-road vehicle, digital data bus, including Ethernet or Controller Area Network (CAN) experience.
• Highly organized and detail-oriented, with strong critical thinking, analytical, and problem-solving skills.
• Ability to handle multiple tasks in a fast-paced environment, both independently and as part of a team.
• Display excellent interpersonal skills as well as the ability to effectively present information and respond to question from leadership and peers.
• Strong proficiency with SQL, Bash, and Python (and experience with the Anaconda distribution).