Senior Data Engineer - Clearance Required

Key Skills

Data Analytics, Data oriented design- DoD, Effective communication skills, ETL frameworks, PySpark, SPARK Programming

Job Description

LMI is seeking a skilled Data Engineer to support data pipelining and sustainment of the Army Vantage analytics platform. Successful Data Engineers demonstrate competency in data acquisition, data analysis, programming, project execution, and critical thinking. In addition, LMI Data Engineers have demonstrated experience in collaborating with other Data Engineers and with effective communication with clients. 

Responsibilities

This data engineer will work as part of a team of experienced data scientists, data engineers, and data analysts to support the Army Vantage platform. Responsibilities include:

• Developing data pipelines using PySpark and SQL.
• Understanding complex and organization-specific datasets.
• Coordinates with external organizations to support the creation of system interfaces.
• Established connections with partner systems to support data pipelining.
• Produces dashboards and visualizations to support complex client requirements.
• Conducting root cause analysis, identifying errors, and refactoring pipelines as needed.
• Performing analyses to answer routine and ad hoc questions about Army systems as identified in the data being leveraged.
• Learning and applying relevant federal policy and regulations to data analysis.
• Developing and improving standard operating procedures.
• Communicating with systems development experts to design tools and applications to improve response to repeat requests.
• Researching, analyzing and documenting the benefits of various technical approaches.
• Proposing alternative designs and processes to manage various types of data using both standard and custom tables and fields.
• The data engineer will need the ability to work in teams and independently.

Qualifications

Required: 

• Bachelor’s degree in Information Systems, Computer Science, Data Science, Mathematics, Engineering, or other related business or quantitative discipline is required.
• Minimum six to ten years of experience in data engineering
• Experience with ETL process and concepts.
• Knowledge and experience manipulating and joining data from various sources and in various formats.
• Ability to query datasets from multiple sources, knowledge of data refresh methodologies, and ability to leverage data models.
• Superior communication skills, both oral and written
• Active DoD Secret Clearance

Desired: 

• Master's degree in a related field
• Working knowledge of Spark or PySpark
• Experience with the Palantir Foundry data analytics product
• Knowledge of Army business systems, domains, and enterprise data
• General knowledge of Army reporting criteria across domains
• Leading SAFe Agile Certified (or ability to become certified within 3-4 months).
• Understanding of Human Centered Design principles