Data Engineer (Expert) -TS/SCI w/Poly

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, XML-JSON, Apache Hadoop, NoSQL, Shell Scripting language, Linux Operating system, SPARK Programming, ETL frameworks

Job Description

Provides expertise in the formulation of systems' scope and objectives. Determines operational objectives by studying business functions, gathering information and evaluating output requirements and formats. Designs and develops computer system specifications that are appropriate for users' needs and consistent with the overall design of the organization's/customer's information systems architecture standards. Creates or modifies procedures to solve technical problems related to computer systems and programs.

The Data Engineer will manipulate data and data flows for both existing and new systems. Additionally, they will provide support in the areas of data extraction, transformation and load (ETL), data mapping, data extraction, analytical support, operational support, database support, and maintenance support of data and associated systems.

As a member of the team, candidates will work in a multi-tasking, quick-paced, dynamic, process-improvement environment that requires experience with the principles of large-scale (terabytes) database development, large-scale file manipulation, data modeling, data mapping, data testing, data quality, and documentation preparation.

Key Responsibilities:

• Research, design, develop and/or modifies enterprise-wide systems and/or application software.
• Develop complex data flows or makes significant enhancements to existing pipelines.
• Resolves complex hardware/software compatibility and interface design considerations.
• Conducts investigations and tests of considerable complexity. Research emerging technologies to determine impact on application execution.
• Provides input to staff involved in writing and updating technical documentation.
• Troubleshoots complex problems and provides customer support for the ETL process Advises hardware engineers on machine characteristics that affect software systems, such as storage capacity, processing speed, and input/output requirements.
• Prepares reports on analyses, findings, and project progress. Provides guidance and work leadership to less-experienced software engineers. May serve as a technical team or task leader.

Required:

• This position requires an active TS/SCI with Poly.
• Bachelor's Degree in Computer Science, Electrical or Computer Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience 8-10 years of related software engineering and ETL experience.
• Experience building and maintaining data flows in NiFi or Pentaho.
• Familiarization with NoSQL datastores Familiarization executing jobs in Big Data Technologies (i.e., Hadoop or Spark).
• Excellent organizational, coordination, interpersonal and team building skills.

Preferred:

• Experience with the following languages: Java/J2EE, C, C++, SQL, XML, XQuery, XPath, Ruby on Rails, HTML/XHTML, CSS, Python, Shell Scripting, JSON Knowledge of servers operating systems; Windows, Linux, Distributed Computing, Blade Centers, and cloud infrastructure.
• Strong problem solving skills Ability to comprehend database methodologies
• Focus on continual process improvement with a proactive approach to problem solving Ability to follow directions and finish task