Lead Data Engineer (TS/SCI Required)

Key Skills

Data Engineering, Data pipelines, Data science techniques, Design, Leadership Skill, Linux Operating system, Machine learning techniques, Unix Operating system

Job Description

Work you’ll do

Deloitte is looking for a Senior Data Engineer to join our Data Science and Capabilities Team that supports an applied research and development shop as we provide prototype data solutions to solve pressing mission issues.

As a Data Engineer, you will be required to interpret business needs and select appropriate technologies and have experience in implementing data governance of shared and/or master sets of data. You will work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions. You will create, maintain, and optimize data pipelines as workloads move from development to production for specific use cases to ensure seamless data flow for the use case. You will perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics. You will analyze data and systems architecture, create designs, and implement information systems solutions. This is a heavily hands-on-keyboard role where the primary programming language is Python but you will have the opportunity to branch into other languages in coordination with the full stack developers, data scientists, and machine learning engineers on the team.

Duties:

• Develop and design data pipelines to support an end-to-end solution.
• Develop and maintain artifacts i.e., schemas, data dictionaries, and transforms related to ETL processes.
• Manage production data within multiple datasets ensuring fault tolerance and redundancy.
• Design and develop robust and functional dataflows to support raw data and expected data.
• Collaborate with the rest of data engineering team to design and launch new features. Includes coordination and documentation of dataflows, capabilities, etc.
• Design and develop databases to support multiple user groups with various levels of access to raw and processed data.

The team

Deloitte’s Government and Public Services (GPS) practice – our people, ideas, technology and outcomes—is designed for impact. Serving federal, state, & local government clients as well as public higher education institutions, our team of over 15,000+ professionals brings fresh perspective to help clients anticipate disruption, reimagine the possible, and fulfill their mission promise.

The GPS AI & Data Engineering (AI&DE) offering is responsible for developing advanced analytics products and applying data visualization and statistical programming tools to enterprise data in order to advance and enable the key mission outcomes for our clients. Our team supports all phases of analytic work product development, from the identification of key business questions through data collection and ETL, and from performing analyses and using a wide range of statistical, machine learning, and applied mathematical techniques to deliver insights to decision-makers. Our practitioners give special attention to the interplay between data and the business processes that produce it and the decision-makers that consume insights.

Required:

• Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future
• Bachelor’s Degree required, STEM related field preferred (Data Science, Computer Science, Engineering, Physics, Mathematics, etc)
• Active TS/SCI security clearance required
• 8+ years experience with software platforms and services, such as Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar.
• Proficient experience utilizing JavaScript, Elasticsearch/Opensearch, JSON, SQL, XML.
• 5+ years experience with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, Redis, and graph databases such as Neo4j, Memgraph, or others.

Preferred Qualifications

• Familiar with Linux/Unix server environments.
• Familiar with common data structures needed to support common machine learning packages such as scikit learn, nltk, spacey, and others.
• Familiar with or desire to become familiar with data structures need to support Generative AI pipelines such as vector databases, NER, and RAG.

 Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applicants.html

Recruiting tips

From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte. Check out recruiting tips from Deloitte recruiters.

Benefits

At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.

Our people and culture

Our diverse, equitable, and inclusive culture empowers our people to be who they are, contribute their unique perspectives, and make a difference individually and collectively. It enables us to leverage different ideas and perspectives, and bring more creativity and innovation to help solve our client most complex challenges. This makes Deloitte one of the most rewarding places to work. Learn more about our inclusive culture.

Our purpose

Deloitte’s purpose is to make an impact that matters for our clients, our people, and in our communities. We are creating trust and confidence in a more equitable society. At Deloitte, purpose is synonymous with how we work every day. It defines who we are. We are focusing our collective efforts to advance sustainability, equity, and trust that come to life through our core commitments. Learn more about Deloitte's purpose, commitments, and impact.

Professional development

From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities to build new skills, take on leadership opportunities and connect and grow through mentorship. From on-the-job learning experiences to formal development programs, our professionals have a variety of opportunities to continue to grow throughout their career.