Data Engineer
TEKsystems, Inc.-
Job Type
Full Time -
Experience
2-4 year -
Salary
$120,000 - $190,000 / Year -
Location
Tysons, VA, USA -
Job Function
-
Industry
Information Technology -
Qualification
Key Skills
Java Programming, Python Programming, SQL, AWS, Apache Hadoop, Snowflake, Docker, Kubernetes-K8s, PySpark, Kubeflow, SPARK Programming, Data Analysis
Job Description
ON SITE TWO DAYS A WEEK
Description:
- Data Engineer Senior (CW)
- Position Overview:
Freddie Mac’s Single-Family Division is currently seeking a Senior BigData Developer to implement BigData tools and methods of data processing and ingestion as a member of the Credit Analytics and Reporting team.
Responsibilities include:
- Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
- Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
- Manage and implement data processes (Data Quality reports)
- Develop data profiling, deduping logic, matching logic for analysis
- Programming Languages experience in Python, PySpark and Spark for data ingestion
- Programming experience in BigData platform using Hadoop platform
- Present ideas and recommendations on Hadoop and other technologies best use to management
Qualifications:
- 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory
- 3+ years of programming experience in Python, Spark for data processing and analysis. - Mandatory
- Strong SQL experience is a must - Mandatory
- 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
- 2+ years of experience with containerization and orchestration. Hands on experience with AWS, Kubernetes, Kubeflow, Docker etc. - Optional
- Detail oriented. Excellent communication skills (verbal and written)
- Must be able to manage multiple priorities and meet deadlines
- Degree in Statistics, Economics, Business, Mathematics, Computer Science or related field
Skills:
- pyspark, hadoop, snowflake, AWS
Top Skills Details:
- pyspark,hadoop,snowflake,AWS
Experience Level:
- Intermediate Level
Company Info.
TEKsystems, Inc.We’re TEKsystems. We accelerate business transformation by solving complex technology, business and talent challenges - across the globe. We partner with 80% of the Fortune 500 to create solutions that enable them to capitalize on change. TEKsystems is an Allegis Group company.
-
IndustryInformation Technology
-
No. of Employees10,500
-
LocationHanover, MD, USA
-
Website
-
Jobs Posted