-
Job Type
Full Time -
Experience
2-4 year -
Salary
$120,000 - $190,000 / Year -
Location
Chicago, IL, USA -
Job Function
-
Industry
Information Technology -
Qualification
Key Skills
Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow
Job Description
Data Engineer (Python/Spark/PySpark) - 86561
Technology and Engineering - USA Chicago, Illinois
If you are a DevOps and/or Cloud-based systems enthusiast who likes to work on cutting-edge technologies in an environment that gives you the freedom to explore, play, and learn, then Nielsen is the right place for you. Join a close-knit, passionate team that collaborates in an agile environment to develop great technology.
In this role, you will be working with devops engineers, data engineers, and data scientists to build/improve the data platform on AWS to ingest data from both internal and external sources, perform ETL and most importantly enable the process for the entire company through the Media Data Lake Ecosystem.
The role requires you to have experience working with large datasets with complex schemas, a can-do approach towards automation, treat data with due care and compliance.
RESPONSIBILITIES:
- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
- Collaborate with product and technology teams to design and validate the capabilities of the data platform
- Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
- Provide technical support and usage guidance to the users of our platform’s services.
- Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
- Design, implement and simplify our system for 24x7 availability
QUALIFICATIONS:
- Experience building and optimizing data pipelines in a distributed environment
- Experience supporting and working with cross-functional teams
- Proficiency working in Linux environment
- 4+ years of advanced working knowledge of SQL, Python, and Spark
- 2+ years of experience with using a broad range of AWS technologies - S3, Lambda, Glue, Athena, IAM, SQS, CloudWatch, CloudFormation
- Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
- Experience with platform monitoring and alerts tools
Desired Skills:
- Experience with GCP / Azure
- Experience with docker and kubernetes.
- Experience with Presto, Airflow, Prometheus, ELK, or similar technologies.
- History of working with external data providers.
- History of open source contributions.
Company Info.
NielsenThe Nielsen Corporation, self-referentially known as The Nielsen Company, and formerly known as ACNielsen or AC Nielsen, is a global marketing research firm, with worldwide headquarters in New York City, United States. Regional headquarters for North America are located in Chicago.
-
IndustryInformation Technology
-
No. of Employees43,000
-
LocationNew York City, NY, United States
-
Website
-
Jobs Posted
Get Similar Jobs In Your Inbox
Nielsen is currently hiring Data Engineer Jobs in Chicago, IL, USA with average base salary of $120,000 - $190,000 / Year.
Similar Jobs View More
Big Data Engineer (Python, Spark and SQL) Rotterdam, Netherlands
NielsenRotterdam, Netherlands
2-4 year
Business Intelligence Leader (North America & Global Extracts)- Must be US-Based
NielsenIQUnited States
6-8 year