Senior Big Data Engineer

Key Skills

Agile methodologies, Apache Hadoop, Apache Hive, Apache Pig, Big Data Technology, Cloud computing, CloudFormtion, Continuous Integration & Continuous Delivery - CI/CD, Data Visualization, DevOps, Docker, DynamoDB, ETL frameworks, GitLab, Kubernetes-K8s, Linux Operating system, MongoDB, MySQL, NoSQL, Python Programming, RDBMS, Scala Programming, SDLC, Spark Core, Terraform

Job Description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. 

Nielsen is seeking a solid and experienced Big Data Engineer. This position requires at least 4 years of experience in the web domain. This position will be responsible for development tasks, including frontend, and database development. The successful candidate will be required to engage with all areas within Nielsen including collection, processing systems, testing, operations, with partners worldwide.

What kind of engineer are we looking for?

• Strong programming skills using at least one of the languages like Spark, Scala, Python.
• Working knowledge of AWS Cloud Servers and related services.
• Good knowledge of RDBMS (MySQL), database designing, and query optimization techniques.
• Experience in NoSQL (MongoDB / DynamoDB / DocumentDB) databases will be an added advantage.
• Experience with Data ETL (Extract Transform and Load) using Legacy and Cloud based services.
• Working knowledge of version controlling systems like GitLab, clear understanding of Gitflow workflow, repository management tools like BitBucket, and understanding of the overall CI/CD process.
• Knowledge with real time streaming data processing using technologies like Kafka & Spark is a plus.
• Knowledge of big data processing and query technologies like Hadoop, Hive and Pig is a plus.
• Knowledge of User Interface design and Data Visualization and Reports is a plus.
• Knowledge of container technologies like Docker and Kubernetes.
• Knowledge of infrastructure as code using Terraform, Cloudformation and Ansible.
• Desire to leverage DevOps techniques including fully automated testing and deployment, Agile methodology and continuous integration/continuous delivery.
• Experience with instrumenting logging and monitoring into applications.
• Experience with setting up test environments, designing test plans, developing test cases/scenarios/usage cases, and executing these cases.
• Experience with Linux OS and Shell scripting.
• Experience with all aspects of product/system development life cycle.
• Desire to invent the next generation of measurement techniques.
• Passionate about technology and the desire to grow professionally.
• Creative thinkers who can propose solutions to tough problems and collaborate well with other Engineers.

Qualification

• B.E. / B.TECH / MCA / (BS / MS in Computer Science)

About Nielsen

• We’re in tune with what the world is watching, buying, and everything in between. If you can think of it, we’re measuring it. We sift through the small stuff and piece together big pictures to provide a comprehensive understanding of what’s happening now and what’s coming next for our clients. Today’s data is tomorrow’s marketplace revelation. We like to be in the middle of the action. That’s why you can find us at work in over 100 countries. From global industry leaders to small businesses, consumer goods to media companies, we work with them all. We’re bringing in data 24/7 and the possibilities are endless.