Product Engineer I - Big Data

Key Skills

Apache Hive, Apache Kafka, AWS, Big Data Technology, Effective communication skills, Flume, HBase, HDFS, Java Programming, Python Programming, Scala Programming, SPARK Programming

Job Description

Experian India is looking for a Data Analyst to join Credit Bureau development team. The candidate would possess a strong analytical mind, be a technical and creative thinker, have a strong aptitude for problem solving, and have zero tolerance for inefficiencies in software development & deliveries. The ideal candidate will have excellent written, oral and interpersonal communication skills, along with the fervent desire to continuously learn about different products and technologies.

You will be working on Big Data application. You will be a member of a team collaborating and working together towards common goals. The team is responsible for the design, development and support of the application.

What you’ll be doing

• Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services
• Integrate new data sources and tools
• Implement scalable and reliable distributed data replication strategies
• Ability to mentor and provide direction in architecture and design to onsite/offshore developers
• Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
• Perform analysis of large data sets using components from the Hadoop ecosystem
• Own product features from the development, testing through to production deployment
• Evaluate big data technologies and prototype solutions to improve our data processing architecture • Automate everythin

Qualifications

What you’ll need to bring to the party

• BS degree in computer science, computer engineering or equivalent
• 5 – 6 years of experience delivering enterprise software solutions • Proficient in Spark, Scala, Python, AWS Cloud technologies
• 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala
• Flair for data, schema, data model, how to bring efficiency in big data related life cycle
• Must be able to quickly understand technical and business requirements and can translate them into technical implementations
• Experience with Agile Development methodologies
• Experience with data ingestion and transformation
• Solid understanding of secure application development methodologies
• Experienced in developing microservices using spring framework is a plus
• Experience in with Airflow and Python will be preferred
• Understanding of automated QA needs related to Big data
• Strong object-oriented design and analysis skills
• Excellent written and verbal communication skills

Additional Information

Why us

• We’re a high-performance and driven team but we don’t forget to celebrate success
• We offer strong career and international opportunities for high performers
• We invest heavily in our products and our people
• We offer training and support from experienced subject matter experts and managers plus dedicated learning & development time