Lead Big Data Engineer

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

Join the emerging platform organization, which is responsible to build, and deploy customer facing solutions using Big Data technologies. Bring in your expertise with developing strategic data supply chain for superior customer experience.

Key Responsibilities:

• Perform hands on development with Spark, Hive, NoSQL, SOLR, Janus, Kafka & In-memory data processing. 
• Develop data architecture and solution designs for classic batch, speed and serving layer. 

• Improve / reengineer existing solutions with data speed/latency, quality and ability to derive analytics insight. 
• Serve as an escalation point for deployments, and change oversight, enabling highly visible business priorities.

Essential Business and Technical Skills:

Required:

• Advanced knowledge of the principles of computer application, including software engineering, system analysis and design, design and analysis of algorithms, digital systems, computer system architecture, data structures, computer networks, database management system, and problem solving and computer programming, among others. 

• Core hands on development skills in Bigdata ecosystem i.e. Spark Scala, SOLR, Hive, HBase and Janus.
• Experience with real-time data delivery, Kafka, NiFi, and Change-data-capture 
• Optimize and tune queries, job flows on Hadoop environments to meet performance requirements. 
• Good understanding of release management, CI/CD 
• Work with Bigdata developers designing scalable supportable Application development. 

• Programming using Shell script/Python to create automation scripts. 
• Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders. 
• Responsible for developing and maintaining the operate runbooks. 
• Minimum bachelor’s degree in computer science or related field is required, master’s degree preferred. 
• 8+ years of software design and development experience. 

Preferred:

• 4+ years of experience in deploying Hadoop components Hive, Spark, HBase, SOLR and Janus.
• Strong communication skills to lead interactions with business and technology leaders across the global lines of businesses. 
• Cloud experience is plus with Azure, and Google 
• 3 to 5 years of functional experience in Insurance industry

• Experience working in cross-functional, multi-location teams. 
• Excellent analytical and problem-solving skills.

Business Category

Big Data Platforms

Number of Openings

1