Sr Staff Engineer - Big Data

Key Skills

Java Programming, Design of Experiment, Python Programming, SQL, DevOps, AWS, Big Data Technology, Apache Hadoop, Scala Programming, Machine learning techniques, Data science techniques, Kubernetes-K8s, CSS3, SparkML, Data Lake, H2O, Hortonworks

Job Description

If you're a Master of the “big picture”, with demonstrated success in development of Big Data solutions where you're building massive Data Lakes, then we want to talk with you. Snap up on this opportunity for your next big career challenge to create business value as you showcase your strength in technical architecture for designing systems and leading projects. In this highly visible role, you will help to develop and maintain the next generation enterprise data and analytics platform for both on premise and cloud services. You will be a vital component in engaging architectural decisions, reviewing of designs, scrum leading, development, and in operations of the Data platforms

About the role - you will:

• Be part of a product team of 8-10 Platform Engineers that are the crux for developing and maintaining Big Data (Data Lake, Data Warehouse and Data Integration) and Machine Learning /advanced analytics platforms at Seagate
• Apply your hands-on subject matter expertise in the Architect, Develop and administration of Big Data platforms - Data Warehouse Appliances , Hadoop (AWS EMR, HortonWorks), Data Lake Technologies (AWS S3/GCS/Other) and experience ML and Data Science platforms (Spark ML , H2O , KNIME)
• Architecting solutions for analytics platform that increase efficient use of infrastructure & improve end to end SLA of data analytics pipeline. 
• Should have very good understanding for Data Engineering and Analytics Platform automations
• Exposure to interact with end customers, understand requirement and help design data analytics platform and data engineering pipeline 
• Strong understanding of cloud platforms & K8S architecture 

About you:

• You’re a passionate professional who is up to the challenge of blending the fast-changing technology landscape of Big Data analytics with the complex and high-impact space of HiTech and Manufacturing analytics
• As a motivated self-starter, you have the experience working in a dynamic environment 
• Strong appetite for constant learning, thinking out of the box, questioning the problems & solutions with the intent to understand and solve better
• You’re uncompromisingly detail oriented, well organized with solid time management skills, and you have solid, effective verbal and written communications abilities as well
• Ability to motivate people and instill ownership, reliability, teamwork, and commitment in the team
• Excellent interpersonal skills to develop relationships with different teams and peers in the organization

Your experience includes:

• Solid technical skills with a proven and successful history working with data at scale and empowering organizations through data
• Big data processing frameworks: Spark, Hadoop, Hive, Kafka, EMR
• Advanced experience and hands-on architecture and administration experience on big data platforms
• Data Warehouse Appliances, Hadoop (AWS EMR, HortonWorks, K8S, Trino), Data Lake Technologies (AWS S3/Athena /Other) and experience with ML and Data Science platforms ( Spark ML , H2O , KNIME )
• Python, Java, Scala
• Architecting and developing big data solutions on cloud (AWS or Other)
• DevOps, Continuous Delivery, and Agile development

Location:

Our site in Pune is dynamic, both in our cutting-edge, innovative work, as well as our vibrant on-site food, and athletic and personal development opportunities for our 400+ employees. You can enjoy breakfast, lunch, or dinner from one of four cafeterias in the park. Take a break from your workday and participate in one of our many walkathons or compete against your colleagues in carrom, chess and table tennis. Learn about a technical topic outside your area of expertise at one of our monthly Technical Speaker Series, or attend one of the frequent on-site cultural festivals, celebrations, and community volunteer opportunities.