Big Data Solution Architect

Key Skills

Java Programming, Python Programming, SQL, AWS, Big Data Technology, Apache Hadoop, Apache Kafka, Scala Programming, Machine learning techniques, Product Development, Apache Hive, Docker, Kubernetes-K8s, Data Analytics, SparkML, Data Lake, H2O, Hortonworks, Networking technologies

Job Description

LYVE Cloud?Storage-as-a-Service platform is an S3-compatible storage-only cloud that enables always-on mass capacity data storage and activation. It is designed as a simple, trusted, and efficient service allowing enterprises to unlock the value of their massive unstructured datasets. LYVE Cloud is a natural extension of Seagate’s leadership in mass data solutions, combining our mass capacity HDD innovation with deep storage industry knowledge to help customers activate more of their valuable data.

In this highly visible role, you will help to develop and maintain the next generation enterprise data and analytics platform’s on Lyve Cloud. You will be a vital component in engaging architectural decisions, reviewing of designs, scrum leading, development, and in operations of the Data platforms.

If you're a Master of the “big picture”, with demonstrated success in development of Big Data solutions where you're building massive Data Lakes, then we want to talk with you. Snap up on this opportunity for your next big career challenge to create business value as you showcase your strength in technical architecture for designing systems and leading projects. You'll join our Lyve Cloud Analytics group and will be based in our Fremont, CA location.

About the role - you will:

• Be part of a product team of 8-10 Platform Engineers that are the crux for developing and maintaining Big Data (Data Lake, Data Warehouse and Data Integration) and Machine Learning /advanced analytics platforms on Lyve Cloud
• Apply your hands-on subject matter expertise in the Architecture and administration of Big Data platforms - Data Warehouse Appliances , Hadoop (AWS EMR, HortonWorks), Data Lake Technologies (AWS S3/GCS/Other) and experience with ML and Data Science platforms (Spark ML , H2O , KNIME)
• Develop and manage SPARK ETL Frameworks, Data orchestration with Airflow and support building PRESTO queries for the key stakeholders
• Design, scale and deploy Machine Learning pipelines
• Collaborate with Application Architects and Business SMEs to design and develop end-to-end data pipelines and supporting infrastructure
• Work with customers and business stakeholders to understand the needs and deliver on their highest priority features and requirements incrementally

About you:

• You’re a passionate professional who is up to the challenge of blending the fast-changing technology landscape of Big Data analytics with the complex and high-impact space of HiTech and Manufacturing analytics
• As a motivated self-starter, you have the experience working in a dynamic environment
• Strong appetite for constant learning, thinking out of the box, and questioning problems & solutions with the intent to understand and solve in more creative ways
• Uncompromisingly detail oriented, well organized with solid time management skills, and you have solid effective verbal and written communications abilities as well
• Ability to motivate people and instill ownership, reliability, teamwork, and commitment in the team
• Excellent interpersonal skills to develop relationships with different teams and peers in the organization

Your experience includes:

• Excellent technical skills with a proven and successful history working with data at scale and empowering organizations through data
• Big data processing frameworks: Spark, Hadoop, Hive, Kafka, EMR
• Architecting and developing big data solutions on cloud (AWS or Other)
• Advanced experience and hands-on architecture and administration experience on big data platforms
• Data Warehouse Appliances, Hadoop (AWS EMR, HortonWorks), Data Lake Technologies (AWS S3/GCS/Other) and experience with ML and Data Science platforms (Spark ML , H2O , KNIME )
• Python, Java, Scala
• DevOps, Continuous Delivery, and Agile development
• Creating a culture of technical excellence by leading code and design reviews, promoting mentorship, and identifying and promoting educational opportunities for engineers
• Bachelor's degree in Computer Science or Business/Data Analytics and 5+ years’ experience or Master’s degree in the same and 3+ years’ experience or equivalent experience and education

You might also have:

• Strong understanding of Micro-services and container-based development using Docker and Kubernetes ecosystem is a BIG plus
• Experience working in a Software Product Development environment is a BIG plus