Sr.Lead Data Engineer

Key Skills

Java Programming, Python Programming, SQL, AWS, Apache Hadoop, Zookeeper, Bootstrap, Perl Programming, Tableau, Presto, Apache Hive, MapReduce, Apache Pig, YARN, Terraform, Amazon EMR, Shell Scripting language, Linux Operating system, Apache Groovy, Amazon Simple Storage Service (S3), 3D interactions, LDAP clusters

Job Description

For decades, Samsung has been leading the charge on innovation. We see beauty in achieving excellence and our passion for change fuels our discoveries, inventions, and breakthrough technology. We believe that technology can, and should, make the world a better place, so we create new possibilities for people everywhere, push the limits of what’s possible, and constantly innovate.

At Samsung Electronics America, we take pride in the creativity and diversity of our talented people – they are at the forefront of everything we do. Their skillset and mindset drive our continued success. Only the resilient and resourceful thrive in the daily dose of unexpected at Samsung. We unapologetically push to achieve unforeseen potential in everything we do, both within the workplace and at home. We fearlessly face challenges head-on, conquer the unconquerable, and are comfortable living in the uncomfortable zone. Together we make the impossible possible. Because at Samsung, we Own the Unknown.

Are you ready to #OwnTheUnknown? Join us.

Role and Responsibilities

If you have ambitions to be a part of a Best in Class organization, Samsung’s eCommerce team is the place to be. We are responsible for the whole stack from infrastructure to support the platform at a global scale, to core eCommerce micro services, and web and mobile experiences. The Bigdata which is the integral part of the Samsung eCommerce team provides critical services like data platform, machine learning, analytics, data tools. The data team is developing systems with advanced technologies to make the data secure, high quality, reliable and easy to use. The data team is managing petabytes of data to support the Samsung business. The Big data team has technically challenging work in a fast paced work environment. The dynamic culture at Samsung offers both great challenge and great reward. If you want to work among the very best talent in the industry, working on the most innovative products in the world, Samsung is the place to be.

Position Summary:

Role and Responsibilities:

You will be expected to have:

• Work with the data team as a technical advisor and strategic thought leader to the data platform by providing architectural leadership.
• Responsible for the design, deployment, configuration, and operations for a multi-node big data cluster. This includes working with open source and/or commercial stacks to support the full SDLC. Resource will work to deploy, manage, and maintain development, test and production environments for the big data platform.
• Develop and maintain architectural roadmap for the data platform
• Develop scripts to automate and streamline operations and configurations in the infrastructure
• Use knowledge of enterprise security solutions like LDAP and Kerberos to maintain a secure environment
• Work to identify infrastructure needs and providing support to developers and business user
• Research performance issues; Optimize platform for performance
• Troubleshoot and resolve issues in all operational environments
• Work with a cross functional team delivering software deployments
• Forward thinking by continuously adopting new ideas and technologies to solve business problems
• Lead, participate, guide and mentor other team members on architecture and design with hands on.
• Collaborate with the key stakeholders, product owners, external vendors to define solution for business and technical requirements.

Skills and Qualifications

• Architecture design and development of large scale data platforms and data application with simple solutions
• Strong Experience in Hadoop Administration - AWS EMR is preferred
• Strong Experience in Hadoop - HDFS, MapReduce, Yarn, Pig, ZooKeeper.
• Strong Experience in Hadoop SQL tools - Hive and Presto
• Any Scripting Knowledge - Shell, Perl, python, groovy, terraform, ansible
• Strong Experience in Linux OS
• Experience on AWS services/network - Instances, Security Groups, Bootstrap actions, S3 Buckets, VPC/Subnet
• Strong Experience with Hadoop security and Governance - LDAP Integrations, Kerberos.
• Strong Performance tuning experience on Hive, Presto and MapReduce/Yarn.
• Strong Experience in monitoring, debugging and troubleshooting of services.
• Expertise in design and management of complex data structures and data processes.
• Experience in metadata management, high availability, ETL processing with streaming and batch data.

Basic Qualifications:

• Bachelors / Master’s Degree in Computer or related field in a reputed institution
• 10+ years of professional experience in software with most of them from a product company

Preferred Qualifications:

• Proficient in one or more technologies like:
• AWS, EMR
• Hadoop
• Python
• Tableau, Microstratgey
• LDAP, Kerebros