AWS Data Engineer II - IN

Key Skills

Java Programming, Design, Python Programming, SQL, Agile methodologies, AWS, RDBMS, Big Data Technology, Apache Hadoop, ETL/ELT technologies, NoSQL, Apache Hive, Docker, Kubernetes-K8s, Continuous Integration & Continuous Delivery - CI/CD, HDFS, Amazon Athena, Amazon RedShift, Zeppelin, Sqoop, SPARK Programming, DynamoDB, HBase, Database testing, Lambda, AWS Kinesis, Data pipelines, AWS Glue

Job Description

• Collaborate with customer to gather requirements and to understand their business processes.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build cloud data solutions and provide domain perspective on storage, big data platform services, serverless architectures, Hadoop ecosystem, RDBMS, DW/DM, NoSQL databases, analytics services on public cloud platforms and security.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Design and write excellent, fully tested code to build ETL /ELT data pipelines and stream on an AWS platform.
• Define and document approach and design (code / testing / migration)
• Define Project detailed tasks, assigns to rest of the team members and monitor progress.
• Monitor quality - Review code and unit testing results
• Assists team members on tasks as needed. 

REQUIREMENTS

• 8+ years of hands-on experience in implementation and performance tuning Hadoop/Spark implementations.
• Proven expertise in deploying major software solutions for various high - end clients meeting the business requirements such as Big Data Processing, Ingestion, Analytics and Cloud Migration from On-prem to AWS Cloud.
• System development and deployment experience with Hadoop and spark-based platforms.
• Experience in technical customer facing role in container technologies and orchestration engines (ECS, EKS, Docker, Kubernetes).
• Experience with migrating mission critical data environment from on-premises to AWS or other cloud platforms.
• Great understanding of Hadoop framework and Big Data Ecosystems. Proven expertise on Big Data Ingestion, Processing and Workflow designs.
• Experience with Big Data technologies such as Hadoop, Hive, Hbase, HDFS, Sqoop, Spark, NoSQL, AWS EMR, Yarn, Zeppelin, Glue, Lambda, Kinesis
• Experience with AWS Data and Analytics technologies such as Glue, Athena, Redshift, Spectrum, Data Pipeline.
• Perform the migration of Hive and MapReduce Jobs from on - premises MapR to AWS cloud using EMR.
• Migrating Hive and MapReduce jobs to EMR with Automating the workflows.
• Hands on expertise with AWS Databases such as RDS(Aurora), Redshift, DynamoDB and Elastic Cache.
• Worked on End-to-End Software Development Life Cycle process in Agile Environment using SCRUM methodologies.
• Familiarity with CI/CD concepts.
• Strong analytic skills related to working with unstructured datasets.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Good Academic track record preferred.

QUALIFICATIONS/SALARY

• Degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
• Excellent Communication skills
• 8+ years of relevant experience.
• Negotiable salary.

About Rackspace Technology

We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.

More on Rackspace Technology

Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.