Cloud and Big Data Architect

Key Skills

AWS, Azure, Big Data Technology, DevOps, Python Programming, R Programming, Spark-SQL, UI design, UX design

Job Description

Job Description:

• 9-12 years of experience in the role of implementation of high end software products.
• Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.
• Must have : Operating knowledge of cloud computing platforms (AWS, especially Redshift, Glue, RDS, EMR, EC2, SWF, S3 services and the AWS CLI)
• Should be aware with columnar database e.g parquet, ORC etc
• Visualize and evangelize next generation infrastructure in Big Data space (Batch, Near Real-time, Real-time technologies).
• Passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source technologies and software paradigms
• Developing and implementing an overall organizational data strategy that is in line with business processes. The strategy includes data model designs, database development standards, implementation and management of data warehouses and data analytics systems
• Expert-level proficiency in at-least one of python/Java
• Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop (YARN; MR & HDFS) and associated technologies -- one or more of Spark, Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc.Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib)
• Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common task

Department:

Cloud & Data Engineering

Open Positions:

3

Skills Required:

AWS, Big Data, spark, python

Role:

• Evaluate and recommend Big Data and AWS Cloud technology stack best suited for customer needs
• Drive significant technology initiatives end to end and across multiple layers of architecture
• Provides strong technical leadership in adopting and contributing to open source technologies related to BigData across multiple engagements
• Designing /architecting complex , highly available , distributed , failsafe compute systems dealing with considerable amount (GB/TB) of data

Identify and work upon incorporating Nonfunctional requirements into the solution (Performance , scalability , monitoring etc.)

Education/Qualification:

BE / B.Tech / MCA / M.Tech / M.Com

Years Of Exp:

9 to 12 Years