Big data

Key Skills

Java Programming, Python Programming, SQL, AWS, Big Data Technology, Apache Hadoop, Scala Programming, Jenkins, Apache Hive, Apache Airflow, SPARK Programming, ETL frameworks

Job Description

Expertise working with large scale distributed systems (Hadoop, Spark, Hive).

• Strong understanding of the big data cluster, and its architecture
• Experience building and optimizing big data ETL pipelines.
• Advanced programming skills with Python, Java, Scala.
• Good knowledge of spark internals and performance tuning of spark jobs.
• Strong SQL skills and is comfortable operating with relational data models and structure.
• Experience with messaging systems like Kafka.
• Experience with No SQL databases, DashDB, etc.
• Expertise with Continuous Integration/Continuous Delivery workflows and supporting applications.
• Exposure to cloud environments and architectures. (Preferably AWS)
• Ability to work collaboratively with other teams.
• Experience with containerization using tools such as Docker will be added advantage.
• Strong knowledge of Linux and Bash. Can interact with the OS at the command line and create shell scripts to automate workflows.
• Advanced understanding of software development and collaboration, including experience with tools such as Git.
• Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences.
• Experience is orchestration tools like Airflow, Jenkins
• Experience vely with other teams.
• Experience with containerization using tools such as Docker will be adin Apache Ni-Fi process

Job Function

• TECHNOLOGY
• Role
• Developer
• Job Id
• 238868
• Desired Skills
• Big Data | Hadoop