Big Data DevOps Lead

Key Skills

Ansible, Apache Cassandra, Apache Hadoop, Apache Kafka, Big Data Technology, DevOps, MariaDB, MySQL, NoSQL, Perl Programming, PostgreSQL, Prometheus, Python Programming, Snowflake, Terraform

Job Description

As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.

Main Responsibilities:

• Driving improvement of the efficiency of Big Data infrastructure.
• Coordinating cross-team infrastructure and Big Data initiatives.
• Leading Big Data – related architecture and design efforts.
• Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
• Building and supporting tools for operational tasks.
• Evaluating, designing, deploying monitoring tools
• Design and implementation of DR/BC practices and procedures.
• On-call support of production systems.

Requirements:

• 7+ years of experience working with Hadoop, preferably Open Source
• 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
• Experience setting up and running Hadoop clusters of 1000+ nodes.
• Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
• Experience running and troubleshooting Kafka.
• Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet.
• Proficiency in shell scripting.

Nice to have:

• Experience with Prometheus.
• Experience managing Showflake.
• Solid knowledge of Graphite and Grafana.
• Python or Perl scripting skills.
• Experience with installing and managing Aerospike.
• DBA experience with one of: PostgreSQL, MySQL, MariaDB.

Diversity, Equity and Inclusion at Zeta

We are committed to building diverse teams with different identities, backgrounds and perspectives.

We believe in providing a forum to connect at Zeta, to learn and celebrate differences. Our mission is to ensure we have an environment that enables a deep level of trust and belonging, so everyone feels invited to bring their whole selves to work, and to increase both diversity at Zeta as well as in the technology industry.