Big Data Operations

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

 In this role you will provide technical support and operations of enterprise big data environments. Working as part of a team of operations engineers you’ll use your skills in big data, networking, storage, Linux, containers and virtualisation, ITIL and automation to support some of Australia’s largest big data platforms. You’ll work with a variety of technologies - we don’t expect everyone to know every technology from day 1 and will support your appetite to learn and grow.

 You’ll perform L1 - L3 support, help identify and drive operational excellence and service improvements, improve security, reliability, performance efficiency, and cost optimization with fellow team members and across Servian more broadly. You'll work closely with a range of experienced, and talented technicians from across Servian, and continue to develop our own set of Company standards, patterns and frameworks for secure, high-performing, resilient, and efficient data platforms, pipelines and solutions.

Required Skills

• 4-8 years of experience in tech operations in an enterprise environment.
• ITIL experience working on operations/support engagements.
• Experience with Hadoop Administration
• Good hands-on foundations with networking, storage and Linux
• Experience with Kubernetes, Docker and Apache Spark
• Experience scripting in either Shell or Python.
• Ability to determine the root cause of issues and provide suggestions on how to avoid them in the future.
• Optimisation experience for system availability, security, and performance of systems.
• Proficiency in at least one major configuration management tool, e.g. Ansible, AWX, Jenkins, Bamboo
• Strong communication skills - written and verbal

Desired Skills

• Experience managing data pipelines / ETL using Kafka / Hadoop / Spark/ Nifi / K8s
• Experience in infrastructure-as-code (e.g. Terraform)
• Experience in or willingness to learn Cloud (AWS, Azure or GCP) administration
• Calm and systematic demeanour in Severity-1 situations
• Experience maintaining high availability (99.9% plus) systems
• Certifications in one or more of ITIL, RHEL etc

What to expect if you join Servian?

• Learning & Development: We invest heavily in our consultants and offer internal training weekly (both technical and non-technical alike!) and abide by a ‘You Pass We Pay” policy.
• Career progression: We take a longer term view of every hire. We have a flat org structure and promote from within. Every hire is developed as a future leader and client advisor.
• Variety of projects: As a consultant, you will have the opportunity to work across multiple projects across our client base significantly increasing your skills and exposure in the industry.
• Great culture: Working on your own MacBook in our custom designed offices in the heart of leafy Jayanagar, we provide a peaceful and productive work environment close to shops, parks and metro stations.
• Professional development: We invest heavily in professional development both technically, through training and guided certification pathways, and in consulting, through workshops in client engagement and communication. Growth in our organisation happens from the growth of our people.