Principal Data Engineer

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

Network Analytics in the Digital Networks group plays the leading role in productionizing and maintaining advanced analytics models making use of our existing large-scale data assets. The technology is powered by a Big Data Ecosystem which includes a big data platform, analytics and visualization tools used for Artificial Intelligence/Machine Learning/Data Mining, the data integration/ETL frameworks.

This role is lead data engineer and data strategist for Optus Networks Big data platform and Data As Service (DaaS) capability, and as well as the key partner to other business units who consumes networks data for customer 360, Customer experience, and internal networks data driven use cases from network engineering to operations and optimization. Data engineering scope for Networks data is complex, impacting multiple business units (Networks, Marketing & Revenue, Digital and IT) thus requiring strong enterprise leadership.

About the Role

As a Principal Data Engineer, you are one of the most critical members of the team. You are coaching, developing, inspiring and working with your peers and leading the new starters in the chapter to take on the challenge of ingesting, transforming and presenting data from different sources in real-time. You are always in demand and praised by various teams such as Data Science, Data Analytics, Product, Marketing, Sales, Etc.

The role is responsible for leading:

• Architecture, Design and implement Networks data pipelines to event driven real-time streaming; and run advanced analytics/Insights to enable Networks Data As A Service (DaaS) capability
• Maintain strong, trusted advisor relationships with all stakeholders to foster a collaborative and innovative culture moving from a traditionally transactional engagement model
• Align the technology ecosystem, data environments, analytical methodologies & analytical assets to Optus strategic roadmap
• Interface with product vendors to keep abreast of new technologies, pricing and customer applicability. Participate in vendor evaluations
• Possess a thought leader/strategic thinking view on how Big data and analytics can bring innovative living networks products into life.

About You

We are looking for the following skills, experience and qualifications

• Bachelor or Master or Doctorate degree in maths, statistics, computer science, information management /Electrical Engineering/STEM.
• 10 -15 years’ experience working in Data Engineering, Bigdata platform management, and latest cloud technologies
• 4-5 years hands on experience on advanced analytics using real time data streams
• Hands on in BigData tools like Spark (python/scala), Hive, Impala, Hue and storage (e.g. HDFS, HBase); and Confluent Kafka streaming framework.
• Experience in building Microservices, Rest APIs, Data as a Service architectures.
• Enterprise Architecture frameworks Tm forum eTom or TOGAF certifications