Big Data Engineer

Key Skills

Java Programming, Oracle, Python Programming, SQL, AWS, SQL Server, Big Data Technology, Apache Hadoop, Scala Programming, Apache Hive, Google Cloud Platform (GCP), Kanban, SPARK Programming, HBase

Job Description

Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

Visit www.infosys.com to see how Infosys (NYSE: INFY) can help your enterprise navigate your next.

Short Description

The Data Engineer Big Data is responsible for designing, developing and supporting batch data pipelines and applications. You will be responsible for developing an expert-level understanding of the core capabilities and building production grade data pipelines, application and components to extend the platform.

Skill

• Expert big data engineering skills including Java, Scala, Python, the Apache Big Data stack and Hortonworks HDF including Hadoop, Hive, Spark, HBase
• Location Sydney, Australia
• Years of EXP 7 plus years

Roles and Responsibilities

• Design and build data pipelines for both analytical and operational data applications
• Build capabilities on the platform that enable data analysts to rapidly consume data pipelines through data applications and exploration capabilities
• Define and update data models and associated technical and business metadata
• Work closely with Product Owners, Architects and delivery teams to build systems that drive towards its strategic platform vision
• Optimise and contribute to existing Platform frameworks, components and templates enabling future development efficiencies
• Knowledge transfer throughout the organization via participation in CoPs, appropriate documentation and internal presentations establishing thought leadership and capability excellence on client’s platform

SkillCompetency Requirements:

Essential

• Experience building batch data pipelines and applications in a production environment
• Experience with functional programming techniques
• Experience in Test Driven Development or Behaviour Driven Development
• Experience in logical and physical data modelling across structured, semi-structured and unstructured data technologies
• Software testing and release cycle experience
• Excellent communications skills and a team player

Preferred

• SQL and relational database skills MS SQL Server, Oracle, etc
• Proficiency with Cloud providers, preferably Azure, alternatively AWS, GCP, etc.
• Ability to express real-world processes in the languages of mathematics and probability
• Agile delivery experience including Scrum, Kanban, SAFe

Additional skills:

• Domain expertise in finance, credit risk, fraud, and or marketing
• Proficiency with data visualization libraries Bokeh, Matplotlib, d3.js
• Machine learning or data science engineering experience.