Senior Data Engineer

Key Skills

Ansible, Apache Hadoop, Apache Hive, AWS, Big Data Technology, Cloud computing, Continuous Integration & Continuous Delivery - CI/CD, DevOps, Google Cloud Platform (GCP), Parquet, Presto, Spark Core, SQL

Job Description

Join our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Our team is delivering Finance, Regulatory & Risk Data and Reports to meet an ever-changing regulatory and business environment. We are almost entirely in the cloud (AWS/GCP) and use various big data tools to provide our internal and external customers accurate and reliable data to support their needs.

At Macquarie, we are working to create lasting value for our communities, our clients and our people. We are a global financial services group operating in 34 markets and with 54 years of unbroken profitability. You’ll be part of a supportive team where everyone - no matter what role - contributes ideas and drive outcomes. 

What role will you play? 

You’ll be working with big data technologies and work in a DevOps environment where you will have end-to-end accountability for designing, developing, deploying and supporting your data assets, as well as creating templates and implementation methods, standards and frameworks. You will also engage with various stakeholders and become an expert in your domain whilst supporting the broader data engineering community.    

What you offer 

• Big Data and Hadoop experience with main focus on Spark, Hive, Presto (or other query engines), big data storage formats (such as Parquet, ORC, Avro), Bamboo/Ansible (or other CICD tools)
• Experience working in a cloud based environment (ideally AWS or GCP)
• Excellent SQL and scripting skills
• Strong knowledge of Spark and experience implementing data pipelines
• Broad knowledge of technical solutions, design patterns, and code for complex applications deployed in distributed computing environment. 

We love hearing from anyone inspired to build a better future with us, if you're excited about the role or working at Macquarie we encourage you to apply. 

Benefits 

• Hybrid and flexible working arrangements
• Wellbeing and service bonus leave
• Up to 20 weeks paid parental leave as well as benefits to support you as you transition to life as a working parent
• Paid volunteer leave and donation matching
• Range of benefits to support your physical, psychological and financial wellbeing 

About the Corporate Operations Group

In our Corporate Operations Group, you will work at the heart of Macquarie. Join a collaborative team who accelerate digitalisation, sustainability and social impact for the benefit of our people, customers, shareholders and communities. Our teams include technology, digital transformation and data, operations, human resources, business services, corporate strategy and solutions and the Macquarie Group Foundation.

Our commitment to Diversity, Equity and Inclusion 

We are committed to providing a working environment that embraces diversity, equity, and inclusion. We encourage people from all backgrounds to apply for a role regardless of their identity, including gender, race, ethnicity, cultural identity, nationality, age, sexual orientation, gender identity, intersex status, marital or family status, neurodiversity, religion or belief, disabilities, or socio-economic background.

If you require adjustments to your working arrangements or the recruitment process, please let us know when applying.