Lead Data Engineer

Key Skills

Agile methodologies, Amazon RedShift, Apache Airflow, AWS, Data Analytics, Data Lake, Data pipelines, Dataiku, Effective communication skills, Leadership, Machine learning techniques, Presto, Python Programming, Spark Core

Job Description

As a Lead Data Engineer in the Data and Analytics team, you will be working with traders, quants and desk analysts to provide data and analytics solutions across our commodities and global markets business lines.

You’ll be developing capabilities such as our public-cloud based datalake, data pipelines for fundamental and alternative market data, and a of range data analytics solutions, such as the data catalog, data science workbench, visualisation tools and real-time analytics. You’ll bring interest and experience in maturing our development practises across our agile-based team, looking to help us on our journey to continually improve the robustness of our solutions and the speed with which we can respond to our business’s needs.

At a technical level you’ll be working largely with python and AWS, and opensource technologies such as Presto, Spark, Airflow and HUDI. In the role you’ll gain exposure to cloud data warehouses such as Redshift and vendor platforms such as Dataiku, Alation and KDB: both on the platform engineering and the data analytics / machine learning sides.

This is a rapidly evolving area where your learning mindset, can-do attitude, and effective communication with a diverse set of stakeholders will see you succeed. If you can code, love data and want to work on innovative projects, then apply now!

About the Corporate Operations Group

The Corporate Operations Group brings together specialist support services in Digital Transformation & Data, Technology, Operations, Human Resources, Business Services, Corporate Strategy & Solutions, and the Macquarie Group Foundation. We deliver service excellence to ensure Macquarie is open for business, deliver on transformational change, invest in our people and have deep relationships with our customers. 

Our commitment to Diversity, Equity and Inclusion 

The diversity of our people is one of our greatest strengths. An inclusive and equitable workplace enables us to embrace that diversity to deliver more innovative and sustainable solutions for our people, clients, shareholders and communities. At Macquarie, you'll be encouraged to be yourself and supported to perform at your best. If you're inspired to deliver on our purpose of ‘empowering people to innovate and invest for a better future’, we want you on our team. If you need adjustments made to the recruitment process, please reach out to your recruiter.

As an inclusive employer, Macquarie does not discriminate on the grounds of age, disability, sex, sexual orientation, gender identity or expression, marriage, civil partnership, pregnancy, maternity, race (including colour and ethnic or national origins), religion or belief.

Joining Macquarie means you’ll be able to work in a way that suits you best. With the right technology, support and resources, our people can work in a range of flexible ways. Talk to us about what working arrangements would help you thrive.