Big Data Platform Engineer

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

G-Research is Europe’s leading quantitative finance research firm. We hire the brightest minds in the world to tackle some of the biggest questions in finance. We pair this expertise with machine learning, big data, and some of the most advanced technology available to predict movements in financial markets.

This role is based in G-Research’s new office in Dallas. Opened in 2022, the Dallas office is a key infrastructure hub where we work on the latest cloud technologies in a cutting-edge environment.

The role

Our business focuses on forecasting financial markets and we use an ever-growing amount of data and processing to achieve this.

The Big Data Platform team provides open source analytic and storage platforms that are key to enabling business-critical functions. It is responsible for cutting-edge, petabyte-scale clusters which underpin diverse use-cases such as quantitative research, risk analysis and cyber security. 

It works closely with a variety of different teams – including Quantitative Research, IaaS Engineering, PaaS, and various development and security teams. It is vital to continue those close relationships in order to understand their use-cases and challenges, and help them get the most out of our big data platforms.

At such a scale, automation is key, and there is a significant focus on containerisation, container orchestration, configuration management, orchestration, Infrastructure as Code and CI/CD for this role.

Key responsibilities of the role include:

• Researching and implementing new technologies in line with key business objectives
• Helping shape and engineer the big data platform, ensuring it is scalable, stable, and performant, as well as easy to use and maintain
• Providing metrics, documentation, and self-service infrastructure to help our users work at pace and get the most out of the platform
• Developing automation libraries and tooling
• Implementing and maintaining CI/CD pipelines
• Using advanced troubleshooting skills to diagnose and fix problems

Who are we looking for?

The successful candidate will be an enthusiastic Platform Engineer who is able to build an automated, scalable, reliable and high performing big data platform. They will work well as part of a team, but also be able to propose and run their own projects and improvement initiatives.

The team has a mixed set of skills that complement each other. Typically, team members will have strong abilities in one of infrastructure automation, big data technologies or software development, and be keen to expand their expertise in other areas.

The ideal candidate will have skills and experience in at least one of the following:

• Automation / Operational tooling (exposure to a majority of the following tooling, or the ability to quickly pick-up new tooling):
• Kubernetes
• Ansible
• Jenkins (CI/CD)
• Linux OS core principles, performance and tuning
• Cloud technologies, such as Terraform, AWS, OpenStack
• Prometheus / ELK
• Big data technologies (exposure to a number of the following big data components, including building, tuning, troubleshooting clusters):
• Spark
• Hive / Trino
• HDFS / OZone
• Airflow
• Cloud technologies, such as AWS EMR, Dataproc
• Coding:
• Experience with at least one programming language. Python, Java and Go are advantageous
• It would also be beneficial to have experience within
• Data engineering / data Mmsh
• Microservice Architectures

Why should you apply?

• Market-leading compensation plus annual discretionary bonus
• Informal dress code and excellent work/life balance
• Paid time off, including sick days, military leave, and family and medical leave
• Summer working hours, equivalent of 4 additional days of paid leave
• Generous 401(k) plan
• 12-weeks’ fully paid parental leave
• Medical and Prescription, Dental, and Vision insurance
• Life and Accidental Death & Dismemberment (AD&D) insurance
• Employee Assistance and Wellness programs

G-Research is committed to cultivating and preserving an inclusive work environment. We are an ideas-driven business and we place great value on diversity of experience and opinions.