AI Engineer

Key Skills

Aartificial intelligence, Deep Learning, Large Language Models - LLMs, Machine learning techniques, Python Programming, PyTorch, TensorFlow

Job Description

We envision a transparent, effortless, and confident mortgage securing experience for everyone. By employing cutting-edge technology and comprehensive insights, we empower consumers on popular comparison platforms and equip lenders with superior technology, driving unparalleled service quality in home financing.

 Our Core Values

Knowing who we are and understanding our mission, our core values at Koodoo define our approach to excellence:

• We are empowered: If it’s to be, it’s up to me.
• We deliver: We are committed to what we do, determined to succeed, and we obsessively prioritise to achieve our goals.
• We empathise: We listen, we support, we care - for each other, our partners, and customers.
• We are focused: We are committed to what we do, determined to succeed, and we obsessively prioritise to achieve our goals.
• We are passionate: We are proud of our work, our product, and our team, and relentless in solving the problems in our industry.

 The role

We’re inviting an AI Engineer to lead the quality workstream across all of our AI-based products, which are currently being piloted across major UK lenders and brokers. This new position will offer a self-starter with a mix of technical and business experience to build out a new set of procedures and frameworks for evaluating and maintaining quality in AI-based applications.

 Key Responsibilities:

Evaluating and benchmarking LLMs used in our applications:

• Facilitating the building out of human in the loop feedback that scales with volume and complexity.
• Owning and building out canonical data sets.
• Testing the best performing AI architectures.

Monitoring, alerting and debugging our AI architectures, including but not limited to:

• Using human in the loop feedback to identify problematic areas.
• Developing and monitoring automatic regression testing.
• Setting up alerting to changes in LLM efficacy due to prompt drift.

Own our prompt management systems and data:

• Support implementation teams with best practices and iteration for prompt engineering for business use cases.
• Explore and implement state-of-the-art algorithms to keep our product on the cutting edge of Generative AI technology.
• Stay up-to-date with the latest advancements in Generative AI, conduct research, and explore innovative techniques to improve model quality and efficiency.
• Influence key decisions on architecture and implementation of scalable, reliable, and cost-effective engineering solutions.

 Skills and Experience:

Required

• Research or engineering experience in deep learning with one or more of the following: generative models, segmentation, object detection, classification, model optimisations.
• Demonstrated expertise in training and optimising generative models.
• Proven track record of implementing systems and frameworks to monitor quality outputs from non-deterministic systems using data-driven approaches.
• Keen interest and experience in more recent Generative AI developments and best practices.
• Ability to straddle business and technical contexts seamlessly, working collaboratively with stakeholders on both sides.
• Hands-on approach and attitude to getting things done in a fast paced and dynamic environment.
• Ability to make translate academic papers, models, algorithms, and research findings into resources that are easily consumed and shared with the wider team.
• Proficient in Python, demonstrating the ability to architect, implement, and optimise code.

Preferred

• Experience in UK Financial Services technology.
• Advanced degree in machine learning, computer vision, or related field.
• Experience with image-to-text generative models and features.
• Experience developing and optimizing ML inference on the backend.
• Experience working with machine learning frameworks such as PyTorch, TensorFlow.
• Experience implementing RAG frameworks as part of production-ready products.

What we can offer you

• Range of benefits to choose from including Private Medical Insurance, Gym Membership, Dental Plan and more.
• Enrollment into a new Advanced GenAI Practitioners qualification upon joining, delivered by an independent learning provider (all Koodoo staff go through this in onboarding).
• Opportunity to collaborate closely with our colleagues in person in our office in India.
• A significant role in a high-growth phase, influencing the company's trajectory.
• Unlimited growth potential, matching your professional development ambitions.
• An inclusive culture surrounded by a passionate, forward-thinking team.