Backend Software Engineer – cloud AI services

Key Skills

Aartificial intelligence, AWS, Azure, Deep Learning, Docker, Google Cloud Platform (GCP), Kubernetes-K8s, Large Language Models - LLMs, Leadership Skill, Machine learning techniques

Job Description

You are excited about launching new products and features into production, who can work autonomously and aren’t afraid to try new technologies, and who don’t back down from the challenges of scale. Our ideal candidate has experience building core services and web-based APIs from the ground up, cares just as much about the product itself as the technology that powers it, and is capable of both structuring and writing clean, maintainable code. You will have a chance to work with a team of talented AI researchers and engineers to optimize and deploy the state-of-the-art Large Language Models to our flagship Generative AI products. Our ideal candidate is a dependable backend engineer who also has at least some experience working with and around machine learning systems.

This position offers a unique chance to work on state-of-the-art language models and contribute to transformative research with the vision of saving lives with Industrial Data. You will be part of a dynamic team of researchers and engineers who are passionate about pushing the boundaries of machine learning and natural language understanding in the Industrial domain. Join us and make a significant impact on the future of Industrial DataOps.

What You'll Do

• You will help build applications that interact with state-of-the-art Large Language Models (LLMs) that deliver cutting-edge and time-saving solutions to Industrial Clients all over the world.
• Orchestrate LLM-driven experiences that delight our customers
• Design and implement highly scalable backend services powering Cognite’s Gen AI products
• Deploy LLMs to production in a cost efficient way and own their life cycles
• Own and improve the reliability and latency of AI services in cloud environments
• Work closely with Product Management & TPMs to translate product requirements into software architectures
• Provide technical leadership to implement best practices for software development

Who You Are

• A BS/MS degree in a relevant technical discipline such as Computer Science, and Computer Engineering
• Experienced software engineer who can design large scale software systems, write high quality code and tests
• 3+ years of experience in building and deploying scalable cloud based backend services and APIs.
• Familiar with Kubernetes, Docker, and AWS, Azure or GCP
• Proficient in Kotlin/Java and Python, and familiar with one or more of the following: Golang, Terraform, GraphQL, Javascript
• Experience in optimizing and deploying large scale deep learning models (e.g. LLMs) in production
• Experience using large language models through code (such as model services from OpenAI, Anthropic, or Cohere; and/or open source models such as Llama).
• Experience with any stages in the ML development lifecycle (e.g. data labeling, data curation, data cleaning, model training, model evaluation, model serving, LLM prompting, etc)
• An excellent communicator with strong organizational, problem-solving, debugging and analytical skills
• Demonstrated technical leadership in a cross-functional distributed team environment