Senior Software Engineer, Data Science Engineering

Key Skills

Apache Solr, Data science techniques, Deep Learning, FastAPI, Google Cloud Platform (GCP), JavaScript, Kubernetes-K8s, Large Language Models - LLMs, Machine learning techniques, Python Programming, PyTorch, Ray.io, REDIS, Spring Boot

Job Description

About the Role

The SaaS Engineering team is responsible for providing a robust platform for our customers. As a Senior Engineer, you will work in our Data Science Chapter to bring our research to large scale production deployments. If you thrive on building scalable, reliable systems and enjoy working in a collaborative environment, we'd love to hear from you.

The Data Science team brings Lucidworks’ differentiating search technologies to our cloud-based SaaS platform and our Fusion product. We work with state-of-the-art embedding models, generative AI models, and search engines to bring the cutting-edge of search capabilities to our customers, using both closed-source and open-source resources. 

We are looking for collaborative engineers who are passionate about their work, the team, and our customers. You will work with a diverse community of personalities spread across multiple time zones, leveraging your communication skills to ensure alignment and progress.

This position reports to the Senior Manager of Data Science. It may include occasional travel to San Francisco HQ (with sufficient notice). Lucidworks is a remote-first company and we invite candidates from anywhere within the Americas to apply.

Responsibilities

• Develop and maintain Python services leveraging FastAPI, Ray, and vLLM.
• Develop and maintain Java services written in Spring Boot (we use Java 21)
• Contribute to scaling a distributed, multi-tenant data platform
• Build and maintain APIs and interfaces for internal and external customers, aiming to improve accessibility and ease of use
• Create services that use deep learning models to provide a cutting-edge search experience
• Optimize our model deployments for latency and throughput
• Participate in software design discussions and contribute ideas and feedback
• Engage with team members in a fast-paced, Agile environment
• Collaborate effectively with international development teams
• Uphold the core values, policies, and procedures of Lucidworks

Our Stack

• Java 21
• Python 3.10+
• PyTorch
• Ray Serve
• vLLM
• Solr
• Vespa
• Spring Boot
• Redis
• Google Cloud Platform (CloudSQL, PubSub)
• Kubernetes (GKE)

Skills & Qualifications

• Bachelor’s degree or equivalent work experience preferred
• 8+ years of professional experience in software development, with exposure to increasingly complex environments
• 6+ years of experience in Java development (and/or) 6+ years of experience in Python development
• Willingness to participate in a 24x7 on-call rotation to help support the services you develop; we take an end-to-end ownership approach to what we build!
• Working with deploying ML models into production environments
• Debugging ML deployments with a focus on both correctness and speed
• Experience with public cloud-based environments (GCP is a plus)
• Familiarity with developing microservices and event-driven architectures, particularly in a Kubernetes-based environment
• Quality-oriented; we write our own tests
• Results-oriented; you take pride in delivering high-quality work
• Successful completion of a background check

Competencies

• Resourceful-willing to jump in, be agile/flexible, leverage existing resources to accomplish goals, ability to work independently
• Team player-confident in collaborating with a diverse community of people and personalities across geographies, backgrounds, and professional abilities
• Strong verbal and written communication skills
• Empathy and care for all stakeholders of Lucidwork including employees, customers, partners, and guests
• Ability to handle confidential information

J$9,360,000 - J$12,870,000 a year

This salary range may include multiple levels. Your level is based on our assessment of your interview performance and experience, which you can always ask the hiring manager about to understand in more detail. Salary is just one component of Lucidworks’ total compensation package for employees. Your total rewards package may include (but is not necessarily limited to) discretionary variable bonus, top-notch medical, dental and vision coverage, equity, a variety of voluntary benefits, generous PTO policy, various leave policies, and many other region-specific benefits.