Staff Software Engineer

Key Skills

Docker, Elasticsearch, Kubernetes-K8s, PyTorch, Risk Analytics, SQL, Tableau

Job Description

As a Staff Software Engineer in Search, you will play a critical role in designing, implementing, and optimizing search capabilities for our enterprise-level document processing platform. You will be responsible for measuring search performance, deploying an efficient enterprise search solution for various document types, and leveraging LLMs to enhance document enrichment techniques. Your expertise in ElasticSearch ranking techniques and index optimizations will be instrumental in ensuring the search platform's high performance and relevance. Additionally, you will collaborate closely with the LLM team to integrate search techniques and improve document generations.

Responsibilities:

• Measure, analyze, and optimize search performance using various metrics and techniques to ensure high accuracy and relevance.
• Deploy and configure enterprise search solutions for traditional document types such as docx, pdf, etc., while ensuring efficient indexing and retrieval.
• Explore and implement advanced Document Enrichment techniques, leveraging LLMs to enhance the search experience.
• Develop and maintain ElasticSearch ranking techniques and index optimizations to improve search result rankings and reduce latency.
• Collaborate with the LLM team to leverage search techniques and RAG techniques to enhance document generations.
• Contribute significantly to the development of a large-scale codebase, leading the search-related components and ensuring code quality and maintainability.
• Apply your production experience with ElasticSearch, preferably leveraging Kubernetes, to ensure the scalability and reliability of the search infrastructure.
• Stay up-to-date with the latest advancements in search technologies, vector search, and LLMs, and proactively apply them to improve our search solutions.
• Mentor and guide junior engineers, fostering a culture of technical excellence and continuous learning within the search team.

Please note We strongly encourage you to apply even if you don't meet all of the requirements for this role if you believe your skills and attributes may still make you a strong fit for the position.

Required Skills and Qualifications:

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field or equivalent experience
• A minimum of 8 years of relevant experience in software engineering, with a focus on search technologies and information retrieval.
• Expertise in measuring search performance using various metrics and methods to ensure optimal results.
• Proven experience in deploying enterprise search solutions for traditional document types like docx, pdf, etc.
• Strong familiarity with Document Enrichment techniques, preferably with experience in leveraging LLMs for improved enrichment.
• In-depth knowledge of ElasticSearch ranking techniques, index optimizations, and search query optimization.
• Excitement and enthusiasm for exploring and leveraging search techniques to enhance document generations by LLMs.
• Proficiency in software development with the ability to contribute effectively to a large codebase.
• Production experience with ElasticSearch, preferably leveraging Kubernetes for scalability and manageability.
• Good to have experience with vector search and LLMs, with a keen interest in exploring their applications.