Senior Staff ML Engineer

Key Skills

Aartificial intelligence, AWS, Azure, Continuous Integration & Continuous Delivery - CI/CD, Docker, Effective communication skills, Google Cloud Platform (GCP), JavaScript, Large Language Models - LLMs, Machine learning techniques, MLOps tools, Natural Language Processing (NLP), SQL, TypeScript

Job Description

At ASAPP, our mission is simple: deliver the best AI-powered customer experience—faster than anyone else. To achieve that, we’re guided by principles that shape how we think, build, and execute. We value customer obsession, purposeful speed, ownership, and a relentless focus on outcomes. We work in tight, skilled teams, prioritize clarity over complexity, and continuously evolve through curiosity, data, and craftsmanship.

We’re seeking technologists and problem solvers who thrive in fast-paced environments, love collaborating with great talent, and approach every day like it’s Day 1. We're a globally diverse team with hubs in New York City, Mountain View, Latin America, and India—embracing both hybrid and remote work to bring the best minds together, wherever they are. If you're driven by continuous learning, rapid pivots, and the challenges of building in a high-growth startup, we’d love to talk. This is more than a job—it’s a journey.

We're actively looking for a highly experienced Senior Staff AI Engineer to join our team. You will play a pivotal role in designing, building, and deploying cutting-edge AI systems that power mission-critical enterprise applications. This role is ideal for an individual who thrives in ambiguity, is deeply technical, and has a strong product sense paired with deep expertise in foundational models and enterprise AI systems.

We're looking for someone with a passion for solving hard, real-world problems using modern machine learning techniques, especially large language models, RAG systems, and prompt engineering. You will lead end-to-end AI initiatives, from quick prototyping through to robust production deployments, while collaborating across engineering, research, and product teams.

What you'll do

• Drive the design and implementation of scalable ML/AI systems with a focus on large language models, vector databases, and retrieval-based architectures
• Leverage foundation models from major providers (OpenAI, AWS Bedrock, Anthropic, etc.) for both prototyping and production use
• Fine-tune, adapt, and evaluate LLMs for domain-specific enterprise applications
• Develop robust infrastructure for experimentation, training, deployment, and monitoring of AI models in production environments
• Optimize model performance and inference workflows for latency, cost, and accuracy
• Provide hands-on leadership and mentorship to other engineers, helping them grow technically and operationally
• Translate research ideas and early-stage prototypes into enterprise-grade ML systems
• Actively stay abreast of advancements in AI, open-source models, and MLOps best practices
• Establish and improve internal processes for experimentation, evaluation, and deployment of ML models
• Collaborate with cross-functional stakeholders to define AI roadmap and influence product direction

Required Qualifications

• 8+ years of professional experience in Machine Learning, with 3+ years focused on LLMs or NLP at scale
• Proficiency on Python and ML frameworks like PyTorch or TensorFlow
• Proven experience working with foundational models (OpenAI, Bedrock, Anthropic, HuggingFace)
• Hands-on experience with fine-tuning LLMs
• Strong understanding of RAG pipelines, prompt engineering, and vector search
• Experience building AI systems using vector databases
• Deep experience with Python and cloud services. AWS is required; experience with GCP, Azure, or Snowflake is a plus
• Experience deploying and scaling AI systems using Docker, Kubernetes, and CI/CD practices
• Demonstrated ability to move fast: prototype, test, and iterate quickly
• Strong written and verbal communication skills; ability to communicate complex technical ideas to both technical and non-technical audiences
• Comfortable with ambiguity and proactive in identifying and solving high-impact problems
• Highly organized, with the ability to manage multiple priorities and projects in parallel

Nice to Have

• Prior experience in MLOps, experimentation platforms, or model evaluation pipelines
• Contributions to open-source AI/ML tools
• Knowledge of additional languages such as SQL, Go, JavaScript, or TypeScript
• Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related field

$200,000 - $220,000 a year

ASAPP is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, or veteran status. If you have a disability and need assistance with our employment application process, please email us at careers@asapp.com to obtain assistance.