Senior Software Engineer - ML Infrastructure

Key Skills

Aartificial intelligence, Amazon Elastic Compute Cloud-EC2, Amazon Simple Storage Service (S3), Lambda, Large Language Models - LLMs, Machine learning techniques

Job Description

At DeepScribe, we are bringing the joy of care back to medicine by helping AI and healthcare professionals work in harmony. Today, we are leveraging ambient AI to automate documentation — allowing clinicians to focus on providing care, not documenting it. Trained using one of the world’s largest databases of patient conversations, DeepScribe empowers providers by transforming patient conversations into fully customizable, detailed clinical notes.

About the Role

We are seeking a Senior Software Engineer for the ML Infrastructure team. The ML Infra team is responsible for building the core platforms & infrastructure that power DeepScribe’s AI stack.

Your Responsibilities

• Develop and optimize infrastructure for audio processing, transcription, and LLM orchestration, ensuring scalability, reliability, and performance.
• Build and maintain core inference infrastructure, including model serving pipelines for transcription and document generation.
• Collaborate with product and AI engineering teams to integrate ML models into scalable, production-grade systems.
• Design and manage infrastructure as code (IaC) using tools like Terraform to automate and standardize deployment and infrastructure management.
• Leverage AWS services (e.g., EC2, Lambda, S3, EFS) to support high-availability, low-latency ML pipelines and processing systems.
• Implement and maintain monitoring, alerting, and logging for production infrastructure, ensuring system reliability and quick issue resolution.
• Ensure security best practices are enforced across ML infrastructure, with a focus on data protection, role-based access, and compliance with HIPAA & SOC-2.

About You

• You have 5+ years experience in building and scaling performant software infrastructure
• You have a track record of deploying ML models and and have familiarity of the full lifecycle of model development
• You’re an effective team player and communicator, and are able to work across functions to find effective solutions

Perks and benefits

• $150,000 to $220,000 annual salary

• Meaningful equity stake in the company

• Flexible PTO

• Work from home stipend

• Medical, Dental, Vision, 401K and other benefits are also offered

About the Team

• At DeepScribe, we value trust, teamwork, and transparency, and we’re dedicated to promoting diversity and equity in the workforce through inclusive hiring practices. Candidates with backgrounds that are underrepresented in the technology industry are encouraged to apply.

• In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required eligibility verification form upon hire.