Senior Lead Software Engineer - ML

Key Skills

Aartificial intelligence, AWS, Azure, Framework, Generative AI, Google Cloud Platform (GCP), High performance computing- HPC, JAX framework, Large Language Models - LLMs, Machine learning techniques, PyTorch, Scikit-learn, TensorFlow

Job Description

Bring your engineering AI/ML skills to the next level where you will achieve state-of-the-art throughput for critical models using advanced techniques like model parallelism and distributed training. You will reduce inference time for new model architectures using optimizations like quantization and pruning. You will collaborate closely with Applied AI engineering to optimize the internal inference stack, leveraging technologies like TensorRT, ONNX, etc. In this role you will assist with interviewing top tier talent as well as acting as a mentor to AI systems Engineers, while fostering a culture of continuous learning and innovation. You will coordinate the inference needs of JPMorgan Chase’s research teams, ensuring alignment with business goals.

As a Senior Lead Software - Machine Learning Engineer at JPMorgan Chase within the Corporate Sector, specifically the AIML Technology division, you will play a crucial role in an agile team. Your responsibilities will include enhancing, developing, and delivering a company-wide AI/ML/Data Platform in a secure, stable, and scalable manner. As a technical contributor, your duties will encompass the architecture, design, and construction of AI/ML related capabilities using cloud technology. You will have the opportunity to work with both traditional AI/ML and Generative AI.

Job responsibilities

• Architects and implements distributed ML infrastructure, including inference, training, scheduling, orchestration, and storage.
• Develops advanced monitoring and management tools for high reliability and scalability.
• Optimizes system performance by identifying and resolving inefficiencies and bottlenecks.
• Collaborates with product teams to deliver tailored, technology-driven solutions.
• Drives the adoption and execution of ML Platform tools across various teams.
• Integrates Generative AI within the ML Platform using state-of-the-art techniques.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience. In addition, 2 + years of experience leading technologists to manage and solve complex technical items within your domain of expertise
• Extensive hands-on experience with ML frameworks (TensorFlow, PyTorch, JAX, scikit-learn).
• Extensive experience with a Public Cloud provider (AWS, Azure, GCP) and addressing non-functional requirements such as scalability and cross-region resiliency.
• Strong coding skills and experience in developing large-scale ML systems and ensuring Software Best Practices.
• Experience with prompt engineering and interacting with various LLM vendors and models.
• Proven track record in contributing to and optimizing open-source ML frameworks.
• Strategic thinker with the ability to craft and drive a technical vision for maximum business impact.
• Demonstrated leadership in working effectively with engineers, data scientists, and ML practitioners.
• Proven ability to identify trade-offs, clarify project ambiguities, and drive decision-making.

Preferred qualifications, capabilities, and skills

• Expertise in Kubernetes ecosystem, including EKS, Helm, and custom operators.
• Background in High Performance Computing, ML Hardware Acceleration (e.g., GPU, TPU, RDMA), or ML for Systems.

About Us

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

About the Team

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.