Search
Go
This job is no longer accepting applications
This listing was closed on Jul 18, 2026.
Browse Open JobsSenior Principal Software Engineer - LLM Engineering
Summary by AIEngineer.careers
Senior Principal Software Engineer - LLM Engineering is a MLOps Engineer role (full-time). with Chase. in CHICAGO, US. Imported listing (source: jooble.org). Apply on the employer's site (jooble.org).
Imported listing (source: jooble.org) · Apply on jooble.org
CHICAGO · US
—
Full-time
PRINCIPAL
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from jooble.org
Senior Principal Software Engineer leading LLM and GNN model serving solutions at JPMorganChase. Responsible for MLOps/LLMOps strategy, optimizing inference, and building scalable platforms on AWS. Collaborates with data science and SRE teams to productionize AI models at enterprise scale.
Responsibilities
- Advise and lead strategy for model serving solutions for LLMs and GNNs across cloud and on-premises.
- Define and implement MLOps and LLMOps strategies for end-to-end model lifecycle management.
- Drive optimization of model inferencing using quantization, model parallelism, intelligent batching, and hardware acceleration.
- Create durable, reusable software and platform frameworks to standardize ML Engineering services.
- Establish best practices for automation, CI/CD, and infrastructure-as-code using containerization and orchestration.
- Partner with data science, platform engineering, and SRE teams to productionize models on AWS.
- Lead deployment and optimization using Triton Inference Server and vLLM for high-throughput, low-latency serving.
- Oversee production operations for AI workloads, including monitoring, incident response, security, and compliance.
Requirements
Chase
Columbus · US · 250355+ employees
Chase is a national banking subsidiary of JPMorgan Chase & Co., offering a full suite of financial services to individuals and businesses. They provide retail banking, credit card services, and commercial banking solutions across the United States.
