Senior Machine Learning Engineer, LLM Inference Optimization
Nebius
LLM Inference Systems Engineer is a AI Inference Engineer role (full-time). with Hippocratic AI. in MENLO PARK, CA (ONSITE), US. Imported listing (source: mikeishiring.com). Apply on the employer's site (mikeishiring.com).
Imported listing (source: mikeishiring.com) · Apply on mikeishiring.com
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Sourced from mikeishiring.com
Hippocratic AI is hiring an LLM Inference Systems Engineer to build the distributed serving and high-performance networking layer behind its healthcare-focused large language models. You will own the path from model server to GPU fabric, including prefill/decode disaggregation, KV-cache transfer, multi-node execution, and production observability and benchmarking. The role sits in the Inference team within the Model team and partners closely with Model, Infrastructure, and Application engineering. This is an on-site role in Menlo Park, CA, five days a week.

Palo Alto · US · 150+ employees
Hippocratic AI is a healthcare technology company building a safety-focused large language model (LLM) designed specifically for healthcare applications. Its AI agents are designed to assist health systems, payors, and pharmaceutical organizations with non-diagnostic clinical tasks.
Get a weekly email when new AI engineering jobs match your filters. Free — confirm your address to start.
Nebius
NVIDIA
Apple
Paramount Global
Capgemini
Apple