AI Inference Platform Engineer

Summary by AIEngineer.careers

AI Inference Platform Engineer is a AI Inference Engineer role (full-time). with DRW. in CHICAGO, US. Compensation shown: $200K–$250K. Imported listing (source: jobs-radar.com). Apply on the employer's site (jobs-radar.com).

Imported listing (source: jobs-radar.com) · Apply on jobs-radar.com

How our listings work

CHICAGO · US

$200K–$250K

Full-time

SENIOR

Apply Now

More AI jobs in United States

The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.

Imported job description

Sourced from jobs-radar.com

DRW is seeking an AI Inference Platform Engineer to build, operate, and optimize systems serving LLMs, vision, and embedding models. The role centers on inference runtimes, distributed systems, GPU literacy, and performance profiling. You will work on the infrastructure that powers production model serving at scale.

Responsibilities

Build and operate systems serving LLMs, vision, and embedding models
Optimize inference runtimes for performance and efficiency
Design and maintain distributed systems for model serving
Profile performance and tune GPU workloads

Requirements

Experience with inference runtimes and model serving
Strong background in distributed systems
GPU literacy and performance profiling skills
Proficiency in relevant programming languages

Nice to Have

Experience with LLM serving frameworks
Familiarity with embedding and vision model deployment

Tech Stack

Computer VisionDistributed SystemsEmbedding ModelsGPUInference RuntimesLLM ServingPerformance Profiling

DRW

Chicago · US · 2497+ employees

DRW is a privately held financial-services and principal-trading firm that identifies and captures trading and investment opportunities globally. It trades across many asset classes and instruments, using technology, research, and risk management.