Senior Software Engineer

Sourced from workvisajobs.co.uk

Join a well-funded AI engineering organization to deploy, extend, and optimize a leading open-source LLM inference engine. The role spans scaling inference and high-assurance regulated environments, involving building new engine features, contributing upstream, and optimizing performance for novel hardware architectures.

• Deploy, instrument, and monitor open-weight models served via the inference engine
• Build new engine features to support novel hardware architectures
• Extend the engine for accuracy, explainability, and accountability in regulated settings
• Contribute upstream to the relevant open-source community
• Optimize inference performance (latency, throughput, hardware utilisation)

• Senior-level Python and low-level programming (C/C++, Rust, CUDA)
• Direct contributions to a major inference/serving engine or similar ML infrastructure project (e.g., PyTorch, Ray)
• Strong grasp of LLM inference internals (KV caching, batching, quantisation)
• Experience upstreaming to active OSS communities
• Hardware accelerator optimization experience (GPU/TPU/etc.)
• Genuine enthusiasm for AI-assisted development (LLMs/agents as core tools)