Search
Go
This job is no longer accepting applications
This listing was closed on Sep 18, 2026.
Browse Open JobsSoftware Engineer, Gen AI Platform
Summary by AIEngineer.careers
Software Engineer, Gen AI Platform is a AI Infrastructure Engineer role (full-time). with LLM APIs. in REMOTE, WORLDWIDE. Imported listing (source: worksynergy.10001mb.com). Apply on the employer's site (worksynergy.10001mb.com).
Imported listing (source: worksynergy.10001mb.com) · Apply on worksynergy.10001mb.com
REMOTE · WORLDWIDE
—
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from worksynergy.10001mb.com
Abridge is building an AI-powered platform that transforms medical conversations into structured clinical notes. This role focuses on designing and building the runtime, orchestration, and evaluation platform for agentic LLM-driven workflows. You will collaborate with researchers and product engineers to turn LLMs into dependable tools for healthcare.
Responsibilities
- Design and build GenAI systems leveraging retrieval, tool use, agentic reasoning, and structured outputs.
- Implement a highly reliable and scalable agent runtime with orchestration, shared state, memory, and tool-calling interfaces.
- Build secure, sandboxed execution for agent actions and code, optimizing cold start, isolation, and observability.
- Create unified interfaces for multiple model sizes and providers, and integrate with open tool ecosystems such as MCP-style connectors.
- Develop an evaluation platform for online/offline assessments, A/B tests, safety checks, and regression gates.
Requirements
- Experience building agent applications with tool-calling, context engineering, or open connector integrations.
- Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines).
LLM APIs
San Francisco · US · 308+ employees
"LLM APIs" refers to AI infrastructure platforms that provide unified or specialized access to Large Language Models. Notable companies providing these services include Together AI and specialized gateways like InferAll or Novita AI.
