Skip to main content

Senior Software Engineer, Agentic Platform

Summary by AIEngineer.careers

Senior Software Engineer, Agentic Platform is a AI Agent Engineer role (full-time). with ServiceNow, Inc. in MOUNTAIN VIEW, CA, CA. Imported listing (source: mindpal.co). Apply on the employer's site (mindpal.co).

Imported listing (source: mindpal.co) · Apply on mindpal.co

How our listings work

MOUNTAIN VIEW, CA · CA
—
Full-time
SENIOR
Apply Now

More AI jobs in Canada

The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.

Imported job description

Sourced from mindpal.co

ServiceNow is hiring a Senior Software Engineer to build and own the runtime infrastructure for enterprise LLM-based agents at scale. You will design an agent orchestration engine, distributed session management, and event-driven pipelines that keep multi-step agent workflows correct, observable, and low latency. The role blends LLM/ML expertise with distributed-systems engineering to make agents reliable in production.

Responsibilities

  • Develop an agent orchestration engine using a state machine for long-running agent sessions
  • Implement model routing and adaptation, including selecting and fine-tuning/distilling LLMs under enterprise constraints
  • Build distributed session management with lease-based ownership, heartbeat protocols, and crash recovery via checkpointing
  • Create an event-driven message pipeline for ordered delivery and real-time streaming
  • Use structured concurrency for concurrent tasks per session with fail-fast semantics and graceful cancellation
  • Deliver observability infrastructure with OpenTelemetry instrumentation and distributed tracing
  • Implement caching and state layers using Redis and DynamoDB with scoped data and hot-reload configuration
  • Enable tool and agent connectivity for LLMs, including MCP and agent-to-agent (A2A) with discovery and tool selection
  • Optimize token efficiency and context engineering to reduce cost and latency
  • Stand up and evaluate open-weights models, including quantization levels, and benchmark accuracy, latency, and cost

Requirements

  • 5+ years building production backend or infrastructure systems
  • Strong in Python or Go (ideally both)
  • Experience designing and operating systems handling real traffic at scale
  • Hands-on experience building production systems using LLMs or other ML models
  • Deep experience in at least 3 of: distributed systems, concurrent/async programming, event-driven architectures, database systems for infrastructure, observability, gRPC/protobuf, machine learning
  • Comfort with ambiguity

Nice to Have

  • Experience shipping LLM products and techniques such as RAG and agentic reasoning
  • Familiarity with message queues such as SQS, Kafka, or pubsub
  • Experience with streaming RPC and Socket.IO
  • Knowledge of checkpointing, heartbeats, and conditional writes

Tech Stack

agentic reasoningasyncioDistributed SystemsDynamoDBGogRPCKafkaLLMMCPOpenTelemetryPrometheusProtobufPythonQuantizationRAGRedisSQSTool Calling
ServiceNow, Inc.

ServiceNow, Inc.

Santa Clara · US · 35163+ employees

ServiceNow is an AI-powered enterprise software company that provides a cloud-based platform designed to digitize and unify business workflows. The platform helps organizations automate tasks, improve operational efficiency, and connect various departments and systems.

Weekly job alert

Get a weekly email when new AI engineering jobs match your filters. Free — confirm your address to start.

Related Jobs