Summary by AIEngineer.careers
Senior Software Engineer, Agentic Platform is a AI Agent Engineer role (full-time). with ServiceNow, Inc. in MOUNTAIN VIEW, CA, CA. Imported listing (source: mindpal.co). Apply on the employer's site (mindpal.co).
Imported listing (source: mindpal.co) · Apply on mindpal.co
How our listings work
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from mindpal.co
ServiceNow is hiring a Senior Software Engineer to build and own the runtime infrastructure for enterprise LLM-based agents at scale. You will design an agent orchestration engine, distributed session management, and event-driven pipelines that keep multi-step agent workflows correct, observable, and low latency. The role blends LLM/ML expertise with distributed-systems engineering to make agents reliable in production.
Responsibilities
- Develop an agent orchestration engine using a state machine for long-running agent sessions
- Implement model routing and adaptation, including selecting and fine-tuning/distilling LLMs under enterprise constraints
- Build distributed session management with lease-based ownership, heartbeat protocols, and crash recovery via checkpointing
- Create an event-driven message pipeline for ordered delivery and real-time streaming
- Use structured concurrency for concurrent tasks per session with fail-fast semantics and graceful cancellation
- Deliver observability infrastructure with OpenTelemetry instrumentation and distributed tracing
- Implement caching and state layers using Redis and DynamoDB with scoped data and hot-reload configuration
- Enable tool and agent connectivity for LLMs, including MCP and agent-to-agent (A2A) with discovery and tool selection
- Optimize token efficiency and context engineering to reduce cost and latency
- Stand up and evaluate open-weights models, including quantization levels, and benchmark accuracy, latency, and cost
Requirements
- 5+ years building production backend or infrastructure systems
- Strong in Python or Go (ideally both)
- Experience designing and operating systems handling real traffic at scale
- Hands-on experience building production systems using LLMs or other ML models
- Deep experience in at least 3 of: distributed systems, concurrent/async programming, event-driven architectures, database systems for infrastructure, observability, gRPC/protobuf, machine learning
- Comfort with ambiguity
Nice to Have
- Experience shipping LLM products and techniques such as RAG and agentic reasoning
- Familiarity with message queues such as SQS, Kafka, or pubsub
- Experience with streaming RPC and Socket.IO
- Knowledge of checkpointing, heartbeats, and conditional writes
Tech Stack
agentic reasoningasyncioDistributed SystemsDynamoDBGogRPCKafkaLLMMCPOpenTelemetryPrometheusProtobufPythonQuantizationRAGRedisSQSTool Calling