Skip to main content

Software Engineer, Agent Harness & Evaluation: Python, TypeScript, LLM Agents & Evals | San Jose, CA (On-site) | Up to $350K + Equity

Summary by AIEngineer.careers

Software Engineer, Agent Harness & Evaluation: Python, TypeScript, LLM Agents & Evals | San Jose, CA (On-site) | Up to $350K + Equity is a AI Agent Engineer role (full-time). with Big Wave Digital. in SAN FRANCISCO, US. Compensation shown: $250K–$350K. Imported listing (source: bigwavedigital.com). Apply on the employer's site (bigwavedigital.com).

Imported listing (source: bigwavedigital.com) · Apply on bigwavedigital.com

How our listings work

SAN FRANCISCO · US
$250K–$350K
Full-time
STAFF
Apply Now

More AI jobs in United States

The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.

Imported job description

Sourced from bigwavedigital.com

Build and improve production AI agents that solve hardware engineering problems like chip design, debug, and verification. You will find agent failure modes, design rigorous evaluations, and build new agent capabilities across tool interfaces, memory, and multi-step orchestration. The role blends applied research, customer-facing problem solving, and production software engineering in Python and TypeScript.

Responsibilities

  • Identify agent failure modes and build evaluations measuring performance, reliability, and efficiency
  • Build new agent capabilities including tool interfaces, context management, memory, and multi-agent orchestration
  • Analyze traces and experiment results to distinguish real improvements from benchmark noise
  • Work directly with hardware engineers and domain experts to translate problems into agent fixes
  • Turn research experiments into maintainable, tested, production-grade software

Requirements

  • 8-15 years as a software engineer with serious experience on large-scale agent systems (staff-plus bar)
  • Deep depth in LLM agents, orchestration, tool interfaces, memory, tracing, ML inference, and transformer architectures
  • Production software engineering in both Python and TypeScript
  • Strong customer-facing ability to understand needs and deliver technical solutions independently
  • CS, EE, or similar degree from a top university
  • US citizens and Green Card holders only; no sponsorship

Nice to Have

  • Experience or interest in EDA, semiconductor domains, RTL, or hardware-software systems
  • Prior work at a major EDA vendor or on-device ML for consumer silicon

Benefits

Equity / stock optionsrelocation support

Tech Stack

Agent OrchestrationEvaluation FrameworksLLM AgentsMemory ManagementML InferencePythonTool InterfacesTracingTransformer ArchitecturesTypeScript
BW

Big Wave Digital

Sydney · AU · 12+ employees

Big Wave Digital is a Sydney-founded specialist recruitment agency focused on technology, AI, digital marketing, data and software engineering talent. Founded by Keiran Hathorn in 2010, it serves startups, scaleups, SaaS companies, digital businesses and established technology teams, providing bespoke permanent and contract recruitment and executive search.

Weekly job alert

Get a weekly email when new AI engineering jobs match your filters. Free — confirm your address to start.

Related Jobs