Software engineer, generative AI

Sourced from jobs.ashbyhq.com

WRITER is seeking a Software Engineer, Generative AI to build secure, scalable generative AI services and applications for enterprise clients. You will design and develop high-performance APIs and microservices, integrate advanced AI models and agentic workflows, and own architecture from proposal to deployment. This is a hybrid role based in San Francisco, New York City, or London, reporting to an engineering director or senior manager.

• Design and develop robust, secure, and scalable generative AI services and applications using Python and modern frameworks
• Build and optimize high-performance, low-latency APIs and microservices to integrate AI models and agentic workflows
• Make system design decisions and own the architecture of core platform components from proposal to production
• Implement and maintain responsive user interfaces using React and TypeScript
• Collaborate with product managers, data scientists, and DevOps engineers to communicate changes and proposals
• Partner with DevOps to build continuous deployment, logging, and monitoring systems

• 3-5+ years of hands-on experience as a software engineer with strong emphasis on Python in production
• Proven expertise building and deploying generative AI applications with LLMs, vector databases (Pinecone, Weaviate, pgvector), and agentic frameworks
• Practical experience with microservices architecture, RESTful APIs, cloud platforms (AWS, GCP, Azure), Docker, and Kubernetes
• Solid grasp of modern web technologies including FastAPI, Asyncio, PostgreSQL, and AI developer tooling (Claude, Cursor, GitHub Copilot)
• Exposure to enterprise architecture: IAM, SSO, SAML, OAuth, OIDC, RBAC, security best practices, or enterprise admin/billing systems

• Experience mentoring other engineers
• Proactive mindset with ability to suggest innovative improvements
• Full accountability for delivering high-quality, resilient, scalable code