Senior Backend Software Engineer (Seattle, West Coast Remote)

Fiddler AI is seeking a Senior Backend Software Engineer to design and build a cloud platform for monitoring and analyzing ML models, including LLMs and generative AI. You will work on enterprise-grade APIs, develop new metrics for model quality, and collaborate with product teams. The role requires experience with Python, ML models in production, and LLM frameworks like LangChain and Hugging Face.

• Design and build a world-class cloud platform for monitoring and analyzing ML models
• Design enterprise-grade, scalable APIs and frameworks for analysis and validation of ML models
• Develop new metrics and evaluation methods for quality and robustness of ML models
• Work with product and customer-facing teams to enhance and expand the product
• Recommend and implement engineering best practices and ensure software meets quality standards

• BS/MS/PhD in Computer Science or equivalent
• 3-4 years of experience
• Proficiency with Python
• Experience with ML models in production
• Experience with common LLM frameworks (Langchain, Llamaindex, RAG, HuggingFace, and eval frameworks like Ragas or Presidio)
• Experience debugging and troubleshooting production systems
• Experience with common distributed systems infrastructure: Redis, Postgres, RabbitMQ, Celery, Flask