Search
Go
AI Benchmark Engineer | Native Language Specialist - German (Switzerland) - Remote
Summary by AIEngineer.careers
AI Benchmark Engineer | Native Language Specialist - German (Switzerland) - Remote is a LLM Evaluation Engineer role (contract). with LILT. in REMOTE, WORLDWIDE. Imported listing (source: wellfound.com). Apply on the employer's site (wellfound.com).
Imported listing (source: wellfound.com) · Apply on wellfound.com
REMOTE · WORLDWIDE
—
Contract
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from wellfound.com
LILT is seeking a Native Language Specialist (German - Switzerland) to design and validate rigorous benchmark tasks for evaluating Large Language Models on multilingual software challenges. The role involves creating high-signal assets in the target language to test model robustness against encoding, locale, and terminal workflow edge cases without relying on English translation. This is a flexible freelance opportunity focused on task engineering, verification scripting, and quality assurance.
Responsibilities
- Design and build realistic task environments using datasets and files in native German (Switzerland).
- Create high-signal tasks that genuinely test LLM ability to handle multilingual environments.
- Write deterministic verifier scripts and support reference implementations.
- Analyze execution logs and calibrate task difficulty levels (Easy to Very Hard).
- Participate in multi-layer human quality control processes alongside automated checks.
Requirements
- 1+ years of industry experience in software or prompt engineering.
- Native or near-native fluency in German (Switzerland) with deep grammatical understanding.
- Strong proficiency in Python, standard shell scripting, and data processing.
- Extensive experience with Terminal/CLI-based development workflows.
LILT
San Francisco · US · 811+ employees
LILT is an AI company providing an end-to-end platform for agentic/enterprise translation and multilingual content production. The platform is used by enterprise teams and governments to customize AI models to translation use cases, automate workflows, and support quality in production.
