Search
Go
Project Lion - Senior Prompt Engineer - Portugal (Remote, Part-Time)
Summary by AIEngineer.careers
Project Lion - Senior Prompt Engineer - Portugal (Remote, Part-Time) is a Prompt Engineer role (part-time). with PagerDuty. in REMOTE, WORLDWIDE. Imported listing (source: remoteforge.2kool4u.net). Apply on the employer's site (remoteforge.2kool4u.net).
Imported listing (source: remoteforge.2kool4u.net) · Apply on remoteforge.2kool4u.net
REMOTE · WORLDWIDE
—
Part-time
SENIOR
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from remoteforge.2kool4u.net
PagerDuty is seeking a Senior Prompt Engineer based in Portugal to manage the end-to-end migration of templates to LLM autoraters. The role focuses on leveraging proprietary optimization tools, manually refining prompts for complex architectures, and evaluating model performance against human baselines using statistical metrics. Candidates must be native Portuguese speakers with fluent English and at least four years of hands-on prompt engineering experience.
Responsibilities
- Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for template clusters
- Supervise Automated Prompt Optimization (APO) workflows and resolve tooling deadlocks
- Manually draft, test, and refine prompts to handle edge cases and anti-patterns
- Monitor shadowbot runs and track human vs. LLM rating disagreements
- Calculate accuracy metrics (F1, precision, recall) and draft launch certification documentation
Requirements
- Native fluency in Portuguese and fluent written/spoken English
- Must be physically based in Portugal
- 4+ years of professional experience as a Prompt Engineer
- Proven track record tuning LLMs for structured outputs and complex classification tasks
- Strong proficiency in SQL and data analytics for error pattern identification
P
PagerDuty
San Francisco · US · 967+ employees
PagerDuty is an AI-first Operations Platform that serves as the central nervous system for a company's digital operations. The company helps businesses identify issues in real-time, automate incident management, and improve operational resilience to deliver an optimal digital experience.
