Evaluators and safety organisations · Article · Apollo Research
What makes a good monitoring prompt?
Read at apolloresearch.ai ↗Read at sourceNo licence statement found
Outline · 289 paragraphs
- What makes a good monitoring prompt?¶2
- Summary¶3
- Setup¶11
- Our prompt format¶21
- Baselines¶22
- Single Category ablations¶30
- Reasoning vs. no reasoning effort¶36
- Prompt-side: does externalizing the reasoning matter?¶38
- Model-side: can native reasoning replace the prompt scaffold?¶41
- Multi-category cuts¶45
- Compressing the prompt¶50
- Appendix A - per-model and per-FM results¶55
- A.1 Baselines per FM × model¶56
- A.2 Single-component ablations (per FM)¶63
- A.3 Reasoning (per FM)¶66
- A.4 Joint cuts (per FM)¶72
- A.5 Short prompts (per FM)¶75
- Appendix B - Canonical prompt (api_keys), annotated¶78