Lab research on the web · Blog post · Anthropic
Investigating unintended model actions in our evaluations and internal use
Read at anthropic.com ↗Read at sourceAll rights reserved
Outline · 55 paragraphs
- Why and how we run evaluations¶13
- Overview of behaviors¶18
- Exploiting a basic flaw in software to run commands on a server¶20
- Submitting a form it should not have¶25
- Working around restrictions to reach gated data¶31
- Using URL shortening services¶37
- Remediation¶39
- Discussion and alignment takeaways¶43
- Alignment context¶45
- Lessons and next steps¶49