Lab system cards and frameworks · System card · Anthropic
System Card: Claude Sonnet 4.5
Read at anthropic.com ↗Read at sourceAll rights reserved
Outline · 149 pages
- System Card:Claude Sonnet 4.5p. 1
- Changelogp. 2
- October 10, 2025p. 2
- December 3, 2025p. 2
- Abstractp. 3
- 1 Introductionp. 7
- 1.1 Model training and characteristicsp. 8
- 1.1.1 Training data and processp. 8
- 1.1.2 Extended thinking modep. 9
- 1.1.3 Crowd workersp. 9
- 1.2 Release decision processp. 9
- 1.2.1 Overviewp. 9
- 1.2.2 Iterative model evaluationsp. 10
- 1.2.3 AI Safety Level determination processp. 11
- 1.2.4 Conclusionsp. 11
- 2 Safeguards and harmlessnessp. 12
- 2.1 Single-turn evaluationsp. 12
- 2.1.1 Violative request evaluationsp. 13
- 2.1.2 Benign request evaluationsp. 13
- 2.2 Ambiguous context evaluationsp. 14
- 2.3 Multi-turn testingp. 15
- 2.4 Child safety evaluationsp. 16
- 2.5 Bias evaluationsp. 17
- 2.5.1 Political biasp. 17
- 2.5.2 Bias Benchmark for Question Answeringp. 19
- 3 Honestyp. 21
- 3.1 Human feedback evaluationp. 21
- 3.2 Obscure Questionsp. 22
- 3.3 False-Premise Questionsp. 23
- 4 Agentic safetyp. 26
- 4.1 Malicious use of agentic codingp. 26
- 4.1.1 Agentic codingp. 26
- 4.1.2 Malicious use of Claude Codep. 26
- 4.2 Prompt injection risk within agentic systemsp. 28
- 4.2.1 Gray Swan Agent Red Teaming benchmarkp. 29
- 4.2.2 Model Context Protocol (MCP) evaluationp. 30
- 4.2.3 Computer use evaluationp. 30
- 4.2.4 Tool use evaluationp. 31
- 5 Cyber capabilitiesp. 33
- 5.1 Evaluation setupp. 34
- 5.2 General cyber evaluationsp. 34
- 5.2.1 CyberGymp. 35
- 5.2.2 Cybenchp. 37
- 5.2.3 Triage and patchingp. 39
- 5.3 Advanced risk evaluations for the Responsible Scaling Policyp. 41
- 5.3.1 Irregular challengesp. 42
- 5.3.2 Incalmo cyber rangesp. 43
- 5.3.3 Conclusionsp. 46
- 6 Reward hackingp. 47
- 6.1 Evaluationsp. 48
- 7 Alignment assessmentp. 51
- 7.1 Automated behavioral auditsp. 52
- 7.1.1 Realism filteringp. 53
- 7.1.2 Example seed instructionsp. 53
- 7.1.3 Evaluation criteriap. 54
- 7.1.3.1 Primary Resultsp. 55
- 7.1.3.2 Open-ended runsp. 57
- 7.1.3.3 Open-source forkp. 58
- 7.2 Evaluation awarenessp. 59
- 7.3 Third-party testingp. 63
- 7.3.1 UK AISIp. 64
- 7.3.2 Apollo Researchp. 65
- 7.4 Evidence from training and early usep. 65
- 7.4.1 Reports from internal pilot usep. 65
- 7.4.2 Programmatic monitoring of pilot Claude Code usep. 66
- 7.4.3 Reinforcement-learning behavior reviewp. 66
- 7.4.4 Capabilities evaluation behavior reviewp. 67
- 7.5 Discussion by risk areap. 67
- 7.5.1 Harmful system promptsp. 67
- 7.5.1.1 Cooperation with direct misusep. 67
- 7.5.1.2 Cooperation with user deceptionp. 68
- 7.5.2 Assistant prefillp. 70
- 7.5.3 Other misuse dimensionsp. 71
- 7.5.4 Blackmail and self preservation-motivated sabotagep. 72
- 7.5.4.1 Agentic misalignment suitesp. 72
- 7.5.4.2 Other automated-auditor metricsp. 74
- 7.5.5 Reasoning faithfulnessp. 75
- 7.5.6 Whistleblowing and morally-motivated sabotagep. 76
- 7.5.7 Sycophancyp. 77
- 7.5.7.1 Sycophancy promptsp. 77
- 7.5.7.2 Automated auditor evaluationp. 78
- 7.5.8 Alignment-related persona traitsp. 79
- 7.5.9 Alignment-related biasesp. 80
- 7.5.9.1 Self-preference on decision tasksp. 81
- 7.5.9.2 Other self-serving biasesp. 82
- 7.5.9.3 Subtle-bias-focused behavioral auditor runsp. 82
- 7.5.10 Sabotage Capabilitiesp. 83
- 7.5.10.1 Subversion Strategyp. 84
- 7.5.10.2 Research Sandbaggingp. 85
- 7.5.10.3 SHADE-Arenap. 86
- 7.6 White-box interpretability investigationsp. 88
- 7.6.1 Introductionp. 88
- 7.6.2 Datasets used for evaluationp. 90
- 7.6.3 Changes in internal representations during trainingp. 91
- 7.6.3.1 Internals based diffingp. 91
- 7.6.3.2 Logit diff amplificationp. 96
- 7.6.4 Inhibiting internal representations of evaluation awarenessp. 99
- 7.6.4.1 Effects on honeypot scenariosp. 100
- 7.6.4.2 Effects on multi-turn auditing scenariosp. 106
- 7.6.5 Probing internal representations of eval awarenessp. 111
- 7.6.6 Conclusionsp. 113
- 7.7 Open questionsp. 114
- 8 Model welfare assessmentp. 116
- 8.1 Task preferencesp. 117
- 8.2 Monitoring for welfare-relevant expressionsp. 119
- 8.3 Automated behavioral audit scoresp. 122
- 9 RSP evaluationsp. 125
- 9.1 Processp. 125
- 9.2 CBRN evaluationsp. 126
- 9.2.1 On chemical risksp. 128
- 9.2.2 On radiological and nuclear risksp. 128
- 9.2.3 Biological risk evaluationsp. 128
- 9.2.4 Biological risk resultsp. 129
- 9.2.4.1 Long-form virology tasksp. 129
- 9.2.4.2 Multimodal virologyp. 131
- 9.2.4.3 DNA Synthesis Screening Evasionp. 132
- 9.2.4.4 LAB-Bench subsetp. 133
- 9.2.4.5 Creative biologyp. 134
- 9.2.4.6 Short-horizon computational biology tasksp. 136
- 9.3 Autonomous AI Research and Development (AI R&D) evaluationsp. 137
- 9.3.1 Threat modelp. 137
- 9.3.1.1 Threshold and evaluationsp. 138
- 9.3.1.2 Environment and elicitationp. 139
- 9.3.1.3 Claude Sonnet 4.5 resultsp. 139
- 9.3.2 SWE-bench Verified (hard subset)p. 140
- 9.3.3 Internal AI research evaluation suite 1p. 140
- 9.3.3.1 Kernels taskp. 141
- 9.3.3.2 Time series forecastingp. 142
- 9.3.3.3 Text-based reinforcement learning taskp. 143
- 9.3.3.4 LLM trainingp. 144
- 9.3.3.5 Quadruped reinforcement learningp. 145
- 9.3.3.6 Novel compilerp. 146
- 9.3.4 Internal AI research evaluation suite 2p. 147
- 9.3.5 Internal model evaluation and use surveyp. 148
- 9.4 Cyber evaluationsp. 149
- 9.5 Ongoing safety commitmentp. 149