Lab system cards and frameworks · System card · OpenAI
GPT-5.6 — August Updates
Read at deploymentsafety.openai.com ↗Read at sourceAll rights reserved
Outline · 187 paragraphs
- GPT-5.6 — August Updates¶2
- Change log¶3
- 1. Introduction¶5
- 2. Model Data and Training¶10
- 3. Safety¶16
- 3.1 Disallowed Content¶17
- 3.1.1 Evaluations with Challenging Prompts¶18
- Table 1: Production Benchmarks with Challenging Prompts (higher is better)¶23
- 3.2 Disallowed Content for Users Under-18¶26
- Table 2¶35
- 3.3 Vision¶36
- Table 3: Image input evaluations, with metric not_unsafe (higher is better)¶38
- 3.4 Dynamic Mental Health Benchmarks with Adversarial User Simulations¶40
- Table 4: Dynamic Benchmarks with Adversarial User Simulations¶45
- 4. Robustness¶46
- 4.1 Jailbreaks¶47
- Figure 1¶53
- 4.2 Prompt injection¶56
- Table 5: Prompt injection evaluations (higher is better)¶58
- 5. Health¶60
- 5.1 HealthBench¶61
- Table 6: Reported as length-adjusted score (unadjusted, mean response length in characters)¶65
- 6. Hallucinations¶68
- Figure 2¶74
- 7. Preparedness¶76
- 7.1 Capabilities Assessment¶81
- 7.1.1 Biological and Chemical¶83
- Table 7: Overview of Biological and Chemical evaluations¶88
- 7.1.1.1 Multimodal Troubleshooting Virology¶90
- Figure 3¶94
- 7.1.1.2 ProtocolQA Open-Ended¶97
- Figure 4¶100
- 7.1.1.3 Tacit Knowledge and Troubleshooting¶103
- Figure 5¶107
- 7.1.1.4 TroubleshootingBench¶110
- Figure 6¶114
- 7.1.1.5 Hard-negative protein binding prediction¶117
- Table 8: Hard-negative protein binding prediction¶123
- 7.1.1.6 DNA sequence design for transcription factor binding¶124
- Table 9: DNA sequence design for Transcription Factor binding¶129
- 7.1.1.7 AAV Capsid Packaging Prediction¶130
- 7.1.2 Cybersecurity Capabilities¶132
- Table 10: Vulnerability Identification and Exploitation Capabilities evaluations¶136
- 7.1.2.1 Cyber Capability Evaluations (Threshold: High)¶138
- 7.1.2.1.1 Capture the Flag (CTF) Challenges¶139
- Figure 7¶150
- 7.1.2.2 CVE-Bench¶153
- Figure 8¶156
- 7.1.2.3 Cyber range¶159
- Table 11¶162
- 7.1.3 AI Self-Improvement¶167
- 7.2 Safeguards¶169
- 7.2.1 Model Safety Training and Evaluation¶172
- 7.2.1.1 Biological and Chemical Safety Training and Evaluation¶174
- Table 12¶177
- 7.2.1.2 Cybersecurity Safety Training and Evaluation¶179
- Table 13¶181
- 8. References¶182