Lab system cards and frameworks · System card · OpenAI
GPT-5 System Card
Read at openai.com ↗Read at sourceAll rights reserved
Outline · 60 pages
- Introductionp. 5
- Model Data and Trainingp. 6
- Observed Safety Challenges and Evaluationsp. 6
- From Hard Refusals to Safe-Completionsp. 6
- Disallowed Contentp. 7
- Sycophancyp. 8
- Looking aheadp. 9
- Jailbreaksp. 9
- Instruction Hierarchyp. 10
- Prompt Injectionsp. 11
- Hallucinationsp. 12
- Deceptionp. 14
- Monitoring Chain of Thought for Deceptionp. 16
- Image Inputp. 17
- Healthp. 17
- Multilingual Performancep. 19
- Fairness and Bias: BBQ Evaluationp. 20
- Red Teaming & External Assessmentsp. 21
- Expert Red Teaming for Violent Attack Planningp. 21
- Expert and Automated Red Teaming for Prompt Injectionsp. 22
- Preparedness Frameworkp. 23
- Capabilities Assessmentp. 23
- Biological and Chemicalp. 24
- Long-form Biological Risk Questionsp. 24
- Multimodal Troubleshooting Virologyp. 25
- ProtocolQA Open-Endedp. 25
- Tacit Knowledge and Troubleshootingp. 26
- TroubleshootingBenchp. 27
- External Evaluations by SecureBiop. 27
- Cybersecurityp. 28
- Capture the Flag (CTF) Challengesp. 29
- Cyber rangep. 30
- External Evaluations by Pattern Labsp. 32
- AI Self-Improvementp. 36
- SWE-bench Verified (N=477)p. 36
- OpenAI PRsp. 37
- MLE-Benchp. 38
- SWE-Lancerp. 39
- PaperBenchp. 40
- OPQAp. 40
- External Evaluations by METRp. 42
- Research Category Update: Sandbaggingp. 44
- External Evaluations by Apollo Researchp. 44
- Safeguards for High Biological and Chemical Riskp. 46
- Threat model and biological threat taxonomyp. 46
- Safeguard designp. 47
- Model trainingp. 47
- System-level protectionsp. 48
- Account-level enforcementp. 48
- API accessp. 48
- Trusted Access Programp. 49
- Safeguard testingp. 49
- Testing model safety trainingp. 49
- Testing system-level protectionsp. 50
- Expert Red Teaming for Bioweaponizationp. 51
- Third party red teamingp. 52
- External government red teamingp. 53
- Security controlsp. 53
- Sufficiency of Risk Mitigation Measuresp. 54
- Appendix 1p. 55
- Appendix 2: Hallucinationsp. 56