SafetyPage

Research papers · Paper

Limitations of Automated Simulatability: LLM Simulators Can Bypass Explanations

Antonin Poch\'e, Fanny Jourdan, Nils Feldhus, Qianli Wang, Jing Yang, Simon Ostermann, Nicholas Asher, and 2 more · 10 Sep 2026

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 33 pages

  1. Introductionp. 1
  2. Backgroundp. 2
  3. Replication and extension of ConSimp. 2
  4. Replication setupp. 2
  5. Implementation and Reproducibilityp. 3
  6. Reproduction and protocol selectionp. 3
  7. Task-solving shortcuts in non-anonymized simulatabilityp. 3
  8. Attributions and rationales extensionp. 4
  9. Consistent but small explanation gains across LLM simulatorsp. 4
  10. The shortcut hypothesisp. 4
  11. Evidence for the shortcut hypothesisp. 4
  12. Anonymization sensitivity to leakagep. 6
  13. Anonymized experimentsp. 6
  14. Classes-as-conceptsp. 6
  15. Conclusions and recommendationsp. 6
  16. Explanations typesp. 12
  17. Simulatability detailsp. 12
  18. ConSim experiments detailsp. 13
  19. Class-subset constructionp. 13
  20. ConSim prompt formatsp. 14
  21. Prompt types and shared inputsp. 14
  22. Old and new organizationp. 15
  23. Explicit simulator framingp. 15
  24. Generation, parsing, and scoringp. 15
  25. Protocol comparisonp. 15
  26. ConSim reproduction plots with Qwen-3.5-9B judgep. 17
  27. Old- and new-ConSim comparison with Qwen-3.5-9Bp. 21
  28. Explanation-method rankings with Qwen-3.5-9Bp. 22
  29. Explanation-family score distributionsp. 24
  30. Matched explanation–baseline differences across LLM simulatorsp. 26
  31. Prompt-prediction and judge exact agreementp. 27
  32. Anonymized and non-anonymized new-ConSim comparisonsp. 32