SafetyPage

Research papers · Paper

Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoning

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 37 pages

  1. Introductionp. 1
  2. Related workp. 2
  3. Error Taxonomyp. 2
  4. Perception Errorsp. 3
  5. Reasoning Errorsp. 3
  6. Experimentsp. 3
  7. Multimodal Datasetsp. 3
  8. Modelsp. 4
  9. Experimental Setupp. 5
  10. Evaluationp. 5
  11. Resultsp. 6
  12. Perception Bottleneck Analysisp. 7
  13. Discussion: InternS1-minip. 7
  14. Conclusionp. 8
  15. Results- All numbers reported below are in %p. 11
  16. Caption Generation Promptsp. 16
  17. Evaluation Promptsp. 18
  18. Physcis Benchmarks Datasetp. 22
  19. Geometry Benchmarks Datasetp. 25
  20. Five Tasks Code Snippets Physics / Geometry Inference Scriptsp. 27
  21. InternS1-mini Models Repsonsesp. 36