SafetyPage

Research papers · Paper

Compact Language, Complex Model Shifts: How and Where Ambiguity and Underspecification Affect LLMs

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 18 pages

  1. Introductionp. 1
  2. Background and Related Workp. 2
  3. Ambiguity and Underspecificationp. 2
  4. Dataset Creationp. 3
  5. Homonyms and Hypernymsp. 3
  6. Corporap. 3
  7. Modifying Corpora with Pseudowordsp. 4
  8. Pseudowords in Semantic Spacep. 4
  9. Corpus Variants for Ablationsp. 4
  10. Experiments and Evaluationp. 5
  11. Models and Parametersp. 5
  12. Increasing Ambiguity and Underspecificationp. 5
  13. Pseudowords and Their Componentsp. 6
  14. Findings on localizationp. 7
  15. Disambiguation and Specificationp. 7
  16. Conclusionp. 8
  17. Pseudowordsp. 12
  18. Model performance split by corporap. 16
  19. Ambiguity Localizationp. 17
  20. Patterns for Disambiguation Probingp. 17