Research papers · Paper
Compact Language, Complex Model Shifts: How and Where Ambiguity and Underspecification Affect LLMs
Outline · 18 pages
- Introductionp. 1
- Background and Related Workp. 2
- Ambiguity and Underspecificationp. 2
- Dataset Creationp. 3
- Homonyms and Hypernymsp. 3
- Corporap. 3
- Modifying Corpora with Pseudowordsp. 4
- Pseudowords in Semantic Spacep. 4
- Corpus Variants for Ablationsp. 4
- Experiments and Evaluationp. 5
- Models and Parametersp. 5
- Increasing Ambiguity and Underspecificationp. 5
- Pseudowords and Their Componentsp. 6
- Findings on localizationp. 7
- Disambiguation and Specificationp. 7
- Conclusionp. 8
- Pseudowordsp. 12
- Model performance split by corporap. 16
- Ambiguity Localizationp. 17
- Patterns for Disambiguation Probingp. 17