SafetyPage

Research papers · Paper

Compositional Multilingual and Behavioral Attribute Steering

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 22 pages

  1. Introductionp. 1
  2. Related Workp. 2
  3. Methodologyp. 3
  4. Steering Vector Extractionp. 3
  5. Steering Vector Applicationp. 3
  6. Compositional Steeringp. 4
  7. Experimental Setupp. 4
  8. Data and Modelsp. 4
  9. Evaluation Metricsp. 4
  10. Steering and Generation Configurationsp. 5
  11. Experimental Resultsp. 5
  12. Single-Attribute Steeringp. 5
  13. Two-attribute Steeringp. 6
  14. Three-attribute Steeringp. 7
  15. Geometry of Steering Vectorsp. 7
  16. Conclusionp. 8
  17. Prompt Suffixesp. 11
  18. Judge Prompt for Output Relevance(OR)p. 11
  19. English Translations of Qualitative Examplesp. 11
  20. Selected Layers and Steering Strengths for Multi-Attribute Steeringp. 11
  21. Disaggregated Single-Attribute Steering Resultsp. 12
  22. Performance by Language Pairp. 15
  23. Single-Attribute Steeringp. 15
  24. Two-Attribute Steeringp. 16
  25. Three-Attribute Steeringp. 18
  26. Disaggregated Compositional Steering Resultsp. 18
  27. Cosine Similarity between Attributes and Individual Languagesp. 20
  28. Steering Performance Across Composition Conditions by Language Pairp. 22