Research papers · Paper
Reproducing and Evaluating the Generalizability of Subliminal Learning in Open-Weight Models
Outline · 8 pages
- Introductionp. 1
- Scope of reproducibilityp. 2
- Methodology for extensionp. 2
- New preference traitsp. 2
- New tasksp. 2
- New modelsp. 2
- Ablationp. 2
- Resultsp. 4
- Results reproducing original paperp. 4
- Results beyond original paperp. 4
- Comparison between traits, tasks and modelsp. 4
- Reduction of the generation spacep. 4
- Analysis of teacher data generationp. 5
- Analysis of student completionsp. 5
- Discussionp. 5
- Conclusionp. 6
- Experimental Setup Detailsp. 7
- Distillation pipelinep. 7
- Dataset generationp. 7
- Numbers taskp. 7
- Chess taskp. 8
- Fine-tuning configurationp. 8
- Evaluation protocolp. 8
- Statistical analysisp. 8
- Compute resourcesp. 8