Sharing new post-training research on self-distillation + RL (JOLT), done together with @NVIDIAAI. In self-distillation, the same model performs the role of both a teacher and a student. The teacher gets extra information that the student doesn't, and the student learns from feedback provided by the teacher. However, the teacher could still use shortcuts in ways the student has no way to follow. Our proposed approach, JOLT, trains the teacher as well, to learn from rewards on its own…