Articles & Guides

Claude API relay guides, detection insights and hands-on LLM API benchmarks

548 articles

CCTest · Blog
On-Policy Self-Distillation Without Supervision: Learning from a Model’s Own Consensus
Large Language Models
cctest.ai

On-Policy Self-Distillation Without Supervision: Learning from a Model’s Own Consensus

The paper introduces U-OPSD, an unsupervised on-policy self-distillation method that builds pseudo-solutions from a model’s own multiple generations. By training on disagreements with those self-consistent pseudo-solutions, it improves mathematical reasoning without ground-truth labels or stronger teachers.

Read more