Articles & Guides

Claude API relay guides, detection insights and hands-on LLM API benchmarks

1636 articles

CCTest · Blog
Wavefront Decoding Brings Parallelism to Looped Language Models
Inference & Serving
cctest.ai

Wavefront Decoding Brings Parallelism to Looped Language Models

Looped language models gain effective depth by repeatedly applying a shared block, but this also creates a sequential decoding bottleneck. Wavefront Decoding uses intermediate states as drafts and schedules states from different positions and recurrence depths in a diagonal, batched wavefront without additional training.

Read more