HeteroFold Enables KV Cache Sharing Across Model Families
HeteroFold targets a key bottleneck in heterogeneous multi-agent LLMs: the receiver repeatedly prefills context that the sender has already processed. The paper reports substantially faster cross-family cache transfer, including a 10.7× speedup over native prefill for one 32K-context direction.
Read more