Large Language Models

GigaWorld-Policy-0.5 tackles a key bottleneck in World Action Models: costly video generation during inference. It keeps future visual dynamics as a training signal while switching to action-only decoding for deployment.

A new arXiv paper introduces Deep Interaction, a human-in-the-loop method that lets users edit faulty reasoning steps in an LLM’s original answer and reuse the corrected chain to steer future output.

A new arXiv paper reframes familiar Transformer feedforward-block choices as mechanisms for preserving gradient rank across depth. Skip connections, normalization placement, and width expansion are interpreted as part of a shared tradeoff among rank collapse, composition, and parameter cost.

DeltaMerge-LowRes explores whether low-resource NLP adaptation can avoid costly joint language-task fine-tuning. It trains a language delta and a task delta separately, then studies how different merge rules change model behavior.