Multimodal

Hallo4D targets spatial and temporal hallucinations in 3D and 4D generation. Instead of retraining generators, it uses multimodal LLMs to detect inconsistencies and guide consensus-based corrections.

KnowAct-GUIClaw introduces a “Know Deeply, Act Perfectly” paradigm for personal GUI assistants, aiming to address OpenClaw’s limitations in cross-platform GUI interaction and self-evolution. The framework combines experience-based memory, a self-evolving skill library, and reflection to improve task execution over time.

A new arXiv paper introduces CF-Net, a multimodal model for recognizing ambivalence and hesitancy in unconstrained video. Instead of looking for prototypical emotion cues, it focuses on subtle inconsistencies across vision, audio, and text.

A new arXiv paper introduces AgentHOI, a training-free agentic framework for human-object interaction detection in open-world scenes. Instead of learning fixed interaction classifiers, it coordinates multimodal reasoning and visual grounding modules.

A new arXiv paper proposes a slice-wise data synthesis pipeline to help 2D-pretrained medical multimodal large language models reason over 3D scans. The approach turns volumetric reading into structured, interpretable reasoning traces.

AspectCLIP addresses a subtle weakness in CLIP-style training: images contain many possible semantic aspects, while captions usually describe only one. The method uses text-guided attribute clusters to apply consistency where it is semantically appropriate.

Thinking Machines has released Inkling on Hugging Face, an open multimodal model designed to natively accept image, text, and audio inputs. With a 1M-token context window and a sparse MoE architecture, it targets advanced multimodal reasoning and downstream adaptation.