Articles & Guides

Claude API relay guides, detection insights and hands-on LLM API benchmarks

1636 articles

CCTest · Blog
PhysVista Tests VLM Physical Intelligence Through a Perception–Reasoning–Assessment Loop
Evaluation & Benchmarks
cctest.ai

PhysVista Tests VLM Physical Intelligence Through a Perception–Reasoning–Assessment Loop

PhysVista introduces a benchmark that evaluates whether vision-language models understand physical consistency rather than merely recognizing visual content. It combines physical state perception, dynamics reasoning, and plausibility assessment across real-world and AI-generated videos.

Read more
CCTest · Blog
Why LLM Agents Keep Following Instructions Users Have Withdrawn
AI Agents
cctest.ai
AI Agents

Why LLM Agents Keep Following Instructions Users Have Withdrawn

A new study turns intent drift into a measurable failure mode: superseded or withdrawn user requirements can continue to shape an agent’s answer or tool action. Its IntentFlux benchmark and StateForge method show that explicit state maintenance helps, but does not eliminate the gap between evolving dialogues and direct single-turn tasks.

Read more
CCTest · Blog
OpenTumorBoard Tests Whether AI Can Reason With a Cancer Care Team
Evaluation & Benchmarks
cctest.ai

OpenTumorBoard Tests Whether AI Can Reason With a Cancer Care Team

OpenTumorBoard turns public multidisciplinary tumor board recordings into a benchmark for evaluating models on specialist answers and full clinical discussions. Its results show that even advanced general and medical models still struggle to reproduce expert responses and board-level consensus.

Read more