HuatuoGPT-3: Adapting Medical LLMs with Reinforcement Learning Alone
HuatuoGPT-3 introduces OnePO, which uses teacher outputs as temporary guidance rather than a permanent imitation target for direct domain adaptation from base models. The paper reports a score of 71.4 for its 27B model on HealthBench Professional.
Read more