health
KampoBench Tests LLMs on Japanese Medicine Consultations
A medRxiv preprint introduces KampoBench, a physician-revised benchmark testing 10 large language models on 74 Japanese Kampo consultation scenarios. The results point to a gap between naming relevant information and applying it to a specific case.