SIM-UT: A User Simulation based Evaluation Framework for Medical Triage Chatbots
LLM-based chat agents are increasingly used for complex, multi-turn, multilingual medical triage in low- and middle-income countries (LMICs), yet evaluation methods focus on single-turn, English-only benchmarks that primarily test the chatbots' knowledge.
arXiv - cs.CL (NLP)2 min read