arXiv cs.AIPaper
Medical Fine-Tuning Reshapes, Not Reduces, Patient-Facing AI Risk: A Rubric-Based, LLM-Judge Evaluation Framework
Medical fine-tuning doesn't solve the core problem: models still generate harmful directives, just in different shapes. The rubric (treatment directives, dosage, contraindication language, overconfidence) is actionable. If you're shipping medical AI, use this or something like it to evaluate before launch. Don't rely on factual correctness alone.