What Does a Faithfulness Score Summarise? Evidence from a Production RAG System Built with Open-Source Technologies
Reading the explanations behind an LLM judge’s faithfulness scores for 1,197 answers from NeuroClima, and finding what a single number leaves out: about one in seven pieces of evidence the judge relied on was text a model had written, not the source.