Factuality and QA
Citation recall
Implemented
factuality.citation_recallDefinition
Share of statements whose cited passages, taken together, support them (statements without citations count as unsupported); ALCE citation recall.
Formula
statements fully supported by their citations / statements
Range: [0, 1]
Inputs and outputs
- citations: per answer, statements with 'supported' and per-citation relevance
Returns: MetricResult (float, or per-example array with average=None)
Assumptions
No assumptions beyond valid, aligned inputs of the documented types.
Limitations
No metric-specific limitations are documented yet. Interpret the value alongside the task, data, and other metrics.
Python API
import evalsuite as es
es.citation_recall(citations)References
- Gao T, Yen H, Yu J, Chen D. Enabling large language models to generate text with citations. EMNLP. 2023:6465-6488.