Factuality and QA

Citation precision

Definition

Share of citations that are relevant to the statement they are attached to (ALCE: a citation counts if it supports, or is needed to support, the statement).

Formula

Range: [0, 1]

Inputs and outputs

• citations: per answer, statements with 'supported' and per-citation relevance

Returns: MetricResult (float, or per-example array with average=None)

Assumptions

No assumptions beyond valid, aligned inputs of the documented types.

Limitations

No metric-specific limitations are documented yet. Interpret the value alongside the task, data, and other metrics.

Python API

import evalsuite as es

es.citation_precision(citations)

References

1. Gao T, Yen H, Yu J, Chen D. Enabling large language models to generate text with citations. EMNLP. 2023:6465-6488.

Implementation status