Retrieval and RAG
Hit rate@k
Implemented
rag.hit_rate_at_kDefinition
Share of queries with at least one relevant document in the top k.
Formula
mean_q [|relevant ∩ top_k| > 0]
Range: [0, 1]
Inputs and outputs
- relevant: per query, relevant ids or id -> grade
- retrieved: per query, ranked ids
Returns: MetricResult (float, or per-example array with average=None)
Assumptions
No assumptions beyond valid, aligned inputs of the documented types.
Limitations
No metric-specific limitations are documented yet. Interpret the value alongside the task, data, and other metrics.
Python API
import evalsuite as es
es.hit_rate_at_k(relevant, retrieved, k=5)References
- Manning CD, Raghavan P, Schütze H. Introduction to Information Retrieval. Cambridge University Press; 2008. Chapter 8.