Inference efficiency and cost
Error rate / availability
Implemented
efficiency.availabilityDefinition
Availability: share of requests served successfully (the value), with the error rate and the error budget remaining against a service-level objective.
Formula
availability = successful / total; budget = 1 − (1 − availability) / (1 − SLO)
Range: [0, 1]
Inputs and outputs
- success: see the signature of es.availability
Returns: MetricResult (value plus counts, intervals and breakdowns in params)
Assumptions
No assumptions beyond valid, aligned inputs of the documented types.
Limitations
No metric-specific limitations are documented yet. Interpret the value alongside the task, data, and other metrics.
Python API
import evalsuite as es
es.availability([True, 200, 503, True], slo=0.999)References
- Beyer B, Jones C, Petoff J, Murphy NR. Site Reliability Engineering. O'Reilly; 2016.