Skip to content

Reference โ€” Quality gates

Generated from validator registration (default_validators() plus the preference validator). Every accepted example must pass the enabled gates; failures carry machine-readable reason codes routed to review or quarantine. See quality concepts.

Gate Purpose
answerability C3.5/C4: the prompt must be answerable from the cited evidence.
completeness Completeness: answer length is within a sane band of the question+evidence.
format Format: assistant should not be empty; JSON-ish answers keep structure.
grounding Faithfulness: the assistant answer must be traceable to the evidence.
preference C1/D5: preference-pair quality โ€” a genuine, non-fabricated signal.
refusal Refusal handling: a refusal must be unanswerable, not a false refusal.
schema C3.1/C4: topology-specific structural validation (fail-closed).
semantic_consistency Semantic consistency (defect 4.1): atomic claims in the assistant