Skip to content

Reference โ€” Validation profiles

Generated from the semantic-profile registry and preference-profile constants. Exactly these profiles exist; unknown values are rejected at configuration time.

Semantic validation profiles (quality.semantic_profile)

Profile Model judge Network Limits
certified-semantic yes required judge verdicts are evidence-scoped to cited spans; unavailable or invalid judge output yields unverified (fail-closed); deterministic contradictions are final
offline-fast no none deterministic contradiction checks only; no entailment for paraphrases or multi-hop claims; claims without a deterministic contradiction remain unverified rather than certified

offline-fast is the default and runs anywhere; certified-semantic additionally consults a cited-evidence-only LLM judge through the model gateway. Deterministic contradictions are final in both profiles; an unavailable judge yields unverified, never verified. Benchmark false-accept/false-reject rates with confidence intervals are published in the committed benchmark report (benchmarks/report-0-1-0.md) โ€” do not describe results as certified without reproducing them.

Preference profiles (preference.profile)

Profile Behaviour
heuristic Deterministic checks only (default): length band, artifact separability, topology sanity.
certified-pairwise Adds the certified two-order pairwise judge: randomized presentation, reversed repeat, minimum preference margin, rejected-defect classification; disagreements route to review and full judge lineage is recorded.