EPIC: data-correctness contract coverage (bronze · silver · gold) → 100%

[SharedQA]

Umbrella for getting the metric path fully under contract + tested + monitored. Split per layer so devs work each independently; the CI wire-up is its own task. None of this depends on the gears-rust migration (plain dbt/OpenAPI; gears is a separate track).

QA owns the measurement (the dbt_coverage.py gate + Data Contracts CI workflow, #1320); Dev owns filling each layer.

Children

• data(bronze): source freshness on all sources + contracts on *__bronze_promoted views #1322 — bronze: source freshness (0/130) + *__bronze_promoted contracts
• data(silver): enforced dbt contracts + key tests on all silver metric models #1323 — silver: enforced contracts + key tests (baseline 1/124, 45/124 key-tested)
• data(gold): API contract + golden-value pinning on gold serving views #1324 — gold (API): API contract (openapi+schemathesis+oasdiff) + golden-value pins (gold = views, not dbt)
• ui(contract): validate UI render fidelity — displayed value = documented transform of the API value (rounding/format) #1326 — gold (UI render): displayed value = documented transform of the API value (rounding/format) — DOM == format(api), not DOM == api
• ci(data-contracts): wire dbt-coverage + API-contract gates as blocking, per layer (ratchet) #1325 — CI wire-up: flip the gates to blocking per layer (ratchet)

Baseline (measured in CI, no DB needed — dbt parse)

contracts 1/124 · key tests 45/124 (36%) · source freshness 0/130.

Related defects this prevents recurring: #1318 (type drift), #1319 (wired-empty connectors).

[SharedQA]

Layer-by-layer test/gate implementation plan & status

Tracking the medallion-layer data-quality gates here. ✅ shipped (PR) · 🟡 partial/in-progress · ⬜ planned.

Bronze

• ✅ Data presence / volume audit — test(data): ClickHouse data-presence / dedup / freshness audit #1335 (data_presence_audit.py)
• ✅ Freshness SLA (warn 36h / error 72h) — test(data): source freshness on all bronze connectors (#1322) #1346 (dbt source freshness, 21 connectors)
• ⬜ Schema contracts on *__bronze_promoted — data(bronze): source freshness on all sources + contracts on *__bronze_promoted views #1322 (needs warehouse CI)
• ⬜ Volume/anomaly baseline (today 0 vs usual 1000) — extend test(data): ClickHouse data-presence / dedup / freshness audit #1335

Silver

• ✅ Connector→silver coverage gate — test(data): ClickHouse data-presence / dedup / freshness audit #1335 (connector_silver_coverage.py)
• ✅ Nullable dedup-key guard (order_by NULL→double-count) — test(data): static gate — no dbt model may dedup on a nullable key (#1330) #1348 (nullable_key_audit.py)
• ✅ Uniqueness / not-null on keys — existing dbt (429 unique / 474 not_null)
• ⬜ Referential integrity (relationships, e.g. person_key→class_people) — data(silver): enforced dbt contracts + key tests on all silver metric models #1323
• 🟡 Business-rule data tests (non-negative counts, date sanity) — test(data): silver business-rule data tests — non-negative counts (#1321) #1350 (pattern shipped; roll out to all class_*)
• 🟡 Enforced contracts (data_type, type drift) — data: fix #1318 type mismatch + enforce contract on collab silver + dbt-coverage gate #1320 (collab) + data(silver): enforced dbt contracts + key tests on all silver metric models #1323 (rest); needs warehouse CI

Gold

• ✅ Gold-view resolution gate — test(data): ClickHouse data-presence / dedup / freshness audit #1335 (check_views())
• ⬜ Golden-value regression (top KPIs) — data(gold): API contract + golden-value pinning on gold serving views #1324 (needs seeded warehouse in CI)

API / Frontend

• ⬜ API honest NULLs (Rust units — emit NULL/ComingSoon, never 0)
• ✅ UI render-contract: null→empty state — insight-front Connector: MS Entra #163/ID Res: Super users #164
• 🟡 UI error≠empty (HTTP 500→retry, not "No data") — [FE] Per-metric batch errors (HTTP 500 items) render as "No data for this period" #1336 (remaining FE half)
• 🟡 E2E Playwright smoke (UI→API→DB) — test(data): ClickHouse data-presence / dedup / freshness audit #1335 live-render e2e; broaden critical paths

Governance / CI

• ✅ PR template, Red-then-green DoD (G-1) — chore(governance): PR template with Red-then-green DoD (G-1) #1349
• ⬜ Warehouse-gated CI (dbt build + seed in data-checks.yml) — ci(data-contracts): wire dbt-coverage + API-contract gates as blocking, per layer (ratchet) #1325 — the prerequisite that unlocks contracts, golden-value, and the ratchet; highest-leverage next step
• 🟡 Gates blocking ratchet (report-only → blocking, per layer) — ci: release train + coverage ratchet (release slice; split from the omnibus) #1317

Priority order: (1) wire warehouse-gated CI → unlocks contracts + golden-value; (2) the no-warehouse gates already shipping (#1348/#1350, referential integrity, FE 500→retry, API honest-NULL units); (3) broaden E2E; (4) flip report→blocking as each goes green.

A live tracker (issues × PRs × this plan) is kept in insight-qa-tracker.xlsx.