auraone

Connect agent systems, inspect tool traces, replay failures, compare candidates, and export regression evidence.

Author, validate, preview, calibrate, diff, and export criterion-level AI evaluation rubrics.

Synchronize robot episodes, inspect failures and recoveries, record review decisions, and export checksummed evidence.

Scan MCP manifests, package metadata, source, and docs for tool, auth, filesystem, shell, network, and readiness risks.

Probe judge behavior for position, verbosity, self-preference, paraphrase, anchoring, and calibration failures.

Measure inter-annotator agreement with modern metrics, uncertainty, ordinal support, and missing-data handling.

Validate and render a disclosure record for judge prompts, calibration, bias, limitations, and intended use.

Shared Proofline UI, runtime contracts, keychain, updater, and release infrastructure for AuraOne Open desktop Studios.

Validate, lint, diff, and convert portable AuraOne Rubric Schema v1 files.

Validate required Datasheet, Model Card, and Data Card sections and surface actionable review findings.

Import rubric JSON and response JSONL, validate them, run deterministic scoring, and inspect exact evidence in the browser.

Validate and render structured cards for robot morphology, sensors, control, environment, data, and known limitations.

Diff and lint rubric changes, annotate affected lines, and publish one merge decision for the exact commit.

Run executable rubric-spec v1 compatibility checks and emit reproducible conformance evidence.

Score repository responses against an AuraOne rubric and publish one consistent GitHub evidence surface.

Normalize agent tool-call traces into deterministic replay artifacts and pytest cases.

Run AuraOne evaluations for an exact commit and publish one lifecycle-aware Check Run plus one idempotent evidence summary.

Generate simulator-light perturbation diagnostics for vision-language-action policies.

Generate controlled synthetic annotator disagreement before real reviewer data is collected.

Browse, filter, validate, and reproduce public synthetic failure cases.