Skip to content

Add real demo outputs from recorded runs #91

Description

@crqu

Problem

The documentation suite is thorough (QUICKSTART.md, TUTORIAL.md, FAQ.md, etc.), but all examples are illustrative/mock — no real captured output from actual runs exists in the repo. A mathematician evaluating ProofPartner has no way to see what a successful run actually produces before committing their API key and money.

Why this matters

This is the lowest-effort, highest-impact adoption improvement. People don't try tools they can't preview. A curated set of real outputs answers: "What will I get?" and "Is this worth $5 per run?"

Proposal

Record and commit 2–3 actual end-to-end runs with real output artifacts:

  1. Simple olympiad problem — e.g., a miniF2F problem via exploreformalizeprove. Show the full terminal output, final .lean file, and cost breakdown. This is the "hello world" that proves the tool works.

  2. Exploration flowexplore on a rough mathematical idea, showing the ranked conjecture table with confidence scores and difficulty ratings. Demonstrates the Stage 0 → Stage 1 value proposition.

  3. Novel conjecture formalization — a conjecture not in any benchmark, showing type-first formalization, IntentJudge verification, and (ideally) a successful proof. This is the use case no competitor supports.

For each, commit:

  • Terminal output (captured via script or tee)
  • Generated .lean artifacts
  • Cost summary
  • Brief annotation explaining what happened at each stage

These could live in examples/ or docs/demos/.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions