Add tests for #1466#1482
Draft
prompt-driven-github[bot] wants to merge 4 commits into
Draft
Conversation
Adds 6 new architecture entries for PDD Generation Quality umbrella: - generation_source_contract (p251): foundational Pydantic v2 schema - generation_readiness (p252): pre-generation PRD analysis pass - interface_grounder (p253): AST-based real interface inspection - wiring_validator (p254): post-generation completeness gate - test_quality_gate (p255): generated test quality validation - generation_audit (p256): machine-readable evidence manifest Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Create prompts for generation_source_contract, generation_readiness, interface_grounder, wiring_validator, test_quality_gate, and generation_audit modules. Also commit shared context documents (_context/data_dictionary.yaml, api_contracts.yaml, integration_points.yaml) generated by Step 8.5. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- Add 7 test files (88 total test cases) for generation quality modules: test_generation_source_contract.py, test_generation_readiness.py, test_interface_grounder.py, test_wiring_validator.py, test_generation_test_quality.py, test_generation_audit.py, test_generation_quality_e2e.py - Add fixture PRDs: underspecified.md and well_specified.md - Add 6 stub implementations: generation_source_contract.py, generation_readiness.py, interface_grounder.py, wiring_validator.py, test_quality_gate.py, generation_audit.py - All 88 tests pass (31 existing-module tests + 57 TDD tests satisfied) Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds tests and stub implementations based on the requirements in #1466 (PDD Generation Quality — Umbrella Tracker).
Test Files
tests/test_generation_source_contract.py— 12 cases: Pydantic v2 schema validation, enum values, round-trip serialization, JSON schema exporttests/test_generation_readiness.py— 16 cases: VAGUE_TERMS detection, requirement extraction, vague-phrase detection, readiness gate, example classificationtests/test_interface_grounder.py— 12 cases: ApiContractSlicer grounding, interface_grounder TDD stubstests/test_wiring_validator.py— 12 cases: architecture include drift detection, wiring_validator TDD stubstests/test_generation_test_quality.py— 15 cases: inline brittle-pattern regression tests via ast/re, test_quality_gate TDD stubstests/test_generation_audit.py— 12 cases: evidence_manifest snapshot validation, generation_audit TDD stubstests/test_generation_quality_e2e.py— 9 cases: conformance gate non-regression, E2E fixture teststests/fixtures/generation_readiness/underspecified.md— fixture PRD with vague prose requirementstests/fixtures/generation_readiness/well_specified.md— fixture PRD with explicit file paths, HTTP status codes, JSON schemasImplementation Stubs
pdd/generation_source_contract.py— Pydantic v2 schema hub with all shared enums and modelspdd/generation_readiness.py— requirement extraction, vague-phrase detection, readiness gatepdd/interface_grounder.py— AST-based Python interface extraction with SHA-256 fingerprintingpdd/wiring_validator.py— post-generation completeness gatepdd/test_quality_gate.py— generated test quality analysis (brittle selectors, private assertions)pdd/generation_audit.py— machine-readable evidence manifest extensionTest Coverage
What These Tests Verify
Contract Test Summary
N/A - no OpenAPI spec found (pure Python CLI/library project)
Accessibility Audit Summary
N/A - not a web test (TEST_TYPE: cli)
Test Execution
Next Steps
Closes #1466
Generated by PDD agentic test workflow (18-step)