Skip to content

get-related benchmark: incoming AND outgoing edge sets #6

Description

@tcballard

One subdir benchmark for the get_related MCP tool, CLI-scoped v1: a fixture relationship graph (GRB- ids) where each case declares the exact expected incoming AND outgoing edge sets for an artifact — the outgoing direction was previously unguarded — scored as set membership over the corpus-wide rac relationships corpus/ --json map. Conformance gated at 1.0; a must_not_return id in either returned edge set is a violation.

Recorded limitation: depth > 1 neighborhoods and the ADR-033 response budget are MCP-only and deferred to the MCP-stdio harness workstream.

Roadmap: rac/roadmaps/benchmarks/tool-benchmarks.md in rac-core [roadmap:tool-benchmarks].

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions