Feat/text to image eval primitives: add prompt-driven evaluation primitives (PromptDataset + CLIPScore + Recall@K + MRR) - #1284

Open

AChenreddy24 wants to merge 8 commits into

mainfrom

feat/text-to-image-eval-primitives

Commits on Aug 5, 2026

feat(datasets): add PromptDataset primitive for prompt-driven evaluators
AChenreddy24
committed
d726e14
feat(eval): add CLIPScoreMetric for text-image alignment
AChenreddy24
committed
d0d9c6a
feat(eval): add RecallAtKMetric for retrieval and ranked-neighbor evaluation
AChenreddy24
committed
b97b07b
feat(eval): add MeanReciprocalRankMetric for retrieval evaluation
AChenreddy24
committed
6fba49f
feat(eval): report Recall@K and MRR from image-feature-extraction evaluator
AChenreddy24
committed
253a2a7
feat(datasets): add filter/sample to PromptDataset with _derive extension hook
AChenreddy24
committed
f191b86
Merge branch 'main' into feat/text-to-image-eval-primitives
AChenreddy24
authored
db4329a
fix(datasets): add return type to PromptDataset.__iter__ for mypy
AChenreddy24
committed
daf8a47