Skip to content

Question about eval chart-to-table on ChartQA #24

@GoGoJoestar

Description

@GoGoJoestar

I want eval the chart-to-table task on ChartQA, but I could't find the annotations file of ChartQA_OCR mentioned in accessory/single_turn_eval_multitask.py

'chartqa_ocr': '/mnt/petrelfs/share_data/path1/path/ChartQA-main/ChartQA-Dataset/test/annotations2.json',

Where can I get this annotations file? And is there a script or document for chart-to-table reasoning and metric (RMS F1 in the chart-ast papar) calculation to follow?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions