Skip to content

TyDiQA dataset #1

@dsj96

Description

@dsj96

Thank you for proposing an interesting token-level data selection method. I encountered some issues while preparing the TyDiQA dataset for evaluation (For research purposes only):

  1. Dataset Download Issue: I'm unable to download the TyDiQA dataset from the following links (see screenshot attached):
Image

Could you provide a new download link or share the dataset with me? My email: daishaojie96@gmail.com

  1. Metrics Clarification: Regarding Table 1 in the paper, for the results on HellaSwag, LogiQA, and ARC_challenge, are the reported metrics accuracy (acc) or accuracy normalized (acc_norm)?

Looking forward to your reply. Thank you!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions