Data leakage with tasks 1295 and 1640

[axelmarmet]

Task 1295 is a training task issued from the AdversarialQA dataset and Task 1640 is a testing task also issued from AdversarialQA.
I would assume that this wasn't caught by automated checks because the URLs are different and there is a typo in the Source field of task 1640 where the value is "adverserial_qa"

[danyaljj]

@axelmarmet Thanks for reporting this!

@yeganehkordi would you be able to address this?

[yeganehkordi]

@yeganehkordi would you be able to address this?

Sure, task1295 is a "Question Answering" task and task1640 is an "Answerability Classification" task, so they are not exactly the same.
I think one solution may be using different instances in these tasks. Also, we can replace one of them with another task. What do you think?

[danyaljj]

@yizhongw suggests moving this task from splits/default/train_tasks.txt to splits/default/excluded_tasks.txt. I think this should address the concern; right?

[yeganehkordi]

Yeah, I'll fix it.