Hello,
You wrote that sentences in the train set marked with M_ when they are metaphorical and didn’t mark when they are literal. And it’s ok for training.
But the texts in the test set also have these marks. Is this right that they already have mark about their metaphorical meaning?
Thank you very much for your answer!
Best
Posted by: nsu_ai @ Feb. 15, 2018, 12:18 p.m.Thanks for pointing this out -- the testing script has been reworked to address this issue. Please download it again at https://github.com/EducationalTestingService/metaphor/releases/download/v1.0/naacl_flp_testing_kit.zip to generate the test corpus.
Technically speaking, all metaphor labels for train and test are already present in the publicly available VUAMC corpus. We expect all participants to act in good faith and provide justification of the results they submitted through the shared task paper.
Posted by: cleong @ Feb. 21, 2018, 5:39 p.m.