Hi,
Some queries related to evaluation test phase.
1. Will a evaluation script be provided for testing on evaluation test?
2. Can we do the submission on the test set till 31st of March or 24th of March?
3. Is it allowed to use the external resources(example, knowledge base) apart from provided dataset?
Posted by: subhashpujari @ March 10, 2020, 2:55 p.m.Hi,
1. I will discuss internally, but I think so. At least, for using it on the training data could help, right? I will post soon (also here) a link.
2. 24th March is deadline for test evaluation. Although the Post Evaluation only starts on 31. 3.
3. I would say a general language model can be used. Given the dataset is free available, an approach based on matching between online patent and patent in the test set would not meet the spirit of the shared task. I would recommend also disclosing it on the paper submission.
Cheers,
Fernando