The 2018 paper "Tackling the Story Ending Biases in The Story Cloze Test" introduces a new revision of the Story Cloze Test, SCT-v1.5, which is supposed to correct for the annotation artifacts that made it possible to choose the right ending 72% of the time without reading the story. The paper points to https://competitions.codalab.org/competitions/15333 as the location of this new evaluation, which is the page for this competition. It suggests that systems should evaluate on both the old (v1.0) and new (v1.5) versions.
However, I see nothing about SCT v1.5 on this page. Where would I find it?
Posted by: rspeer @ Aug. 28, 2018, 8 p.m.