Reasoning Over Paragraph Effects in Situations (ROPES)

AllenNLP • 2019
ROPES is a QA dataset which tests a system's ability to apply knowledge from a passage of text to a new situation. A system is presented a background passage containing a causal or qualitative relation(s), a novel situation that uses this background, and questions that require reasoning about effects of the relationships in the back-ground passage in the context of the situation.
License: CC BY

Leaderboard

Top Public Submissions
DetailsCreatedExact Match
10/5/202075%
5/29/202070%
10/24/201954%
4/30/202055%

Authors

Kevin Lin, Oyvind Tafjord, Peter Clark, Matt Gardner