-
Notifications
You must be signed in to change notification settings - Fork 24
Open
Description
Question "uid": "c91ad938-6ad1-4481-8f6b-43ccd2f69926"
in the tatqa_dataset_dev.json
appears to be annotated incorrectly. It's annotated as:
{
"uid": "c91ad938-6ad1-4481-8f6b-43ccd2f69926",
"order": 4,
"question": "What is the nominal difference for ROFE between F19 and F18?",
"answer": 1.9,
"derivation": "17.1 - 15.2 ",
"answer_type": "arithmetic",
"answer_from": "table",
"rel_paragraphs": [],
"req_comparison": false,
"scale": "percent"
},
when it should be the following based on the table data provided:
{
...
"answer": -1.9,
"derivation": "15.2 - 17.1",
...
},
Relevant table data for reference where you can see that the "ROFE (%)" "F19" value is "15.2", and "F18" is "17.1":
{
"uid": "00addb09-bf31-4240-a351-bc4480a3cecc",
"table": [
[
"",
"F19",
"F18 (3)",
"",
"CHANGE"
],
...
[
"ROFE (%)",
"15.2",
"17.1",
"(190) bps",
"(215) bps"
]
]
},
Metadata
Metadata
Assignees
Labels
No labels