Skip to content

Incorrect annotation in tatqa_dataset_dev.json #12

@reganconnell

Description

@reganconnell

Question "uid": "c91ad938-6ad1-4481-8f6b-43ccd2f69926" in the tatqa_dataset_dev.json appears to be annotated incorrectly. It's annotated as:

      {
        "uid": "c91ad938-6ad1-4481-8f6b-43ccd2f69926",
        "order": 4,
        "question": "What is the nominal difference for ROFE between F19 and F18?",
        "answer": 1.9,
        "derivation": "17.1 - 15.2 ",
        "answer_type": "arithmetic",
        "answer_from": "table",
        "rel_paragraphs": [],
        "req_comparison": false,
        "scale": "percent"
      },

when it should be the following based on the table data provided:

      {
...
        "answer": -1.9,
        "derivation": "15.2 - 17.1",
...
      },

Relevant table data for reference where you can see that the "ROFE (%)" "F19" value is "15.2", and "F18" is "17.1":

{
      "uid": "00addb09-bf31-4240-a351-bc4480a3cecc",
      "table": [
        [
          "",
          "F19",
          "F18 (3)",
          "",
          "CHANGE"
        ],
        ...
        [
          "ROFE (%)",
          "15.2",
          "17.1",
          "(190) bps",
          "(215) bps"
        ]
      ]
    },

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions