Annotation Example

[Original Clip] The Lovely Bones - Lindsey Finds Evidence (watch for reference)

  • [Premise] A man runs from the house after the girl to catch her outside the house.
  • [Observation] video clip (for replaying: please refresh the page)
  • [Part One] Commonsense Annotation
    [Q1] object-attribute Is there any object that connects the persons or relates to any person in the events? Does there exist any attribute that is important about this relation?
    [A1] an example the book; probably there is something in the book that is important to both persons
    [Q2] person-emotion What does the person(s) feel?
    [A2] an example man-angry, girl-scared
    [Q3] social-interaction What is the relation(s) between the persons?
    [A3] an example hostile, scramble for the book
  • [Part Two] Judge Existing Inference (each inference is provided in a form of QA pair)
    Below are 4 inferences to judge:
    predictive What is going to happen to the girl instantly?
    The girl shows the book to the man after the fence.
    comet premise Causes what?
    [" scared", " angry", " worried", " terrified", " a woman"]
    comet premise ReceivesAction what?
    [" run from the house", " run to the house", " none", " run away", " get caught"]
    comet observation ReceivesAction what?
    [" the girl runs away", " the girl gets hurt", " the girl falls down", " the girl falls", " the girl runs"]
    For each inference, judge by answering below questions:
    [Q1] feasible Is the question answerable or can we provide a plausible answer to it?
    [Q2] not unexpected Is the given answer too unexpected to predict?
    [Q3] interesting Is the provided answer so general that it is not that specific given the premise and observation?
    [Q4] multimodal Does the question require information from both premise and observation to answer?
    [Q5] commonsense Does the question relate to any of the knowledge you use to answer the queries in Part One?
  • [Part Three] Inference Generation Based on the knowledge you use to answer the queries in Part One, write an answer to the questions below.
    PS: make sure the question requires info from both premise and observation to answer.
    [Q1] abductive What has happened to the girl in between the observation & premise?
    [Q2] predictive What is going to happen to the girl instantly after the observation?