Instructions for ParseGloss Evaluation

Purpose

We are doing a test of software to choose the most important words and phrases in a dictionary definition.

The goal of the research is to take these words and use what we learn to help people find information.

We would like your help to identify these words, in order to help test and refine our software.


Instructions

You will get 5 definitions to mark up.

1. Most important word or phrase

  1. Please choose what you consider the most important word or phrase that is essential to the definition. In other words, if a person said, "give me the heart of a definition," choose the word or words from the definition would you use. For example, given a definition:

    	car: a vehicle that has four wheels.

    You might say that the most important word to define "car" is "vehicle".


  2. Choose a word or phrase that appears in the definition. It will likely be easiest to copy the text (highlight, then press Ctrl-C), and then paste it in the correct box (click, and then press Ctrl-V).


  3. Some definitions will be very long. For example:

    	truck: a vehicle that has at least four wheels, excluding SUVs and
	non-commercial minivans, intended for use on paved roads, and often 
	used to transport cargo.

    In this case, you may choose to focus on the most pertinent portion (in this case, "vehicle").

2. Words and phrases of secondary importance

    We also need your help to decide what other words or phrases in the definition are important, but are less important.


  1. Please list as many of them as you want, and please list their relationship to the term being defined. For example, given (again):

    2. 	car: a vehicle that has four wheels.
    		Relationship: 	has
    		Word or phrase:	has four wheels

    A property of cars that distinguishes them from motorcycles is the phrase "has four wheels".


  2. Please only use a word or phrase directly from the definition. Again, please copy and paste.

  3. You may describe the relationship using any words (not just those from the definition).

  4. Please list as many as you can identify.

  5. Feel free to list any words or phrases that you can identify; the examples below are just suggestions.

Example 1 >>