Research Data Leeds Repository

Comparing Category and Typicality Judgements for Spatial Prepositions

Citation

Richard-Bollans, Adam (2020) Comparing Category and Typicality Judgements for Spatial Prepositions. University of Leeds. [Dataset] https://doi.org/10.5518/873

This item is part of the Spatial Prepositions and Situated Dialogue collection.

Dataset description

Various accounts of cognition and semantic representations have highlighted that, for some concepts, different factors may influence category and typicality judgements. In particular, some features may be more salient in categorisation tasks while other features are more salient when assessing typicality. In experiment we explore the extent to which this is the case for the English spatial prepositions (`in', `inside', `on', `on top of', `over', `above', `under', `below' and `against'). We hypothesise that object-specific features --- related to object properties and affordances --- are more salient in categorisation, while geometric and physical relationships between objects are more salient in typicality judgements. In order to test this hypothesis we conducted a study using virtual environments to collect both category and typicality judgements in 3D scenes. The data collection framework is built on the Unity3D game development software, which provides ample functionality for the kind of tasks we implement. Two tasks were created for our study --- a Categorisation Task and a Typicality Task. In the Categorisation Task participants are shown a figure-ground pair (highlighted and with text description) and asked to select all prepositions in the list which fit the configuration. Participants may select `None of the above' if they deem none of the prepositions to be appropriate. In the Typicality Task participants are given a description and shown two configurations. Participants are asked to select the configuration which best fits the description. Again, participants can select none if they deem none of the configurations to be appropriate. The current dataset is from an online study where participants were recruited via internal mailing lists along with recruitment of friends and family. We have created 18 virtual 3D scenes each containing a single highlighted figure-ground pair. Four scenes each were created for `in', `on', `over' and `under' and these scenes were also shared with their respective geometric counterparts: `inside', `on top of', `above' and `below'. Two scenes were created for `against'. In the Typicality Task, participants compare scenes/configurations associated with the preposition given in the description. The study was conducted online and participants from the university were recruited via internal mailing lists along with recruitment of friends and family. Each participant performed first the Categorisation Task on 6 randomly selected scenes and then the Typicality Task on 15 randomly selected scenes, which took participants roughly 5 minutes. 30 native English speakers participated providing 180 annotations in the Categorisation Task and 447 annotations in the Typicality Task. As the study was hosted online, we first asked participants to show basic competence. This was assessed by showing participants two simple scenes with an unambiguous description of an object. Participants are asked to select the object which best fits the description. If the participant makes an incorrect guess in either scene they are taken back to the start menu.

Additional information:

Data is licensed under CC-BY; software under an MIT license. Correction: A minor error in the process_data.py file when reading the list of prepositions associated with annotations caused some inaccuracies when calculating and comparing annotator agreements. This has been corrected and the corresponding results have been updated. 10/11/2020

Keywords:

Spatial Prepositions, Semantics, Referring Expressions

Subjects:

I000 - Computer sciences > I400 - Artificial intelligence

Divisions:

Faculty of Engineering and Physical Sciences > School of Computing

Related resources: