Effectiveness of collaborative map-based decision support tools: Results of an experiment

G.A. Arciniegas Lopez, R. Janssen, P. Rietveld

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

This article reports on the results of an empirical analysis of the effectiveness of a set of collaborative spatial decision support tools developed to support a land use allocation problem in a peat-meadow polder in the Netherlands. The tools feature spatial multicriteria analysis as the means to make spatially explicit trade-offs between stakeholder objectives in three different ways: as colors on multiple printed maps, qualitatively on a single digital map and quantitatively on a single digital map. An interactive mapping device is used as the interface between spatial information and participants. A series of controlled experiments was conducted with 30 participants, who were asked to use the tools and perform specific individual and group allocation tasks. Data on the responses of the participants were collected through questionnaires, observer notes, video film and multicriteria scores. The analysis focused on three aspects of effectiveness: usefulness of the tools; clarity of tool information; and impact on decisions. The findings of this analysis are discussed within the context of the information offered by the tools, individual and collaborative work of participants and the spatial and numerical quality of the resulting land use plans. From the experiments, it is clear that the cognitive effort related to the volume and format of information is a critical issue in spatial decision support. This holds true for both the level of detail per item of information and the amount of information to be supplied to the participants. Although the quantitative tool provided the most information, the participants did not consider this tool the most useful and it did not produce the best results. © 2012 Elsevier Ltd.
Original languageEnglish
Pages (from-to)159-175
Number of pages17
JournalEnvironmental Modelling & Software
Volume39
DOIs
Publication statusPublished - 2013

Fingerprint

experiment
Experiments
digital map
Land use
multicriteria analysis
empirical analysis
Peat
decision
meadow
peat
stakeholder
land use
Color
allocation
analysis
polder
land use plan
video

Cite this

@article{a2dfe049fe9d49c8879d51686c666fac,
title = "Effectiveness of collaborative map-based decision support tools: Results of an experiment",
abstract = "This article reports on the results of an empirical analysis of the effectiveness of a set of collaborative spatial decision support tools developed to support a land use allocation problem in a peat-meadow polder in the Netherlands. The tools feature spatial multicriteria analysis as the means to make spatially explicit trade-offs between stakeholder objectives in three different ways: as colors on multiple printed maps, qualitatively on a single digital map and quantitatively on a single digital map. An interactive mapping device is used as the interface between spatial information and participants. A series of controlled experiments was conducted with 30 participants, who were asked to use the tools and perform specific individual and group allocation tasks. Data on the responses of the participants were collected through questionnaires, observer notes, video film and multicriteria scores. The analysis focused on three aspects of effectiveness: usefulness of the tools; clarity of tool information; and impact on decisions. The findings of this analysis are discussed within the context of the information offered by the tools, individual and collaborative work of participants and the spatial and numerical quality of the resulting land use plans. From the experiments, it is clear that the cognitive effort related to the volume and format of information is a critical issue in spatial decision support. This holds true for both the level of detail per item of information and the amount of information to be supplied to the participants. Although the quantitative tool provided the most information, the participants did not consider this tool the most useful and it did not produce the best results. {\circledC} 2012 Elsevier Ltd.",
author = "{Arciniegas Lopez}, G.A. and R. Janssen and P. Rietveld",
year = "2013",
doi = "10.1016/j.envsoft.2012.02.021",
language = "English",
volume = "39",
pages = "159--175",
journal = "Environmental Modelling & Software",
issn = "1364-8152",
publisher = "Elsevier BV",

}

Effectiveness of collaborative map-based decision support tools: Results of an experiment. / Arciniegas Lopez, G.A.; Janssen, R.; Rietveld, P.

In: Environmental Modelling & Software, Vol. 39, 2013, p. 159-175.

Research output: Contribution to JournalArticleAcademicpeer-review

TY - JOUR

T1 - Effectiveness of collaborative map-based decision support tools: Results of an experiment

AU - Arciniegas Lopez, G.A.

AU - Janssen, R.

AU - Rietveld, P.

PY - 2013

Y1 - 2013

N2 - This article reports on the results of an empirical analysis of the effectiveness of a set of collaborative spatial decision support tools developed to support a land use allocation problem in a peat-meadow polder in the Netherlands. The tools feature spatial multicriteria analysis as the means to make spatially explicit trade-offs between stakeholder objectives in three different ways: as colors on multiple printed maps, qualitatively on a single digital map and quantitatively on a single digital map. An interactive mapping device is used as the interface between spatial information and participants. A series of controlled experiments was conducted with 30 participants, who were asked to use the tools and perform specific individual and group allocation tasks. Data on the responses of the participants were collected through questionnaires, observer notes, video film and multicriteria scores. The analysis focused on three aspects of effectiveness: usefulness of the tools; clarity of tool information; and impact on decisions. The findings of this analysis are discussed within the context of the information offered by the tools, individual and collaborative work of participants and the spatial and numerical quality of the resulting land use plans. From the experiments, it is clear that the cognitive effort related to the volume and format of information is a critical issue in spatial decision support. This holds true for both the level of detail per item of information and the amount of information to be supplied to the participants. Although the quantitative tool provided the most information, the participants did not consider this tool the most useful and it did not produce the best results. © 2012 Elsevier Ltd.

AB - This article reports on the results of an empirical analysis of the effectiveness of a set of collaborative spatial decision support tools developed to support a land use allocation problem in a peat-meadow polder in the Netherlands. The tools feature spatial multicriteria analysis as the means to make spatially explicit trade-offs between stakeholder objectives in three different ways: as colors on multiple printed maps, qualitatively on a single digital map and quantitatively on a single digital map. An interactive mapping device is used as the interface between spatial information and participants. A series of controlled experiments was conducted with 30 participants, who were asked to use the tools and perform specific individual and group allocation tasks. Data on the responses of the participants were collected through questionnaires, observer notes, video film and multicriteria scores. The analysis focused on three aspects of effectiveness: usefulness of the tools; clarity of tool information; and impact on decisions. The findings of this analysis are discussed within the context of the information offered by the tools, individual and collaborative work of participants and the spatial and numerical quality of the resulting land use plans. From the experiments, it is clear that the cognitive effort related to the volume and format of information is a critical issue in spatial decision support. This holds true for both the level of detail per item of information and the amount of information to be supplied to the participants. Although the quantitative tool provided the most information, the participants did not consider this tool the most useful and it did not produce the best results. © 2012 Elsevier Ltd.

U2 - 10.1016/j.envsoft.2012.02.021

DO - 10.1016/j.envsoft.2012.02.021

M3 - Article

VL - 39

SP - 159

EP - 175

JO - Environmental Modelling & Software

JF - Environmental Modelling & Software

SN - 1364-8152

ER -