The user as wizard

A method for early involvement in the design and evaluation of adaptive systems

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

User testing tends to put participants in the role of the user. To evaluate complex systems (such as adaptive systems), a Wizard-of-Oz study may be used, where the role of the system is made easier by allowing somebody on the design team to perform part of it. In this paper, we propose a method whereby participants take the role of the system, allowing early user involvement in the design process. Participants¿ actions can inspire the design of adaptive algorithms, and their rationale can inspire evaluation criteria. We illustrate the method with a number of case studies.
Original languageEnglish
Title of host publicationFifth Workshop on User-Centred Design and Evaluation of Adaptive Systems
Subtitle of host publicationheld in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06)
EditorsStephan Weibelzahl, Alexandros Paramythis, Judith Masthoff
Pages460-469
Number of pages10
Publication statusAccepted/In press - 2006
EventFifth Workshop on User-Centred Design and Evaluation of Adaptive Systems, held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06), - Dublin, Ireland
Duration: 20 Jun 2006 → …

Conference

ConferenceFifth Workshop on User-Centred Design and Evaluation of Adaptive Systems, held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06),
CountryIreland
CityDublin
Period20/06/06 → …

Fingerprint

Adaptive systems
Adaptive algorithms
Large scale systems
Testing

Keywords

  • adaptive systems
  • user-centred design
  • personalization
  • evaluation

Cite this

Masthoff, J. (Accepted/In press). The user as wizard: A method for early involvement in the design and evaluation of adaptive systems. In S. Weibelzahl, A. Paramythis, & J. Masthoff (Eds.), Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems: held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06) (pp. 460-469 )

The user as wizard : A method for early involvement in the design and evaluation of adaptive systems. / Masthoff, Judith.

Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems: held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06). ed. / Stephan Weibelzahl; Alexandros Paramythis; Judith Masthoff. 2006. p. 460-469 .

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Masthoff, J 2006, The user as wizard: A method for early involvement in the design and evaluation of adaptive systems. in S Weibelzahl, A Paramythis & J Masthoff (eds), Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems: held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06). pp. 460-469 , Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems, held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06), , Dublin, Ireland, 20/06/06.
Masthoff J. The user as wizard: A method for early involvement in the design and evaluation of adaptive systems. In Weibelzahl S, Paramythis A, Masthoff J, editors, Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems: held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06). 2006. p. 460-469
Masthoff, Judith. / The user as wizard : A method for early involvement in the design and evaluation of adaptive systems. Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems: held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06). editor / Stephan Weibelzahl ; Alexandros Paramythis ; Judith Masthoff. 2006. pp. 460-469
@inproceedings{c97fd480e17b48b6b85f61ded4babc72,
title = "The user as wizard: A method for early involvement in the design and evaluation of adaptive systems",
abstract = "User testing tends to put participants in the role of the user. To evaluate complex systems (such as adaptive systems), a Wizard-of-Oz study may be used, where the role of the system is made easier by allowing somebody on the design team to perform part of it. In this paper, we propose a method whereby participants take the role of the system, allowing early user involvement in the design process. Participants¿ actions can inspire the design of adaptive algorithms, and their rationale can inspire evaluation criteria. We illustrate the method with a number of case studies.",
keywords = "adaptive systems, user-centred design , personalization, evaluation",
author = "Judith Masthoff",
note = "Proceedings of the Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems, held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06), Dublin, Ireland, June 20th, 2006",
year = "2006",
language = "English",
pages = "460--469",
editor = "Stephan Weibelzahl and Alexandros Paramythis and Judith Masthoff",
booktitle = "Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems",

}

TY - GEN

T1 - The user as wizard

T2 - A method for early involvement in the design and evaluation of adaptive systems

AU - Masthoff, Judith

N1 - Proceedings of the Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems, held in conjunction with the 4th International Conference on Adaptive Hypermedia & Adaptive Web-based Systems (AH'06), Dublin, Ireland, June 20th, 2006

PY - 2006

Y1 - 2006

N2 - User testing tends to put participants in the role of the user. To evaluate complex systems (such as adaptive systems), a Wizard-of-Oz study may be used, where the role of the system is made easier by allowing somebody on the design team to perform part of it. In this paper, we propose a method whereby participants take the role of the system, allowing early user involvement in the design process. Participants¿ actions can inspire the design of adaptive algorithms, and their rationale can inspire evaluation criteria. We illustrate the method with a number of case studies.

AB - User testing tends to put participants in the role of the user. To evaluate complex systems (such as adaptive systems), a Wizard-of-Oz study may be used, where the role of the system is made easier by allowing somebody on the design team to perform part of it. In this paper, we propose a method whereby participants take the role of the system, allowing early user involvement in the design process. Participants¿ actions can inspire the design of adaptive algorithms, and their rationale can inspire evaluation criteria. We illustrate the method with a number of case studies.

KW - adaptive systems

KW - user-centred design

KW - personalization

KW - evaluation

M3 - Conference contribution

SP - 460

EP - 469

BT - Fifth Workshop on User-Centred Design and Evaluation of Adaptive Systems

A2 - Weibelzahl, Stephan

A2 - Paramythis, Alexandros

A2 - Masthoff, Judith

ER -