Layered Evaluation material

Layered evaluation of adaptive systems

This page contains material to assist authors in positioning their submissions in relation to the layered evaluation of adaptive systems approach, which will be summarized by the editors in an introductory article to the special issue. At this time, the material available includes prior publications and tutorials. In the future, draft versions of the introductory article will also be made available here for further reference.

The most recent paper on layered evaluation of adaptive systems, which will serve as a basis for the special issue's introductory article is:

The above paper represents an effort towards unifying previous proposals and approaches in the area. The following publications represent the main basis upon which the unified framework has built:

  • Weibelzahl, S., & Lauer, C. U. (2001). Framework for the evaluation of adaptive CBR-systems. In I. Vollrath, S. Schmitt & U. Reimer (Eds.), Experience Management as Reuse of Knowledge. Proceedings of the 9th German Workshop on Case Based Reasoning, GWCBR2001 (pp. 254-263). Baden-Baden, Germany. [PDF
  • Paramythis, A., Totter, A., & Stephanidis, C. (2001). A modular approach to the evaluation of Adaptive User Interfaces. In S. Weibelzahl, D. Chin & G. Weber (Eds.), Proceedings of the Workshop on Empirical Evaluations of Adaptive Systems, held in the context of the 8th International Conference on User Modeling (UM'2001), 13-17 July, Sonthofen, Germany (pp.9-24). Freiburg: Pedagogical University of Freiburg. [PDF
  • Brusilovsky, P., Karagiannidis, C., & Sampson, D. (2004). Layered evaluation of adaptive learning systems. International Journal of Continuing Engineering Education and Lifelong Learning, 14 (4/5), 402 - 421.

The layered evaluation framework by Paramythis & Weibelzahl was also briefly presented as part of the following tutorial:

  • Weibelzahl, S., Paramythis, A., & Masthoff, J. (2007). Tutorial on "Formative Evaluation Methods for Adaptive Systems". Tutorial no 4 in the 11th International Conference on User Modeling (UM 2007), Corfu, Greece, 25 - 29 June, 2007. [Slides in PDF]