 |
Third Workshop on Empirical Evaluation of Adaptive Systemsin conjunction with AH2004 |
|
| Eindhoven University
of Technology, The Netherlands, August 23 - 26 |
||
Call for papers
|
Note: If you want to distribute or print this Call for Papers, you may want to refer to the PDF or the ASCII version. Quick index:
You are kindly invited to contribute to the Third Workshop on Empirical Evaluation of Adaptive Systems, which follows in the tracks of two very successful workshops held in conjunction with UM2001 and UM2003. This workshop intends to explore methods and criteria that can be employed in assessing (interactive) adaptive systems. The perspective taken is that a build-up of knowledge in this direction can serve as a driving force in facilitating and fostering detailed empirical studies with significant results in the field of user modeling something lacking from the literature today. The workshop seeks to cover a wide range of application domains and user modeling techniques and aims to both raise awareness of researchers and practitioners in the area, as well as contribute towards a widely accepted evaluation "toolset" for adaptive systems. Background and MotivationOnly few publications on user modeling systems report significant evaluation results. One of the reasons that have been identified to be responsible for this lack is that both methods and criteria for assessing the "success" of adaptation are not clear. However, user modeling systems are designed for human-computer interaction and thus, empirical approaches for such assessment are absolutely necessary in order to justify the efforts required to render systems adaptive. This is the third workshop on empirical evaluation of adaptive systems. The workshop's guiding perspective is that adequate methods and reliable criteria are prerequisites towards increasing the quantity and quality of evaluation studies on adaptive systems. The workshop aims to contribute to the exploration and discussion of suitable methods and criteria in various domains with differing user modeling and adaptation techniques. It further aims to encourage researchers to perform evaluation studies with their own adaptive hypermedia systems. QuestionsThe workshop, continuing in the steps of its predecessor, will focus on the following questions:
Goals and Workshop FormatThe goals of this workshop are, on the one hand, to consolidate existing knowledge in the area of adaptive hypermedia system evaluation, and, on the other hand, to provide researchers and practitioners in the field with a set of "tools" and guidelines, which could foster future work and facilitate a more homogeneous view of related evaluation activities. The format of the workshop will be such as to facilitate goal-oriented discussions; specifically, there will be short presentations of the accepted papers, followed by group discussion (among the workshop participants). The workshop will be organized around the research questions above, i.e., submissions are to be evaluated in regard to their contribution to the questions, and the discussion during the workshop will be structured around the questions. Participants of the workshop are expected to share their experiences and discuss the issue of what constitutes good and bad practice in studies targeting adaptive systems. Two types of submissions will be solicited to achieve this goal: studies and position-papers. Each study will be discussed in terms of experience gathered. The submission of "unsuccessful studies" is explicitly encouraged, as these can be very informative for other participants. During the workshop we will work towards a list of recommendations for the performance of an evaluation study. Position-papers will be solicited mainly in relation to the second and third questions above. Authors of such papers are expected to build upon related experience to discuss and propose either new (or, reworked existing) metrics for adaptation, or, perhaps more interestingly, address the issue of why related studies in the literature are so few and mostly uninformative. The topics to be raised by the authors will be integrated in (and, hopefully, enrich) the aforementioned study-based workshop discussions. Submission FormatAs stated above, each submission is required to address at least one of the main workshop questions. Fulfillment of this requirement will be assessed in the course of the review process. Submissions should not exceed 10 pages and should be formatted according to the Springer LNCS guidelines. Please refer to the submission section for more information on the submission format. Workshop papers will be published in full length in the workshop proceedings and presented in talks at the workshop. Please, submit your paper by e-mail to ah2004-workshop@easy-hub.org until Friday May 28th, 2004. Portable Document Format (*.pdf) and Postscript (*.ps) files are preferred. Important dates
Program CommitteePeter Brusilovsky, University of Pittsburgh, USA OrganizersDr. Stephan Weibelzahl
Note: If you want to distribute or print this Call for Papers, you may want to refer to the PDF or the ASCII version. |
||||||||||||||||
|
|||||||||||||||||
