Human Computer Interaction (CS408) VU
© Copyright Virtual University of Pakistan
Lecture 30. Evaluation – Part II
The aim of this lecture is to introduce you the study of Human Computer Interaction,
so that after studying this you will be able to:
• Understand the DECIDE evaluation framework
DECIDE: A framework to guide evaluation
Well-planned evaluations are driven by clear goals and appropriate questions (Basili
et al., 1994). To guide our evaluations we use the DECIDE framework, which
provides the following checklist to help novice evaluators:
1. Determine the overall goals that the evaluation addresses.
2. Explore the specific questions to be answered.
3. Choose the evaluation paradigm and techniques to answer the questions.
4. Identify the practical issues that must be addressed, such as selecting participants.
5. Decide how to deal with the ethical issues.
6. Evaluate, interpret, and present the data.
Determine the goals
What are the high-level goals of the evaluation? Who wants it and why? An
evaluation to help clarify user needs has different goals from an evaluation to
determine the best metaphor for a conceptual design, or to fine-tune an interface, or to
examine how technology changes working practices, or to inform how the next
version of a product should be changed.
Goals should guide an evaluation, so determining what these goals are is the first step
in planning an evaluation. For example, we can restate the general goal statements
just mentioned more clearly as:
• Check that the evaluators have understood the users’ needs.
• Identify the metaphor on which to base the design.
• Check to ensure that the final interface is consistent.
• Investigate the degree to which technology influences working practices.
• Identify how the interface of an existing product could be engineered to im-
prove its usability.
These goals influence the evaluation approach,