Evaluation: Difference between revisions

From InfoVis:Wiki
Jump to navigation Jump to search
m moved resources to extra page
 
(One intermediate revision by the same user not shown)
Line 18: Line 18:


== Useful Resources ==
== Useful Resources ==
*[[Plaisant, Catherine|Catherine Plaisant]]: [http://hcil.cs.umd.edu/trs/2004-19/2004-19.pdf "The challenge of information visualization evaluation"]. AVI 2004: 109-116
see [[Evaluation and Usability Links]]
*A list of papers dealing with evaluation of InfoVis compiled by [[Bertini, Enrico|Enrico Bertini]]: http://www.dis.uniroma1.it/~beliv06/infovis-eval.html
 
*[[Komlodi, Anita H.|Anita Komlodi]] et al.: [http://www.research.umbc.edu/~komlodi/IV_evaluation_bibliography_Sep2005.pdf "Information Visualization Evaluation Review Bibliography"] with over 200 entries.
*[North, 2006] Chris North, Toward Measuring Visualization Insight, ''IEEE Computer Graphics and Applications'', p. 6-9, May/June 2006.


[[Category: Glossary]]
[[Category: Glossary]]

Latest revision as of 14:55, 20 September 2007

Evaluating InfoVis: Been There, Done That?

The purpose of visualization is insight. The purpose of visualization evaluation is to determine to what degree visualizations achieve this purpose.
[North, 2006]


The usefulness of an InfoVis tool is not as predictable as with ‘classic’ software problems, because of the remarkable influence of human reasoning processes on success in application. So even after participative design and faithful development the outcome has to be evaluated to a high extent.

Usability not only matters but may become vital due to the interactive and explorative nature of many tasks users will perform. Therefore on the one hand, one has to pay particular attention to usability questions in an iterative design process. On the other hand, a severe examination is also essential for the assessment of the InfoVis technique because of its interdependency with usability.

Ecological validity and external validity: looking for the gemstones.
As necessary it is to conduct ‘classic’ controlled experiments as essential is it to break out of laboratories and do some kind of field observation.In many cases this is the one and only way to evaluate the usefulness for the ‘real world’ and ensure ecological validity. The same applies to the question of generalization. Sometimes only other populations are able to decide for themselves whether a technique makes sense in their setting and for their data and tasks and thus allowing profound assessment of external validity.

Related Pages

Useful Resources

see Evaluation and Usability Links