Evaluating Exploratory Visualization Systems: A User Study on How Clustering-Based Systems Supporting Information Seeking from Large Document Collections

Liu, Y., Barlowe, S., Luo, D., Feng, Y., Yang, J., & Jiang, M. (2013). Understanding the role of clustering-based visualization in exploring large text collections. Information Visualization, 12(1), 25-43.

15 Pages Posted: 9 Jun 2012 Last revised: 22 Jun 2013

See all articles by Min Jiang

Min Jiang

University of North Carolina (UNC) at Charlotte

Yujie Liu

University of North Carolina (UNC) at Charlotte

Scott Barlowe

University of North Carolina (UNC) at Charlotte

Yaqin Feng

University of North Carolina (UNC) at Charlotte

Jing Yang

University of North Carolina (UNC) at Charlotte

Date Written: June 9, 2012

Abstract

Assisting iterative, opportunistic and evolving visual sensemaking has been an important research topic as information overload continues. Such exploratory systems (ESs) maximize users’ information gain through learning and have been widely used in scientific discovery and decision making contexts. Although many ESs have been developed recently, there is a lack of general guidance on how to evaluate such systems. Researchers are facing challenges such as understanding the underlying cognitive learning process of these systems. In this paper, we propose an evaluation framework designed specifically for ESs. The new framework is built based on cognitive load theory (CLT) and takes the user as well as the system as the focus of evaluation. With the thorough examination of users’ cognitive process, carefully designed procedures detangle the interwoven, interactive process of ESs as well as the variability that comes with human subjects. To demonstrate the usage of the framework, we present an evaluation conducted on Newdle, a clustering-based ES for large news documents. This study was a successful use case of the framework. It revealed how and why clustering-based ES benefited (or not) users in a variety of information seeking tasks. We also report the different information seeking strategies observed from the users and summarize leverage points for designing clustering-based ES.

Suggested Citation

Jiang, Min and Liu, Yujie and Barlowe, Scott and Feng, Yaqin and Yang, Jing, Evaluating Exploratory Visualization Systems: A User Study on How Clustering-Based Systems Supporting Information Seeking from Large Document Collections (June 9, 2012). Liu, Y., Barlowe, S., Luo, D., Feng, Y., Yang, J., & Jiang, M. (2013). Understanding the role of clustering-based visualization in exploring large text collections. Information Visualization, 12(1), 25-43. , Available at SSRN: https://ssrn.com/abstract=2080288 or http://dx.doi.org/10.2139/ssrn.2080288

Min Jiang (Contact Author)

University of North Carolina (UNC) at Charlotte ( email )

9201 University City Boulevard
Charlotte, NC 28223
United States

Yujie Liu

University of North Carolina (UNC) at Charlotte ( email )

9201 University City Boulevard
Charlotte, NC 28223
United States

Scott Barlowe

University of North Carolina (UNC) at Charlotte ( email )

9201 University City Boulevard
Charlotte, NC 28223
United States

Yaqin Feng

University of North Carolina (UNC) at Charlotte

9201 University City Boulevard
Charlotte, NC 28223
United States

Jing Yang

University of North Carolina (UNC) at Charlotte ( email )

9201 University City Boulevard
Charlotte, NC 28223
United States

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
92
Abstract Views
684
rank
307,909
PlumX Metrics