Using Randomized Experiments as a Methodological and Conceptual Tool for Improving the Design of Online Learning Environments

9 Pages Posted: 21 Nov 2014

See all articles by Joseph Williams

Joseph Williams

National University of Singapore

Betsy Williams

Stanford University

Date Written: December 10, 2013

Abstract

Although there is often a convoluted pipeline from educational research to practice, a commonly touted benefit of MOOCs and online learning is the opportunity to bridge this gap. Drawing on theory and methodology from cognitive science and education research, this paper proposes that experimental comparisons – which evaluate how target learning outcomes are influenced by changing the components of an online resource – can play a special role in bringing together research and practice. Three examples of experiments in online environments (MOOCs) are presented and explained, spelling out the logic and considerations in embedding experiments in MOOCs. We also consider how and why the conceptual tool of experiment-focused design – considering hypothetical experiments during the process of designing online instruction – is valuable from a practical perspective, because it can guide decisions about instructional design, provides a basis for evidence-based improvements to students’ outcomes, and supports iterative improvement of online educational resources.

Suggested Citation

Williams, Joseph and Williams, Betsy, Using Randomized Experiments as a Methodological and Conceptual Tool for Improving the Design of Online Learning Environments (December 10, 2013). Available at SSRN: https://ssrn.com/abstract=2528211

Joseph Williams (Contact Author)

National University of Singapore ( email )

Singapore

HOME PAGE: http://www.josephjaywilliams.com/

Betsy Williams

Stanford University ( email )

Stanford, CA 94305
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
15
Abstract Views
251
PlumX Metrics