Using and Designing Platforms for in Vivo Educational Experiments

4 Pages Posted: 16 Sep 2015

See all articles by Joseph Williams

Joseph Williams

National University of Singapore

Korinn Ostrow

Worcester Polytechnic Institute (WPI)

Xioalu Xiong

Worcester Polytechnic Institute (WPI)

Elena Glassman

Massachusetts Institute of Technology (MIT)

Juho Kim

Massachusetts Institute of Technology (MIT) - MIT Computer Science and Artificial Intelligence Laboratory

Samuel Maldonado

San Jose State University

Na Li

Harvard University

Justin Reich

Massachusetts Institute of Technology (MIT) - Office of Digital Learning

Neil Heffernan

Worcester Polytechnic Institute (WPI)

Multiple version iconThere are 2 versions of this paper

Date Written: September 14, 2015

Abstract

In contrast to typical laboratory experiments, the everyday use of online educational resources by large populations and the prevalence of software infrastructure for A/B testing leads us to consider how platforms can embed in vivo experiments that do not merely support research, but ensure practical improvements to their educational components. Examples are presented of randomized experimental comparisons conducted by subsets of the authors in three widely used online educational platforms – Khan Academy, edX, and ASSISTments. We suggest design principles for platform technology to support randomized experiments that lead to practical improvements – enabling Iterative Improvement and Collaborative Work – and explain the benefit of their implementation by WPI co-authors in the ASSISTments platform.

Keywords: Intelligent tutoring system; MOOC; randomized controlled trial; A/B testing; crowdsourcing; collaborative work

Suggested Citation

Williams, Joseph and Ostrow, Korinn and Xiong, Xioalu and Glassman, Elena and Kim, Juho and Maldonado, Samuel and Li, Na and Reich, Justin and Heffernan, Neil, Using and Designing Platforms for in Vivo Educational Experiments (September 14, 2015). Available at SSRN: https://ssrn.com/abstract=2660609 or http://dx.doi.org/10.2139/ssrn.2660609

Joseph Williams (Contact Author)

National University of Singapore ( email )

Singapore

HOME PAGE: http://www.josephjaywilliams.com/

Korinn Ostrow

Worcester Polytechnic Institute (WPI) ( email )

100 Institute Road
Worcester, MA 01609
United States

Xioalu Xiong

Worcester Polytechnic Institute (WPI) ( email )

100 Institute Road
Worcester, MA 01609
United States

Elena Glassman

Massachusetts Institute of Technology (MIT) ( email )

77 Massachusetts Avenue
50 Memorial Drive
Cambridge, MA 02139-4307
United States

Juho Kim

Massachusetts Institute of Technology (MIT) - MIT Computer Science and Artificial Intelligence Laboratory ( email )

32 Vassar Street
Cambridge, MA 02139
United States

HOME PAGE: http://www.juhokim.com/

Samuel Maldonado

San Jose State University ( email )

San Jose, CA 95192-0066
United States

Na Li

Harvard University ( email )

1875 Cambridge Street
Cambridge, MA 02138
United States

Justin Reich

Massachusetts Institute of Technology (MIT) - Office of Digital Learning ( email )

77 Massachusetts Avenue
Cambridge, MA 02139
United States

Neil Heffernan

Worcester Polytechnic Institute (WPI) ( email )

100 Institute Road
worcester, MA 01609
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
20
Abstract Views
674
PlumX Metrics