Selection Bias and the Evaluation of Distance Classes: Comparing Traditional and On-Line Economics Course Outcomes

30 Pages Posted: 15 May 2003

See all articles by Jeff Anstine

Jeff Anstine

North Central College - Department of Management

Mark Skidmore

Michigan State University - Department of Agricultural Economics

Date Written: March 2003

Abstract

This research examines whether MBA students at a regional, comprehensive university taking completely on-line courses learn as much as students taking identical classes in the traditional, face-to-face format. The courses were an introductory statistics class and a managerial economics class, one of each taught in the traditional format and one of each taught completely on-line. We examine average test scores and value-added (average test scores minus a pre-test score given at the beginning of each class). A simple comparison of test scores indicates that learning outcomes are similar in the two formats. However, controlling for other factors that determine outcomes, regression analysis shows that outcomes in the on-line environment are inferior to the traditional format with respect to the amount of material learned. Given that the choice to take a course in the on-line environment may be related to outcomes, we also use a two stage least squares technique and a switching regression model with endogenous switching to control for potential sample selection bias. The two stage least squares analysis yields findings similar to ordinary least squares estimation. The switching regression analysis shows that students in the on-line class would have learned as much as the students in the traditional class had they chosen that format. However, if students in the traditional class had taken the class in the on-line format they would have not performed as well as the students who actually chose the on-line learning environment.

JEL Classification: A2

Suggested Citation

Anstine, Jeff and Skidmore, Mark L., Selection Bias and the Evaluation of Distance Classes: Comparing Traditional and On-Line Economics Course Outcomes (March 2003). Available at SSRN: https://ssrn.com/abstract=390800

Jeff Anstine

North Central College - Department of Management ( email )

Naperville, IL
United States
(262) 472-1776 (Phone)
(262) 472-4863 (Fax)

Mark L. Skidmore (Contact Author)

Michigan State University - Department of Agricultural Economics ( email )

East Lansing, MI 48824
United States

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
95
Abstract Views
1,254
rank
302,078
PlumX Metrics