Can You Tell If They're Learning? Using a Pedagogical Framework to Measure Pedagogical Activity
Posted: 14 May 2015
Date Written: April 24, 2015
Abstract
The proliferation of Web-based learning objects makes finding and evaluating online resources problematic. While established Learning Analytics methods use Web interaction to evaluate learner engagement, there is uncertainty regarding the appropriateness of these measures. In this paper we propose a method for evaluating pedagogical activity in Web-based comments using a pedagogical framework, and present a preliminary study that assigns a Pedagogical Value (PV) to comments. This has value as it categorises discussion in terms of pedagogical activity rather than Web interaction. Results show that PV is distinct from typical interactional measures; there are negative or insignificant correlations with established Learning Analytics methods, but strong correlations with relevant linguistic indicators of learning, suggesting that the use of pedagogical frameworks may produce more accurate indicators than interaction analysis, and that linguistic rather than interaction analysis has the potential to automatically identify learning behaviour.
Keywords: web-based learning, pedagogical frameworks, learning analytics, language analysis, MOOC, discussion forums
JEL Classification: I21
Suggested Citation: Suggested Citation