JUCS - Journal of Universal Computer Science 16(21): 3191-3209, doi: 10.3217/jucs-016-21-3191
Assessing the Learning Path Specification: a Pragmatic Quality Approach
expand article infoJosé Janssen, Adriana J. Berlanga§, Stef Heyenrath|, Harry Martens, Hubert Vogten, Anton Finders, Eelco Herder#, Henry Hermans, Javier Melero¤, Leon Schaeps, Rob Koper
‡ Open University of the Netherlands, Heerlen, Netherlands§ Open Universiteit Nederland, Heerlen, Netherlands| Logica, Maastricht, Netherlands¶ Open University in the Netherlands, Heerlen, Netherlands# L3S Research Centre, Hannover, Germany¤ Universitat Pompeu Fabra, Barcelona, Spain
Open Access
Abstract
Finding suitable ways to achieve particular learning goals is not an easy task, both in initial education and lifelong learning. To facilitate selection, personalisation and navigation of learning paths we propose to describe learning paths in a formal and uniform way by means of a learning path specification. This paper explains the rationale behind the Learning Path Specification. Based on a framework developed for the evaluation of the specification the paper describes a study that was carried out to establish pragmatic quality, i.e. whether stakeholders can understand and use the specification. The paper explores the relationship between the concepts pragmatic quality, usability, and desirability, and distinguishes first-order and second-order pragmatic quality, relating it to different stakeholders: software developers and end-users. First-order pragmatic quality of the Learning Path Specification was evaluated during the process of developing a tool that describes learning paths according to the specification: the Learning Path Editor. Second-order pragmatic quality was evaluated through workshop sessions with end-users involving some hands-on experiences with this tool. The paper describes adaptations made to the specification in the process of developing the Editor. End-user evaluations were quite positive, leading to one more adaptation.
Keywords
learning path specification, evaluation, pragmatic quality, usability, desirability