Literature review on assessment models of the quality of training devices

Abstract

Assessing the quality of training devices is an ongoing and relevant research topic. It’s now more than ever an obvious necessity. However, the
literature review on the issue remains disparate and fragmented according to themes and across countries. Our research had a threefold
purpose: 1) to propose a review of the literature on assessment models of the quality of training devices; 2) identify assessment models that
are most often used; 3) to determine their key issues, strengths and limitations. Our methodological approach was based on two types of data:
(1) a set of empirical documents published over the last thirty years (guides and reports); and (2) an analysis of recent studies produced by
specialized research centers. Thus, we conducted three successive steps: 1) selection of documents on the basis of criteria such as relevance
and consistency; 2) extensive analysis of assessment models, using a validated analysis matrix that consists of four criteria: goals, issues,
strengths and limitations; 3) categorization of these models by transversal thematic analysis. At least 21 models have been generated. All have
more or less different characteristics. These models have been listed in a thematic classification into four distinct categories. Beyond this
classification, we retain two main conclusions. First, no model of them is exhaustive. Each model covers one or at most three dimensions of
quality of training device, and thus has limits. Secondly, the quality is complex and plural. Therefore, two approaches are recommended:
conceptual (systemic) and methodological (total triangulation). The first allows a combination of several assessment models to cover up
dimensions of a training device. The second allows multiple crossing between several actors (assessors), collection instruments and data
analysis tools to better describe the quality of training.

Keywords: Assessment models; quality; training device.