Developing a Systemic Framework for Evaluation Models and their Applications

Authors

  • Maria Alejandra Torres-Cuello
  • Luis Arturo Pinzon-Salcedo

Keywords:

reflexivity, marginalization, evaluation, framework, values, critical systems thinking

Abstract

The following paper presents the development of a systemic framework for the mapping of evaluation models, based on the reflective process that takes place when selecting an evaluation model and the study of processes of marginalization. For such purposes, several classifications proposed by various authors for systemic methodologies are taken into account. We should begin by stressing the importance of the concept of assessment or evaluation as it allows us to make judgements about the performance of organizations, projects, programs, staff and activities at different levels enabling the implementation of activities or actions to reduce the gap between the current state of a system and its desired state. These activities not only seek a gap reduction but are also oriented to process and human group sustainability through the achievement of best practices that will bring benefits in the long term. When selecting an evaluation model, the evaluator is usually based on the best-known features, such as the methods used, the research questions that it follows, and the kind of problems that could be targeted. However, as evaluation is entirely based on judgements, each assessment model necessarily has a set of underlying values that are rarely taken into account and should be aligned not only with the purpose for which the evaluation is done but also with the moral characterization of the problems it tackles. Such judgemental nature implies that any judgement must be based on a set of guiding principles, standards or ideals that determine the position of the object evaluated with respect to such values. An individual, which in this case is the evaluator, must carry out a reflective process to establish this set of elements. For this reason, this paper describes the development of a systemic framework that seeks to classify the various models of evaluation of projects, policies and programs according to the values underlying each of them considering their ethical bases. For the development of this framework we took into account the framework for the classification of systemic methodologies proposed by authors such as Burrell & Morgan, as well as the theory of “knowledge-constitutive interests” proposed by Jürgen Habermas and the context classification of a problem. The development of such a classification allows the individual that is conducting the evaluation to be able to select an appropriate and accurate methodology in accordance with the purpose for which the assessment will be carried out.

Published

2018-01-22