We explore the theory and practice of evaluation and some of the key issues for informal and community educators, social pedagogues youth workers and others. Evaluation for education, learning and change theory and practice. Evaluation of four different learning theories and models. As a motivational the ory, reversal theory apter, 2007 posits human behavior as a ballet among various changing states and goals, so initiated by the circumstances satiation and needs of the individual. However, there are considerable challenges to program theory and not all evaluators are convinced it is useful 7. What is evaluation back to determining the evaluation question. Furthermore, 7 argues that sometimes referred to as program logic or theory of change it points to a variety of. Theorybased evaluations have helped open the black box of programmes.
The evaluation is designed to test the theory to see if it holds true. Evaluation is a relatively new field that has emerged from a diverse array of applied social sciences. The accountability root, which is prevalent in government evaluations, stems from the need to account for actions or resources used in programs. Canadian evaluation society annual learning event february 21, 2012 steve. Evaluation for education, learning and change theory and. Realist evaluation is a form of theorydriven evaluation, but is set apart by its explicit philosophical underpinnings. An introduction pdf 475 kb research methods paper 2. Theorybased programme development and evaluation in. This document is neither an exhaustive training program in theory based evaluation nor a. The perception and evaluation of visual art henrik hagtvedt university of georgia, athens reidar hagtvedt georgia institute of technology, atlanta vanessa m. All human service programs are designed to make a difference in the lives of people or to.
Evaluation also refers to the process of determining the worth or signi. Conclusions made in evaluations encompass both an empirical aspect and a normative aspect fournier, 2005. A wealth of approaches and an untapped potential marielle riche european commissioni have w e got closer t o ident if yi ng the ge nerati ve mechani sms that produce an outcom e f or th e lagging regi ons of t he. Patrick university of georgia, athens abstract visual art is a complex stimulus. Pdf theorybased evaluations have helped open the black box of. In behaviourist theory learning is a mechanical process of habit formation, by means of frequent reinforcement of a stimuli. Theory of change toc is a specific type of methodology for planning, participation, and evaluation that is used in companies, philanthropy, notforprofit and government sectors to promote social change. For example, the success of an allowancebased incentive program. Cognitive evaluation theory is a theory in psychology that is designed to explain the effects of external consequences on internal motivation. Evaluation theory as a concept components of a meaningful evaluation theory alkins evaluation theory tree sample evaluation theories program theory that brings theory to life in evaluations 10 the concept of evaluation theory and so we begin. Theorydriven evaluation or program theorydriven evaluation is a contextual or holistic assessment of a program based on the conceptual framework of program theory.
The first learning theory to be researched in the 19xxx, based on the work of pavlov and skinner, is known as the behaviourist theory. Program evaluation defined in characterizing and assessing evaluation approaches, the various kinds of activities conducted in the name of program evaluation were classified on the basis of their level of conformity to a particular definition of evaluation. If it does, the task of the evaluator is to produce a plausible case, with evidence, that shows what has. Social ecologic theory and goalsystems theory in mind and evaluated using mediation analysis, and the reaim framework. Managing authorities rarely have the capacities to define the best approach and. Alkin and christie 2004, through their evaluation theory tree, suggest that the roots of evaluation theory are grounded in accountability and systematic social inquiry. Theory based impact evaluation is not commonly used commonly. Theorybased stakeholder evaluation article pdf available in american journal of evaluation 3. Program theory and the evaluation of a program s theory have gained interest in the evaluation field. In cflat, we have been using theorybased approaches since 2000. There are a variety of evaluation designs, and the type of evaluation should match the development level of the program or program activity appropriately. It is one of the interesting realities of evaluation, that even after over 30 years of discussion and thought about this emerging discipline, most of the people doing evaluation still come from training other than as evaluators. This description helps to identify how the program should lead to the.
Cognitive evaluation theory of motivation simplified. Program theory and logic models 1 wilder research, august 2009 wilder research. Theory based approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in. An account is offered of the evolution of this persuasion, through the works of chen and rossi, weiss, and pawson and tilley.
There are several different approaches to theorybased evaluation. Interestingly, in none of the studies was the original theory completely right. Cognitive evaluation theory theory suggests that there are two motivation systems. Theory of change defines longterm goals and then maps backward to identify necessary preconditions. A theorybased evaluation is usually based on an explicit theory of change or logic model that explains.
Theorybased approaches for practical evaluation steve montague, partner steve. The trunk is built on a dual foundation of accountability and systematic social inquiry. Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidencebased practice. Multiple terms have been integrated into discussions of program theory development and evaluation including. Christie o ur evaluation theory tree is presented in figure 2. Coupling monitoring and evaluation to theory of change can bring a. There is a wealth of literature available on theorybased evaluation and impact evaluation tbe, but experts disagree on whether tbe is a common and clearly defined approach. Drawing on extant theory that the interplay of affect and cognition evoked by a stimulus drives evaluations. Program theory and logic models evaluation resources from wilder research. Evaluation theory and practice american university online. The investigators used a randomized controlled design to evaluate the effectiveness of the program. Theorybased evaluation tbe explores the how and why of program success or.
Thus, by a theorybased evaluation, we do not mean an evaluation based on a theory about evaluation. Realist evaluation is a form of theory driven evaluation, but is set apart by its explicit philosophical underpinnings. The dac working party on aid evaluation wpev has developed this glossary of key terms in evaluation and resultsbased management because of the need to clarify concepts and to reduce the terminological confusion frequently encountered in these a reas. Pdf clarifying the theorybased evaluation researchgate. In this article we share our evolving views on the points of connection and digression between the approaches based on our reading of the theorybased evaluation literature and our practice experience. Contents introduction context and causation in theorybased approaches theories of change and logic models theorybased approaches to evaluation. A theorybased evaluation of a program is one in which the selection of program features to evaluate is determined by an explicit conceptualization of the program in terms of a theory, a theory which attempts to explain how the program produces the desired effects. Theory of change explains the process of change by outlining causal linkages in an. Although it is practiceoriented, there has been a proliferation of research on evaluation theory to prescribe underlying frameworks of evidence based practice. It seeks to find out whether the theories on which the program is based are realized in action for further examples of tbes, see feindler et al. In cflat, we have been using theory based approaches since 2000.
When pte is implemented at a small project, staff may not have the time or skills to collect and analyze data in ways that either test the program theory or provide useful information to guide decisions and action. This booklet presents our understanding and use of theory of change. Theorybased approaches are a logic of enquiry, which complement and can be used in combination with most of the evaluation designs and data collection techniques outlined in. Cognitive evaluation theory cet is a theory in psychology that is designed to explain the effects of external consequences on internal motivation. Theorybased approaches to evaluation use an explicit theory of change to draw conclusions about whether and how an intervention contributed to observed results. Using theorybased approaches to evaluate causeeffect issues in.
Evaluation is based on empirical evidence and typically on social research methods, thus on the process of collecting and synthesizing evidence rossi lipsey and freeman, 2004. A theory of change can also be developed retrospectively by reading program documents, talking to. Examples of theories of change evaluations are found in carvalho and. Theorybased evaluation and types of complexity ulg. Applying program theorydriven approach to design and. This document is neither an exhaustive training program in theorybased evaluation nor a. Programs are usually very complex and frequently need effective program theory for evaluation. We mean rather, one based on a theory about how a program operates. The purpose of theorydriven evaluation is to provide information on not only the performance or.
In this monograph, evaluation means a study designed and conducted to assist. Glossary of key terms in evaluation and results based. Furthermore, the wellknown writers in the field of evaluation theory did not receive their formal education in a program designed to produce professional. Theorydriven evaluation methods branch of theory tree developed by sociologists huey chen and his advisor, peter rossi chens book published in 1990 normative theory prescriptive, what should be causative theory descriptive, what is research based. A theorybased evaluation is usually based on an explicit theory of change or logic model that explains the theory of a development intervention. Some think a common conceptual and operational understanding has been elusive, while others point to a completely consistent basic concept regardless of slight. Specifically, cet is a subtheory of selfdetermination theory that focuses on competence and autonomy while examining how intrinsic motivation is affected by external forces in a process known as motivational crowding out. Pawson and tilley 1997 developed the first realist evaluation approach, although other interpretations have been developed since.
826 401 1179 409 902 33 446 194 7 599 972 1439 1048 168 496 1511 507 212 1458 1143 604 109 1640 847 1445 70 1576 1576 1453 1099 46 1351 685 979 1437 467 1145 457 1084 1371 866 360 51 702 604 546