Collaborative, participatory, and empowerment (CP&E) evaluation
Section
Instructions: Clicking on the section name will show / hide the section.
Course description
COURSE REQUIREMENTS
- To have passed all courses of engineering degree or other higher education degrees.
- To know and master the specific skills of projects or to be familiar with the environment of development projects
- To
have completed or be pursuing the following subjects of the Master in
Rural Development and Sustainable Management Project Planning
- Evaluation designs: methods and tools
COURSE DESCRIPTION
This course deals with the collaborative, participatory and empowerment approaches to evaluation in the rural development projects and programs. The main contents of this course are:
- Importance and relevance of the evaluation of rural development projects and programs
- Review of evaluation concepts and methodologies
- Collaborative and Participatory evaluation
- Empowerment Evaluation methodology and its different application contexts
- Ethnography, culture and management of focus groups as 3 key tools for CP&E Evaluation
- Empowerment the different actors of development projects through evaluation
COMPETENCES
The main objective of this course is to go further in the knowledge of evaluation methodologies that are based on knowledge of the actors and on the organizational learning. The course is highly practical oriented and teaching methodology is based on the materials with a direct application to the real world of evaluation.
Transversal Competencies
- The student participates in activities with interest in strengthening their knowledge
- The student is capable of empathy in the study of the situation of the different actors in the development process
- The student is capable of constructive criticism and self-critical responsibility
Specific Competencies
- The student is able to recognize the key-aspects of different methodologies and apply them to real cases and different contexts
- The student is able to understand the motivations of each model and its positive aspects
- The student understands the conflicts and how they develop participatory processes in different cases
- The student knows how to identify and involve different social groups and stakeholders in the evaluation of development projects
- The student has learned to identify, assess and take into account human, social and environmental factors that affect and are affected by the rural development project
- The student understands the role of evaluation in the integrated approach to rural development projects, and is also able to apply the most appropriate methodology according to the context
- The student is able to manage changes and the evolution of projects through the evaluation tools and the methodological resources acquired to involve all project stakeholders
TEACHING MATERIAL
Teaching is based on the following materials:
- Group work in the classroom. It will be the main teaching method. The students have already studied the course about evaluation methodologies, so that classes will focus on the practice of these methodologies to strengthen these concepts in its development through the study of real cases. All theoretical sessions will be complemented with the case study methodology
- Lectures in class. About the theoretical aspects of the course
- Each session will have additional resources that will be available through the web
- Students will complete several self-assessment exercises using different methodologies as the practical activities of the course
- Students will make a final presentation on a topic related to the different methodologies for carrying out an evaluation
EVALUATION ACTIVIVTIES OR PRACTICAL TASKS
The evaluation of the course will take into account the following items according to a defined percentage:
- 40% Evaluation of the knowledge acquired by the student through on-line and class-room questioners
- 25% Tasks performed by the student
- 25% Evaluation of presentations about the tasks
- 10% Student’s participation
Program
- Session I: Evaluation expansion and utilization in projects and programs
- Session II: Evaluation Models
- Session III: Collaborative and Participatory Evaluation
- Session IV: Empowerment Evaluation
- Session V: Ethnography as a key tool for CP&E Evaluation
- Session VI: Across cultures and ethnic groups in CP&E Evaluation
- Session VII: Moderating meaningful focus groups in CP&E Evaluation
Bibliography
LN-1 - Evaluation expansion and utilization in projects and programs
Fetterman, D. & Cazorla, A. (2007). Empowerment Evaluation: Metodologías para el seguimiento de programas y proyectos. UPM-Stanford
LN-2 - Evaluation Models
Patton, M.Q. (2008). Utilization-Focused Evaluation (4th edition). SAGE Publications
Link to Google books (3rd edition)
Stufflebeam, D.L. & Shinkfiel, A.J. (2007). Evaluation theory, models, and applications. Jossey-Bass
Link to Google books
LN-3 – Participatory Evaluation
Rodríguez-Campos, L. (2005). Collaborative Evaluations: A Step-by-step Model for the Evaluator. Llumina Press
Link to Google books
LN-4 - Empowerment Evaluation
Fetterman, D. & Wandersman, A. (2005). Empowerment Evaluation Principles in Practice. Guildford Press.
Link to Google books
Fetterman, D.M. (2001). Foundations of Empowerment Evaluation. SAGE Publications
Link to Google books
LN-5 - Ethnography as a key aspect in CP&E Evaluation
Fetterman, D. (2010). Ethnography: step-by-step. SAGE Publications
Link to Google books
LN-7 - Moderating meaningful focus groups in CP&E Evaluation
Kahle, R.W. (2007). Dominators, Cynics, and Wallflowers. Practical Strategies for Moderating Focus Groups. Paramount Market Publishing, Inc.
Link to Google books
Krueger, R.A. (1998). Moderating Focus Groups. SAGE Publications
Link to Google books
Lecture notes
- Presentation 1 (PDF)
Evaluation expansion and utilization in projects and programs - Presentation 2 (PDF)
Evaluation models - Presentation 3 (PDF)
Collaborative and Participatory Evaluation - Presentation 4 (PDF)
Empowerment Evaluation - Presentation 5 (PDF)
Ethnography and the human instrument as a key tool for CP&E Evaluation - Presentation 6 (PDF)
Across cultures and ethnic groups in CP&E Evaluation - Presentation 7 (PDF)
Moderating meaningful focus groups in CP&E Evaluation
- Presentation 1 (PDF)
Compulsory reading
LN-1 - Evaluation expansion and utilization in projects and programs
CR-1 - Díaz‐Puente, J.M. & Vidueira, P. (2012). Evaluation as an instrument for territorial development. Cuadernos de Desarrollo Rural, forthcoming (PDF)
LN-3 – Participatory Evaluation
CR-3 - Fetterman, D.M. (2006). About the value of evaluation, collaboration and empowerment given scarce resources and the need to have local buy in. Lecture at the conference “Empowerment Evaluation Tools to Inform Decision Making and Strategic Planning” in Madrid (PDF)
LN-4 - Empowerment Evaluation
CR-4 -Fetterman, D.M. Empowerment Evaluation Workshop Slides (English). FETTERMAN & ASSOCIATES. Retrieved at http://www.davidfetterman.com/ (PDF)
CR-4 - Fetterman, D.M. (2006). Empowerment Evaluation. A participatory tool to help accomplish programmatic objectives. Lecture at the conference “Empowerment Evaluation Tools to Inform Decision Making and Strategic Planning” in Madrid (PDF)
CR-4 - Fetterman, D.M. and Wandersman, A. (2007). Empowerment Evaluation Yesterday, Today, and Tomorrow. American Journal of Evaluation, 28 (2), 179-198 (Link)
LN-6 - Across cultures and ethnic groups in CP&E Evaluation
CR-6 - Fetterman, D.M. and Díaz-Puente, J.M. (2012). Empowerment Evaluation Cross-culturally: Guiding Theories, Principles, and Concepts in Spain and the United States, in A. Cazorla & J. Midgley “Rural Development as Working with People”. Berkeley-UPM, forthcoming (PDF)
Futher materials
LN-2 - Evaluation Models
FM-2 - Ray, C. (2000). Endogenous socio-economic development in the European Union ― issues of evaluation. Journal of Rural Studies, 16, 447-458 (Link)
LN-3 – Participatory Evaluation
FM-3 - The Collaborative, Participatory & Empowerment Evaluation TIG of the American Evaluation Association:
http://comm.eval.org/cpetig/home/
FM-3 - Collaborative Evaluations. A Step-by-Step model for the evaluator:
http://www.collaborative-evaluations.com/english.htmlLN-4 - Empowerment Evaluation
FM-4 - Smith, M.K. (1998). Empowerment Evaluation: theoretical and methodological considerations. Evaluation and Program Planning, 21 (3) 255–261 ( Link)
FM-4 - Steps of empowerment evaluation From California to Cape Town. Fetterman, D.M. (1994). Steps of empowerment evaluation: From California to Cape Town. Evaluation and Program Planning, 17 (3) 305–313 ( Link)
Empowerment Evaluation Controversy
FM-4 - Patton, M.Q. (1997). Toward Distinguishing Empowerment Evaluation and Placing it in a Larger Context. Evaluation Practice, 18 (2), 147-163 (Link)
FM-4 - Patton, M.Q. (2005). Toward Distinguishing Empowerment Evaluation and Placing It in a Larger Context: Take Two. American Journal of Evaluation, 26 (3), 408-414 ( Link)
FM-4 - Fetterman, D.M. (2005). In Response to Drs. Patton and Scriven. Empowerment Evaluation Focusing on the Issues. American Journal of Evaluation, 26 (3), 418-420 (Link)
FM-4 - Wandersman, A. and Snell-Johns, J. (2005). Empowerment Evaluation. Clarity, Dialogue, and Growth. American Journal of Evaluation, 26 (3), 421-428 ( Link)
FM-4 - Patton, M.Q. (2005). Patton Responds to Fetterman, Wandersman, and Snell-Johns. American Journal of Evaluation, 26 (3), 429-430 ( Link)
Conference “Empowerment Evaluation Tools to Inform Decision Making and Strategic Planning”. Madrid, 2006
Presentation: Video
José Eugenio Mantínez Falero. Economy and politics in Spain: Challenges: Video
José María Díaz Puente: Evaluation Culture Expansion in a World-wide Context: Video
David Fetterman: Empowerment Evaluation. A participatory tool to help accomplish programmatic objectives (CR-4): Video
Adolfo Cazorla: Evaluation and Planning as social learning: Video
Juanjo de Gracia: The role of evaluation in the political framework: Video
David Fetterman: About the value of evaluation, collaboration and empowerment given scarce resources and the need to have local buy in (CR-3): Video
David Fetterman Workshop: Video
David Fetterman Workshop II (results): Video
Benjamín Figueroa: Video
Case Study
FM-4 - Fetterman, D.M. (2009). Empowerment evaluation at the Stanford University School of Medicine: using a critical friend to improve the clerkship experience. Avaliação e Políticas Públicas em Educação, 17 (63) 197-204 (Link)
Book Reviews
FM-4 - Miller, R.L. (2005). Book review: Empowerment Evaluation Principles in Practice, Edited by David M. Fetterman and Abraham Wandersman, Reviewed by Robin Lin Miller. Evaluation and Program Planning, 28 (3), 317–319 ( Link)
FM-4 - Chatterji, M. (2001). Book review: Foundations of empowerment evaluation: David M. Fetterman. Sage, Thousand Oaks, CA, 2001. Evaluation and Program Planning, 24 (4) 363–365 ( Link)
Other materials
David Fetterman’s blog:
http://www.davidfetterman.com/
Empowerment Evaluation blog:
http://eevaluation.blogspot.com/
David Fetterman - AEA Ignite:
Empowerment evaluation from Wikipedia, the free encyclopedia:
http://en. wikipedia.org/wiki/Empowerment_evaluation
Authors of material
José María Díaz Puente
Associated Professor of Rural Development & Evaluation at the Technical University of Madrid
José M. Díaz Puente received his undergraduate degree in Engineering at the Technical University of Madrid in 1998. That year he joined the Program for Research Training of the Madrid Region, and completed his education and research training in the Technical University of Madrid (Projects and Rural Planning Department), UC Berkeley (Institute of Urban and Regional Development), and Stanford University (Policy Analysis and Evaluation Unit). His line of research is focused on participatory methodologies for planning, evaluation and management of public policies, programs and projects, specially, with regard to rural and socioeconomic development. In 2003 he received his graduate degree at the Technical University of Madrid and won the Europe Award for the contributions of his thesis to the development and evaluation of the European policies. During the period 2005-2007 he enjoyed a Fulbright Scholarship to work at Stanford University and do research on evaluation topics. He has presented more than thirty papers in scientific national and international conferences; he has organized conferences with international experts on evaluation and planning of public policies in Europe and USA; he has been invited to lecture in universities such as Harvard or Stanford, in Government institutions in countries like Spain, México or Poland, or in professional associations such as the American Evaluation Association. He is the author of scientific publication in international journals like Community Development Journal, American Journal of Evaluation, Evaluation Review, European Planning Studies, Agrociencia, o Estudios Geográficos.
He has carried out many teaching activities in the University of Antonio de Nebrija, and the Technical University of Madrid in Spain; Stanford University in USA; and Colegio de Postgraduados in México. At present he is professor of undergraduate and graduate courses in the Technical University of Madrid (in topics related to planning, management and evaluation of development programs), and he is professor in the international Master Degree Program on Rural Development of the Erasmus Mundus Programme of the European Commission. In this Master he gives a 30 hours course (in Spanish or English) for the professional training in the evaluation of development programs and projects. It is a very practical oriented course and enables the students to acquire hands-on experience in the design of their own evaluations and in the use of more than 60 evaluation tools.
He has been certified as a Project Management Director by IPMA (International Project Management Association) and has cooperated with governments, universities and firms in the framework of planning and evaluation of different public policies at the regional, national, European and international level. He has led the design of many socioeconomic programs at the local, regional and national level, as well as many evaluations at international and European level in the framework of the Consultative Group on International Agricultural Research (CGIAR) and the European Commission. He has been adviser of the regional government of Madrid and the national government of Mexico in planning and evaluating regional and rural development. He is a member of the Editorial Board of the Spanish Journal of Agricultural Research, reviewer of the American Journal of Evaluation and European Planning Studies; and member of the Research Group GESPLAN, the Spanish Evaluation Society, the Spanish Association of Project Engineering, the American Evaluation Association, and the European Evaluation Society.
Contact information:
José M. Díaz Puente; Universidad Politécnica de Madrid, Escuela Técnica Superior de Ingenieros Agrónomos, Departamento de Proyectos y Planificación Rural, Avenida de la Complutense s/n, Madrid 28040, Spain; e-mail: jm.diazpuente@upm.es; phone number: (+34) 91 336 3986; web: https://ruraldevelopment.es/index.php/es/