Evaluators play an important role in shaping and managing the evaluation as well as in interpreting its results. It is, therefore, critical to reflect on how to best identify, choose, and work with one of these individuals, regardless of whether the evaluator is internal to your organization or an external professional you will hire.

Table of Contents

Should I use an internal or external evaluator?
Where do I find external evaluators?
How do I choose an external evaluator?
How can I work effectively with my evaluator?

Return to: Step 1: Before You Get Started

Should I use an internal or external evaluator?

Whether you should use an internal or external evaluator depends on a number of factors such as the complexity of the evaluation, the resources available, and the type of relationship you expect the evaluator to have with program staff. The following resources:

1. Describe the responsibilities of an evaluator,
2. Help you determine whether your program is best suited for an internal or external evaluation, and
3. Help you determine what kind of evaluator you need based on your program goals.
   
   

• The Program Manager’s Guide to Evaluation, Chapter 4: How do you Hire and Manage an Outside Evaluator?
  US Department of Health and Human Services, Administration for Children and Families
  Beginner
  Two lists at the end of this document review the respective responsibilities of the evaluator and program manager. For example, the evaluator is typically responsible for training project staff on relevant evaluation techniques, while the program manager informs the evaluator about the program's operations, audience, staff, and about program changes.
  

• Selecting and Managing an Evaluation Consultant or Team (.pdf)
  International Development Research Center
  Beginner
  This resource presents the advantages and disadvantages of internal and external evaluators. A section titled “Selecting an external consultant or team” explains how the goals of the evaluation determine the qualities to look for in evaluators.

• A fundamental choice: Internal or External Evaluation? (.pdf)
  Conley-Tyler, M. (2005). Evaluation Journal of Australasia, 4(1&2): 3-11.
  Intermediate
  This article takes an in-depth look at the factors to consider when deciding between an internal or external evaluator. Table 1 on page 9 provides a comparison of internal and external evaluators according to each factor.

  
  

Where do I find external evaluators?

• The Program Manager’s Guide to Evaluation, Chapter 4: How do you Hire and Manage an Outside Evaluator?
  US Department of Health and Human Services, Administration for Children and Families
  Beginner Intermediate
  This document outlines the basic steps for finding an evaluator and lists resources for finding evaluators.

Evaluator Directories

Several organizations maintain online, searchable directories of evaluators. Please note that MEERA does not endorse any specific evaluator; it is your responsibility to contact the consultants or firms to decide whether or not they will meet your needs.

• The Registry of Outcome Evaluators
  U.S. Department of Education, What Works Clearinghouse
  Search by geographic region, individual/organization, target populations, or content area (including EE).

• Find an Evaluator
  American Evaluation Association
  Browse all listings or search by name, keyword, or geographic area.

• Directory of Evaluators
  The Evaluation Center, Western Michigan University
  Search by name, geographic location, and area of specialty (does not include EE).
  
  

How do I choose an external evaluator?

Once you have identified several potential evaluators, how do you determine who will best meet your needs? These resources offer qualifications and characteristics to look for and guidance for making an informed decision.

• Finding an Evaluator, an excerpt from Enhancing Education: A Producer's Guide
  Center for Public Broadcasting
  Beginner
  This short and simple excerpt has useful tips on choosing evaluators and a list of questions to ask potential evaluators. One question, for example, is "What evaluation approaches do you think would be best to help answer our evaluation questions?"
  

• How to work effectively with an evaluation consultant (.pdf)
  Financial Management Board Secretariat, Government of the Northwest Territories
  Beginner Intermediate
  This practical guide includes a discussion in Section B, “Finding and choosing your evaluation consultant,” as well as a sample decision-making model in Appendix 4.
  
  

How can I work effectively with my evaluator?

Smooth relationships with your evaluator make for an easier evaluation process and are likely to result in a higher quality evaluation. These resources explain how best to foster collaboration, prevent conflict, monitor progress, and provide on-going feedback.

• How to work effectively with an evaluation consultant (.pdf)
  Financial Management Board Secretariat, Government of the Northwest Territories
  Intermediate
  Section C, “Working effectively with your evaluation consultant” contains practical information on how to work with an evaluation consultant in several key areas: initial meeting, contract, project management, providing feedback, monitoring progress, payment, and deliverables.

• Hiring and Working with an evaluator
  Juvenile Justice Evaluation Center, 2001.
  Beginner
  Pages 7 – 9 of this user-friendly guide describe the steps involved in working with your external evaluator to develop an evaluation plan and specify the evaluation products. Page 9 is particularly useful. It explains how to maximize collaboration and prevent conflict.

• Evaluation Handbook
  W.F. Kellogg Foundation
  Beginner Intermediate
  In Chapter 5, Step 4, the “Working as an evaluation team” section (pp. 65-68) highlights the importance of good communication, providing several interesting examples of evaluation relationships and explanations of why they failed or succeeded, and explaining why.
  
  Return to: Step 1: Before You Get Started