Planning and Implementing an EE Evaluation
Welcome to the Process of Evaluation
Excellent! You have decided to conduct an evaluation. Although
the task may initially seem daunting, an understanding of the steps involved can
make the entire process easier to manage. The Planning and Implementing section
is designed to walk you through all eight steps of the evaluation process, from
the initial pre-planning stages to the final step of improving your program.
Each step of the process has its own page (linked below & in the drop-down
box above) where you will find a description of what the step involves as well
as helpful tips from practitioners and links to relevant resources.
Before you dive head first into the process, however, you may find the
following overview of the evaluation process helpful. This description, which
explains how the steps fit together, will help you better understand the journey
upon which you’re about to embark.
Overview of Evaluation Phases and Steps
PHASE 1
Step 1: Before you get started...
Step 2: Clarify program logic
PHASE 2
Step 3: Set goals and indicators
Step 4: Choose design and tools
PHASE 3
Step 5: Collect data
Step 6: Analyze data
Step 7: Report results
Step 8: Improve program
Evaluation: Step by Step
Where do I start?
Is beginning your evaluation at Step 1 the appropriate thing to do? It depends on your situation. If you are already collecting data about your program– your evaluation has started! Steps 5 and 6, Collecting and Analyzing Data, list one, but not the only way, of organizing this part of the evaluation process. If you have explicit goals and objectives for your program, it way be appropriate to begin by identifying your evaluation goals and questions, Step 3. Evaluation is a cycle, and the entry point is not set. See what you have in hand, and start there.
We are constantly evaluating things in the world around us, but we usually do
so quite informally. We may be curious why something works the way it does,
what would make something better, or what we should do differently. Evaluating
your program is not all that different, though it will likely be more formal.
To make the process easier to understand, MEERA presents evaluation as a series
of steps that fit within three phases. These phases and their steps are meant to
help you with specific aspects of preparing for and conducting an evaluation.
While this may suggest a linear approach, the evaluation process is actually not
linear. Instead, it tends to be cyclical, as suggested by the diagram
below.

Figure: Phases of Evaluation
Phase 1: Understand Your Program
Developing a good understanding of how your program works and
identifying the resources you have for evaluation generally comes first. Step 1 (Before You Get Started) presents a number of important
issues for you to consider before you begin your evaluation, such as working
with staff and finding an evaluator. Step 2 (Clarify Program Logic) gets you thinking about the
rationale behind your program and what the program is expected to achieve in the
short and long-term. As you work through this phase, you will recognize how
Steps 1 and 2 are interlinked.
Phase 2: Plan Your Evaluation
Once you have critically reflected on your program and situation, you
can begin to develop your evaluation plan. Step 3 (Set Goals and Indicators) will help you create and
clarify your evaluation questions, and as part of Step 4 (Choose Design and Tools) you will identify how to
collect data to answer these questions. Similar to Phase 1, these steps
interact in a dynamic way. For example, the questions you choose will influence
how you design your evaluation. You may also find that some evaluation designs
are impractical due to limited time, resources and/or expertise, thus forcing
you to re-examine and revise your original questions.
Phase 3: Implement Your Evaluation
After you have identified the evaluation questions you want to answer,
the evaluation design to employ and the data collection instruments to use, you
can begin to think about how you will collect (Step 5) and analyze (Step 6) your data and report your results (Step 7). Your sources of data, as well as
the amount and type of data you collect will determine the conclusions you are
able to draw, which will in turn influence how you should share your findings.
If results are unclear or raise new questions, you may need to revisit Phase 2,
rethinking your design and tools, and collecting more data.
Improve Your Program (Step 8)
The final step of evaluation involves using evaluation results to
improve the program. This is the most critical and most overlooked step in the
evaluation process. Your evaluation results can help you decide to expand
successful activities, discontinue or modify those that are not working as well,
or take an entirely new approach to achieving a program goal. Findings from one
evaluation can even be used to initiate another evaluation. Results may give
rise to an improved model of your program’s logic, generating new evaluation
questions, and helping to kick off another cycle of evaluation and program
development, leading your program to achieve greater success.



