Search

3447 results

Filter search results

Biophysical measurement
Biophysical measurement measures physical changes that take place over a period of time related to a specific indicator and using an accepted measurement procedure.
Method
Geographical
Capturing geographic information about persons or objects of interest such as the locations of high prevalence of a disease or the location of service delivery points.
Method
Control group
A control group is an untreated research sample against which all other groups or samples in the research is compared.
Method
Realist analysis of testable hypotheses
Realist analysis of testable hypotheses tests the program theory by developing a nuanced understanding of ‘what works for whom in what circumstances and in what respects, and how?’.
Method
Check dose-response patterns
Evaluators can examine the link between dose and response as part of determining whether the program caused the outcome.
Method
Check results match a statistical model
Program staff may develop a statistical model as part of the project theory design. Statistical models can be useful tools to predict elements of the program:
Method
Check results match expert predictions
Expert predictions can be a useful part of developing the program theory. Program staff can draw expert predictions from the literature or by engaging a group of experts.
Method
Check timing of outcomes
The program theory may predict the timing of outcomes for the evaluator to check against these dates with the dates of actual changes and outcomes.
Method
Key informant
Asking experts of programmes or in the community to predict what would have happened in the absence of the intervention.
Method
Searching for disconfirming evidence/following up exceptions
Treating data that doesn’t fit the expected pattern not as outliers but as potential clues to other causal factors and then seeking to explain them.
Method
General Elimination Methodology
General Elimination Methodology has two stages:
Method
Force field analysis
A force field analysis is used to support the decision making process by providing a detailed overview of the variety of forces that may be acting on an organisational change issue.
Method
Statistically controlling for extraneous variables
Statistically controlling for extraneous variables is an option for removing the influence of a variable on the study of program results.
Method
Ruling out technical explanations
Ruling out technical explanations involves identifying and investigating possible ways that the results might reflect technical limitations rather than actual causal relationships.
Method
Judgemental matching
Judgemental matching involves creating a comparison group by finding a match for each person or site in the treatment group based on researcher judgements about what variables are important.
Method
Difference-in-difference
Difference-in-difference involves comparing the before-and-after difference for the group receiving the intervention (where they have not been randomly assigned) to the before-after difference for those who did not.
Method
Sequential allocation
Sequential allocation involves creating a treatment group and a comparison group by using a sequence to choose participants (e.g. every 3rd person on the list).
Method
Statistically created counterfactual
A statistical model, such as regression analysis, is used to develop an estimate of what would have happened in the absence of an intervention.
Method
Numeric weighting
Numeric weighting involves developing numeric scales in order to rate performance against each evaluation criterion and then adding them up for a total score.
Method
Multi-criteria analysis
A multi-criteria analysis (MCA) is a form of appraisal that measures variables such as material costs, time savings and project sustainability as well as the social and environmental impacts in addition to monetary impacts.
Method
Qualitative weight and sum
Using qualitative ratings (such as symbols) to identify performance in terms of essential, important and unimportant criteria. "In QWS:
Method
Textual narrative synthesis
Dividing the studies into relatively homogenous groups, reporting study characteristics within each group, and articulating broader similarities and differences among the groups
Method
Meta-analysis
Meta-analysis is a statistical method for combining numeric evidence from experimental (and sometimes quasi-experimental studies) to produce a weighted average effect size.
Method
Rapid evidence assessment
Rapid Evidence Assessment is a process that uses a combination of key informant interviews and targeted literature searches to produce a report in a few days or a few weeks.
Method
Modus operandi
Interventions create distinctive/characteristic patterns of effects. Scriven describes the modus operandi as a set of footprints:
Method
Expert panel
Expert panels are used when specialized input and opinion is required for an evaluation.
Method
Logically constructed counterfactual
In some cases it is not possible to construct a counterfactual by creating a control group or a comparison group, but by constructing one logically.
Method
Postcards
Postcards can be used to collect information quickly, and they can also be used to provide a short report on evaluation findings (or an update on progress).
Method
Data dashboard
Stephen Few defines a dashboard as: "A data dashboard is a visual display of the most important information needed to achieve one or more objectives, with the data consolidated and arranged on a single screen so the informa
Method
Photographic reporting
Adding photographs to an evaluation report can make it more appealing to readers and also make the key messages more memorable.
Method
Poetry
When preparing an evaluation report, one way of communicating vividly the experience of participants, or the situation in which the program has been implemented, is to present some of the findings in the form of a poem.
Method
Plain language
Plain English is a clear and concise writing style that ensures accessibility to the information for all stakeholders.
Method