Search
3447 results
Filter search resultsParticipant observation
Participant observation is used to identify the attitudes and operation of a community by a researcher living within its environs.MethodTransect
Transect walks are a method for gathering spatial data on an area by observing people, surroundings and resources while walking around an area or community.MethodField trips
Field trips are organised trips where participants visit physical sites.MethodBiophysical measurement
Biophysical measurement measures physical changes that take place over a period of time related to a specific indicator and using an accepted measurement procedure.MethodGeographical
Capturing geographic information about persons or objects of interest such as the locations of high prevalence of a disease or the location of service delivery points.MethodControl group
A control group is an untreated research sample against which all other groups or samples in the research is compared.MethodRealist analysis of testable hypotheses
Realist analysis of testable hypotheses tests the program theory by developing a nuanced understanding of ‘what works for whom in what circumstances and in what respects, and how?’.MethodCheck dose-response patterns
Evaluators can examine the link between dose and response as part of determining whether the program caused the outcome.MethodCheck results match a statistical model
Program staff may develop a statistical model as part of the project theory design. Statistical models can be useful tools to predict elements of the program:MethodCheck results match expert predictions
Expert predictions can be a useful part of developing the program theory. Program staff can draw expert predictions from the literature or by engaging a group of experts.MethodCheck timing of outcomes
The program theory may predict the timing of outcomes for the evaluator to check against these dates with the dates of actual changes and outcomes.MethodKey informant
Asking experts of programmes or in the community to predict what would have happened in the absence of the intervention.MethodSearching for disconfirming evidence/following up exceptions
Treating data that doesn’t fit the expected pattern not as outliers but as potential clues to other causal factors and then seeking to explain them.MethodGeneral Elimination Methodology
General Elimination Methodology has two stages:MethodForce field analysis
A force field analysis is used to support the decision making process by providing a detailed overview of the variety of forces that may be acting on an organisational change issue.MethodStatistically controlling for extraneous variables
Statistically controlling for extraneous variables is an option for removing the influence of a variable on the study of program results.MethodRuling out technical explanations
Ruling out technical explanations involves identifying and investigating possible ways that the results might reflect technical limitations rather than actual causal relationships.MethodJudgemental matching
Judgemental matching involves creating a comparison group by finding a match for each person or site in the treatment group based on researcher judgements about what variables are important.MethodDifference-in-difference
Difference-in-difference involves comparing the before-and-after difference for the group receiving the intervention (where they have not been randomly assigned) to the before-after difference for those who did not.MethodSequential allocation
Sequential allocation involves creating a treatment group and a comparison group by using a sequence to choose participants (e.g. every 3rd person on the list).MethodStatistically created counterfactual
A statistical model, such as regression analysis, is used to develop an estimate of what would have happened in the absence of an intervention.MethodNumeric weighting
Numeric weighting involves developing numeric scales in order to rate performance against each evaluation criterion and then adding them up for a total score.MethodMulti-criteria analysis
A multi-criteria analysis (MCA) is a form of appraisal that measures variables such as material costs, time savings and project sustainability as well as the social and environmental impacts in addition to monetary impacts.MethodQualitative weight and sum
Using qualitative ratings (such as symbols) to identify performance in terms of essential, important and unimportant criteria. "In QWS:MethodTextual narrative synthesis
Dividing the studies into relatively homogenous groups, reporting study characteristics within each group, and articulating broader similarities and differences among the groupsMethodMeta-analysis
Meta-analysis is a statistical method for combining numeric evidence from experimental (and sometimes quasi-experimental studies) to produce a weighted average effect size.MethodRapid evidence assessment
Rapid Evidence Assessment is a process that uses a combination of key informant interviews and targeted literature searches to produce a report in a few days or a few weeks.MethodModus operandi
Interventions create distinctive/characteristic patterns of effects. Scriven describes the modus operandi as a set of footprints:MethodExpert panel
Expert panels are used when specialized input and opinion is required for an evaluation.MethodLogically constructed counterfactual
In some cases it is not possible to construct a counterfactual by creating a control group or a comparison group, but by constructing one logically.MethodPostcards
Postcards can be used to collect information quickly, and they can also be used to provide a short report on evaluation findings (or an update on progress).MethodData dashboard
Stephen Few defines a dashboard as: "A data dashboard is a visual display of the most important information needed to achieve one or more objectives, with the data consolidated and arranged on a single screen so the informaMethod