Episode studies

Episode studies are an excellent way of investigating the influence of research on policy.

Episode studies refer to a case study that focuses on a clear policy change and tracks back to assess what impact research had among the variety of issues that led to the policy change. They could be focusing on a single episode or comparative episodes. It differs from other case study approaches, which usually take an initiative as the starting point and look forward. 

Many studies of research impact take a particular piece of research as the starting point and then follow the various impacts of it forwards over time. This can be useful (see tools on research utilisation and bibliometric techniques), but tracking forward probably overemphasises the importance of research vis a vis other factors. The crucial advantage of using an episode or tracer study is that the process of working backwards in time gives a more realistic view of the broad range of factors – other than research – that influence policy.

Detailed outline of process

The first step is to identify a clear policy change.

The next step is to identify the key research questions related to the issue – generally regarding what influenced policy change and what was the relative role of research. This process could draw on the RAPID framework (archive link). 

Each episode study will need to construct a historical narrative leading up to the observed policy change in question. This involves creating a timeline of key policy decisions and practices, along with important documents and events, and identifying key actors.

The next step is to explore how and why those policy decisions and practices took place, and to assess the relative role of research in that process by drawing on the framework. In the RAPID episode studies, this was done through a variety of methods:

  • review of the literature 
  • interviews with key actors 
  • capturing the authors’ own experience 
  • discussions at workshops

Examples

The PRSP Initiative: Multilateral Policy Change and the Relative Role of Research: In September 1999, the World Bank and IMF adopted a new approach to aid – the Poverty  Reduction Strategy Papers (PRSP) initiative. A PRSP is a document that sets out an analysis of poverty in a country and defines the national strategy on how the government is going to reduce it. They are important because preparation of a PRSP by a low-income country is an eligibility criterion for debt relief and concessional lending from the World Bank and IMF. How did the idea of the PRSP come to be adopted? What was the role of research in this process – both ‘academic research in general and the ‘applied policy research’ within the World Bank and IMF? This episode study traces the emergence of the PRSP initiative and the various factors, including the role and relative influence of research, that contributed to this far-reaching policy shift.  

Advice for choosing this method

  • Since policy processes are complex, multi-layered and change over time, it is difficult to identify the key factors that caused policy to change (or not) and isolate the impact of research.
  • The standard challenges of unconscious selection of informants are common to case studies. There is a certain risk that actors may ‘re-write history’ after a time lapse of a few years, and in the light of the perceived failure or success of the policy in question.  
  • It is important to seek the views of a wide range of informed stakeholders. It is also important that the process of preparing an episode study is iterative; key facts and / or inconsistencies need to be cross-checked with key informants.

Advice for using this method

  • This method does not stand alone but requires experience with other data-gathering methods such as interviews, document review, focus groups etc.
  • For this method to be most effective, it requires a stakeholder workshop, bringing together various informants to analyse the data. Good facilitation skills are recommended.

Resources

This summary was produced for the RAPID programme of the Overseas Development Institute based on their experience of applying the approach to four case studies of policy change. The case studies were developed separately by their authors, but the same basic process was followed in each case and there were regular meetings to report and discuss the findings.

'Episode studies' is referenced in: