Research Methodology
Research in Real Time
Spotlight is the research series of the Community Impact Policy Institute, the thinktank and research arm of Fedcap, and its approach is one we call Research in Real Time. Rather than studying complex social and economic challenges only through aggregate data or after the fact analysis, Spotlight follows them into communities to understand how they are experienced, how communities respond, and which solutions show the greatest potential to make a difference.
Our Unit Analysis
The person, and the trajectory a person travels
A Mixed Methods Approach
Quantitative Evidence
We draw on
Government statistics
Published datasets
Fedcap UK outcome data
Purpose[1]
Establish scale and trends.
Triangulation
We continuously triangulate interview material with administrative and programme data.
Qualitative Evidence
We conduct in-depth, purposive, semi-structured and probing interviews with:
Customers of the interventions
Service users
Frontline delivery staff
Local partners
Elected representatives
Purpose
Explain the nuances numbers cannot.
How We Work
Community by Community
We begin in individual communities. This is the scale at which the work is done.
Multiple Vantage Points
Each trajectory is heard from more than one vantage point to corroborate or contest accounts.
- Family members
- Teachers
- Delivery staff
- Local representatives
Record, Transcribe, Code & Analyse
Interviews are recorded, transcribed, coded and thematically analysed.
Follow the Person and Their Trajectory
We follow the person across the points in a life where barriers build and where they are broken.
Aggregate Upwards
We build national findings from local evidence rather than disaggregating from national averages.
What Keeps Our Research Rigorous
Multiple vantage points ensure accounts are corroborated or contested.
All interviews are recorded and transcribed.
Data is coded and thematically analysed.
We retain what is honest and unresolved, with the gaps and lingering difficulties.
They are not testimonials. Their function is to explain the nuances numbers cannot.
Purposive Sample
Our sample is drawn from Fedcap participants, and we have privileged access to this data. That access allows us to reach people rarely represented in research and to hear from them candidly. However, the sample is purposive rather than representative, and findings should be read with that selection in mind.
Not Causal Inference
We are not claiming population level causal inference. Programme evidence is presented as case study rather than impact evaluation. We make no counterfactual claims about what would have happened without the intervention.
Our design allows us to identify the interventions at play and to assess what kinds of policies have the best chance of making a difference.
Judge By
Credibility · Transferability · Trustworthiness
Research of this kind is judged by its credibility, transferability and trustworthiness rather than by statistical generalizability. Well-chosen local cases can carry insight well beyond their setting.
While we are not establishing population level causation, the patterns we identify tell an important story. We present our findings for insight and accountability rather than as broadly generalisable claims, community by community.
References
- Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE Publications.
- Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
- Small, M. L. (2011). How to conduct a mixed methods study: Recent trends in a rapidly growing literature. Annual Review of Sociology, 37, 57–86. https://doi.org/10.1146/annurev.soc.012809.102657
- Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. SAGE Publications.
- Flyvbjerg, B. (2006). Five misunderstandings about case-study research. Qualitative Inquiry, 12(2), 219–245. https://doi.org/10.1177/1077800405284363
Methodology Note
Spotlight is the research series of the Community Impact Policy Institute, the thinktank and research arm of Fedcap, and its approach is one we call Research in Real Time. Rather than studying complex social and economic challenges only through aggregate data or after the fact analysis, Spotlight follows them into communities to understand how they are experienced, how communities respond, and which solutions show the greatest potential to make a difference. Lessons and promising practices are captured as they emerge, not simply once a programme or policy has concluded, and what is learned connects directly to the people shaping policy. Spotlight on Breaking Britain's Barriers applies this approach to economic inactivity, community by community. The research unfolds across three sequential chapters, examining early indicators in childhood, through youth disengagement at the transition out of compulsory education, to adult economic inactivity. To investigate this pathway, we use a mixed methods design combining aggregate data analysis with on the ground research in localities.1
The quantitative strand draws on government statistics, published datasets and Fedcap UK's outcome data. The qualitative strand will consist of in depth, purposive interviews with customers of the interventions, service users, frontline delivery staff, local partners and elected representatives. Interviews are semi structured and probing, designed to draw out honest, person centred responses, and all are recorded, transcribed, coded and thematically analysed.2 They are not testimonials, and the study does not treat them as such. Their function is to explain the nuances numbers cannot. Each trajectory is heard from more than one vantage point, including family members, teachers, delivery staff and local representatives, so that accounts are corroborated or contested rather than taken alone, and we deliberately retain what is honest and unresolved, the gaps and lingering difficulties, rather than presenting only success.
Two limitations qualify the interpretation and generalisability of these findings. Firstly, our sample is drawn from Fedcap participants, to whose data we have direct access. This access lets us reach and hear candidly from people rarely represented in research. It also carries a selection effect that should be kept in mind when reading the findings: the sample is purposive rather than representative, and because participants are, by definition, people the system reached, those it lost entirely are the least likely to be present. The chapters that examine where the system loses people should be read with that absence in view. Secondly, we are not claiming population level causal inference. Programme evidence is presented as case study rather than impact evaluation, and the study makes no counterfactual claims about what would have happened without the intervention. Our design does, however, allow us to identify the interventions at play and to assess what kinds of policies have the best chance of making a difference. Research of this kind is judged by its credibility, transferability and trustworthiness rather than by statistical generalisability.4 Thus, well-chosen local cases can carry insight well beyond their setting.5
References
- Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
- Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE Publications.
- Flyvbjerg, B. (2006). Five misunderstandings about case-study research. Qualitative Inquiry, 12(2), 219–245. https://doi.org/10.1177/1077800405284363
- Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. SAGE Publications.
- Small, M. L. (2011). How to conduct a mixed methods study: Recent trends in a rapidly growing literature. Annual Review of Sociology, 37, 57–86. https://doi.org/10.1146/annurev.soc.012809.102657