New Interactive Evidence Mapping Platform for Stakeholders in Non-State Education
Identifying and Addressing Gaps in Financing, Delivery, and Services
The Education Finance Network recently launched the Non-State Actors in Education: Interactive Evidence Gap Map (EGM) to highlight available evidence and gaps in the sector and guide program design. The EGM serves practitioners and funders by identifying research priorities, pinpointing the most timely and relevant data, and facilitating evidence exchange to accelerate progress on development goals in education.
Evidence Gap Map Genesis
The Education Finance Network is a community of practice focused on the role of non-state actors in driving access, equity, and quality in education in low- and middle-income countries (LMIC). In early 2022, the Network team conducted a series of focus group discussions and stakeholder consultations to understand the priorities, needs, and goals of current and potential members. A key priority that emerged from these consultations was the need to identify, share, and synthesize concrete evidence of impact, as this evidence is usually scattered across multiple platforms or behind paywalls of academic journals. Until now, there was no singular platform bringing together evidence from academic and practitioner circles, making key findings readily available.
The EGM consolidates more than 170 papers published since 2015 on the role and impact of non-state actors in education in LMICs, synthesizing the research in an easy-to-digest interactive visual map.
Based on extensive consultations with EFN members, key stakeholders, and experts in the sector, 23 types of non-state education interventions were identified as priority interest areas to guide the desk review. These were organized into three overarching categories, including:
- Financing mechanisms such as social impact bonds and vouchers,
- Education delivery such as social franchises or faith-based schools, and
- Ancillary services such as EdTech and teacher-training.
The EGM also presents the outcomes measured by each study, such as affordability, gender equity, or learning outcomes. The studies are presented in an interactive visual map so that users can easily identify which interventions and outcomes have been subject to the most research and which areas lack significant evidence. The interactive map also allows users to filter the available evidence by country, region, or the study’s level of rigor. This ensures that the map is easily tailored to specific research interests.
Process and Scope
Twenty-three priority non-state education interventions were initially identified during the Network member consultation. The EGM process consisted of an extensive desktop review, analysis of identified research, and categorization by research type, including academic studies, systematic reviews, third-party evaluations, and other gray literature. The key source materials included in this process were published between 2015 and 2022.
The EGM is an online, living resource and will continue to grow, with regular updates added as new publications become available. While the initial scope of the EGM desktop research was limited to a focus on LMICs and excluded studies related to tertiary education, future iterations may have a broadened scope, depending on the needs and interests of the Network.
Key Findings: Concentration of Evidence
Following the desktop review, coding, and mapping process, a high-level map analysis was carried out to highlight key findings, including where evidence is concentrated, what gaps prevail, and whether existing evidence is sufficiently rigorous. This analysis considered the number of studies in each intervention and outcome category as well as the level of rigor of the various sources within each category.
A key finding of the EGM analysis was that evidence is highly concentrated in four key intervention and outcome areas:
- Learning Outcomes
- Public-Private Partnerships
- Low-Cost Private Schools and Affordability
- Ancillary Services
Learning Outcomes: The largest proportion of available evidence focuses on learning outcomes, measured by student test scores. A substantial body of rigorous evidence was found on learning outcomes, drawing from academic studies using randomized control trials and quasi-experimental methods that assessed different types of education interventions. Alongside the academic literature, many third-party evaluations and gray literature also focused on learning outcomes to assess impact. Program-level evaluations of specific interventions are complemented by systematic reviews examining learning outcomes on a global scale. Given the large amount of rigorous evidence on learning outcomes, the Network will produce four evidence briefs highlighting factors contributing to success in achieving learning outcomes, across four models of non-state education.
Public-Private Partnerships: The EGM analysis also found that many studies focused on public-private partnerships (PPPs) in education. Studies assessed the cost-effectiveness of PPPs, their ability to improve learning outcomes, and whether PPPs can increase access for out-of-school children. These rigorous studies draw from experimental academic literature, program-level evaluations, and policy papers that present concrete recommendations for policymakers.
Low-Cost Private Schools and Affordability: The EGM also identified studies on low-cost private schools that examined affordability for low-income families. These studies include multiple comprehensive systematic reviews and are geographically concentrated around India and East Africa, but also include some studies in Pakistan, Ghana, Nigeria, and Latin America, in addition to numerous global studies. These rigorous studies include many academic studies that use quantitative or quasi-experimental methods to assess low-cost private schools and their accessibility to low-income families. The affordability of low-cost private schools is also a key area of debate in gray literature and is the topic of many important pieces of practitioner research.
Ancillary Services: Lastly, the EGM revealed high volumes of evidence around non-state actor involvement in ancillary service delivery for education and the impact of ancillary services—such as teacher training and EdTech—on learning outcomes. Given the breadth of evidence in these areas, the EGM focuses specifically on systematic reviews of ancillary services. The vast majority of these systematic reviews focus on learning outcomes. The Network plans to produce several evidence briefs on ancillary services and learning outcomes in 2022.
Key Findings: Gaps in Evidence
In addition to highlighting key areas where evidence is most concentrated, the EGM also revealed several critical gaps, including:
- Limited focus on Latin America in the available research, with most studies focusing on sub-Saharan Africa or South Asia (India and Pakistan).
- Very little evidence on school quality outside of learning outcomes, particularly related to diversity, inclusion in language and curriculum, and ensuring curriculum is relevant to students’ background and contexts. This indicates a critical gap in the literature, as test scores represent only one indicator of school quality and may not capture the complete picture.
- Limited research on innovative financing, including on social/development impact bonds, results-based finance, and impact investing.
Now What? Putting the EGM into Practice
Practitioners and funders looking to engage in a new project or partnership can use the evidence presented in the EGM to gain insight into whether interventions in particular countries or regions have successfully achieved outcomes. Ensuring that evidence on past programs is widely available and shared will help direct resources into the most successful interventions and expand their impact.
For research entities and evaluators, the EGM can be used to understand what research already exists to avoid duplicating recent studies and ensure that new research prioritizes current gaps in the literature. As new research projects require an initial literature review, the EGM can facilitate this process by identifying existing research in one place for ease of access.
Overall, the EGM aims to bring greater transparency to the sector, allowing other stakeholders, such as policymakers and investors, to coordinate and align programs to better leverage resources and avoid duplication of services. Sharing and synthesizing evidence— including from outside their usual stakeholder group—that is up-to-date with the most relevant literature will illustrate the impact and business case. This will help attract more capital for education lending and to encourage further research in areas where meaningful gaps have been identified. Ultimately, it will also help to ensure a better return on investment, increase learning, and improve the efficacy and efficiency of services.
About the Education Finance Network
Launched on April 7, 2022, the Education Finance Network convenes diverse education stakeholders, including foundations, donors, impact investors, and practitioner networks, with a focus on directing non-state resources toward creating inclusive, high-quality education in LMICs globally. With over 70 members in 23 countries, the Network has hosted events on various topics, including results-based finance for youth workforce development, public-private partnerships in education, and early childhood education. The Network is member-driven, focusing on the interests and needs of its members to shape programming content, professional development activities, and topics of interest for its knowledge products.
Get in Touch!
Have you recently come across or published a relevant research piece that is not included in the EGM? Let us know! If you are a member of the Education Finance Network and would like your organization’s research to be included in the interactive EGM, please contact us at: firstname.lastname@example.org. Our goal is to facilitate evidence-sharing among our members broadly. We appreciate your efforts to help us do so.
If you are interested in becoming a member of the Education Finance Network, fill out an application form here.