Session 6: How do I ensure my EdTech investments are cost-effective?

An output of the EdTech Hub, https://edtechhub.org


Background
The Strategic Choices for Education Reform workshop held in Zimbabwe in November 2022 aimed to provide a forum for senior government officials to reflect and consider the strategic reform options for their countries.The objective was to convene officials in key positions in the ministries of education, higher education, finance, and planning to learn about important issues and approaches in education; exchange experiences and lessons; develop an understanding of what is necessary to reconstruct better and more resilient education systems; and to transform the large potential of young people, through human capital investments, into development and prosperity.
EdTech Hub was invited to facilitate the day of the workshop focused on harnessing ICT for better teaching and learning.This presentation is one of several used in the workshop to promote learning, discussion, and problem solving among the participants.We have published four presentations.Details are on the next slide.

Published presentations from the workshop
We have published four presentations from the workshop, you can access these in our Evidence Library using the following links We often review pilots that are unaffordable at scale (by many factors).
Therefore, ensuing a route to affordability at scale is vital.

Equity
The cost-efficiency of interventions which are targeted at the most marginalised is normally lower.
This element of equity must be considered when deciding on which interventions to support.
You would rightly expect to pay more for outcomes of an intervention targeted at children with disabilities.

Cost, impact, cost-effectiveness
To improve cost-effectiveness, either: Learning impact must increase or:

Cost must decrease
Often, with EdTech-supported interventions, reducing the costs of an intervention is more feasible than increasing learning.

Evidence-based scaling
Learning-Adjusted Years of Schooling (LAYS) per $100 is the best metric we have for evidence-based decision-making about the cost-effectiveness of scaling an education intervention.
It does not give the whole picture, but is a very useful tool.

Costs are crucial
Unless data is captured accurately at source, both in terms of learning outcomes and costs, comparisons are problematic.
Costs are often systematically underreported, and the work that the Strategic Impact Evaluation Fund (SIEF) is doing to correct this is a great step.

Embedded approach
Committing to embedding this approach across EdTech research will allow consistent comparison that can reduce arbitrary decision-making and increase impact.

Define EdTech costs carefully
Recurrent, often hidden, EdTech costs may include but not be limited to: ■ In other interventions, the costs are so high that the intervention is not affordable to be scaled in the country.
■ We also see examples where the cost-effectiveness targeted is significantly lower than 'non-tech' options.

Predict and measure cost-effectiveness
Recommendation: When introducing an EdTech initiative regularly check on the projected cost-effectiveness and affordability at scale.
If an intervention appears to be unaffordable or is not cost-effective, then continue further piloting to identify options to reduce costs or increase learning impact.

Embed analysis in the short and long term
The timing of cost-effectiveness analysis should be aligned with decision points throughout the programme cycle (e.g., deciding whether or not to scale-up a programme, or deciding which of two programmes will be funded).
Committing to embedding this approach across EdTech research will allow consistent comparison that can reduce arbitrary decision-making and increase impact.The 'how' of tech is usually more important for effectiveness than the 'what' -so it needs to be an ongoing embedded process.In Malawi, the Unlocking Talent initiative, has worked hard to reduce costs from upwards of $40-$50 per child per year to $1-10 per child per year, in order to be affordable at scale.
In Tanzania, EdTech initiatives have leveraged teachers' personal devices to reduce costs while maintaining impact.

Equity: Promote intersections of equity and cost-effectiveness
In many cases, focusing on equity can improve learning outcomes for all.
Camfed's programme in Tanzania aims to reach marginalised girls at the secondary education level and provide financial and learning support.High cost-effectiveness was achieved as all students attending Camfed-supporting schools (not just the most marginalised) benefited from the programme (⇡Sabates et al., 2018).
Technology to support children with disabilities can be particularly effective at addressing equity, alongside learning.

Cost-effectiveness
The ratio of costs to impact can be used to compare EdTech initiatives and identify themes contributing to cost-effectiveness.
Predict and measure cost-effectiveness 3.
Embed analysis in the short and long term

Affordability
Ensure an intervention is both affordable and cost-effective before starting to scale.
It's possible to have interventions that are theoretically cost-effective at scale, but are still not affordable at scale.

Equity
Promote intersections of equity and cost-effectiveness.
This element of equity must be considered when deciding on interventions to support.
Cost of repairing or replacing broken hardware ■ Energy usage and connectivity costs ■ Required investments in school building infrastructure to securely house expensive new equipment ■ Teacher training ■ Salaries of support team members ■ Costs associated with parental engagement ■ Costs of network equipment (routers, switches, wireless access points) ■ Hosting costs over time 1.Define EdTech costs carefully Source: (⇡SIEF, 2020) ■ Many interventions do not measure costs and do not project the subsequent costs at greater scale.
Overall and component costs may change over time Learning curves are associated with the introduction of new technologies How does cost-effectiveness analysis link to innovation in EdTech?Affordability: Ensure an intervention is both affordable and cost-effective before scaling It's possible to have interventions that are theoretically cost-effective at scale, but are still not affordable at scale.

develop an aligned and actionable EdTech strategy ■ Session 4: How can I rapidly upskill my large teacher workforce? ■ Session 5: How can I use EdTech to ensure that students are provided with quality educational content, at the right level? ■ Session 6: How do I ensure my EdTech investments are cost effective Overview: Cost-effectiveness, affordability, equity Cost-effectiveness
■Session 3: How can I