evidoria

← Back to browse

Good practice Imported

From Chalkboards to Chatbots — World Bank RCT Finds Microsoft Copilot Tutoring Lifts English Scores by Two Years in Edo State, Nigeria

Nigeria · Benin City · See the Nigeria profile · See the Benin City profile

Evidence: Randomised controlled trial Top 17% 67/100 · Ask Evidence Copilot about this practice

A World Bank RCT in Edo State, Nigeria found 800 secondary students using Microsoft Copilot in teacher-guided after-school English classes gained 0.31 SD - roughly 1.5-2 years of learning - in six weeks, with the largest gains among girls.

0.31 SD
English score gain (treatment vs control) (6-week intervention)
1.5-2 years of typical schooling
Learning gain equivalent
~800 students
Trial sample size
9 public schools
Schools involved
From Chalkboards to Chatbots — World Bank RCT Finds Microsoft Copilot Tutoring Lifts English Scores by Two Years in Edo State, Nigeria

Details

Maturity
Pilot
Promoter
World Bank
Period
Jun-Jul 2024 pilot; published May 2025
Keywords
generative AI, secondary education, English language learning, randomized evaluation

Context

Edo State's Ministry of Education and the World Bank's education team ran a randomized controlled trial testing whether generative AI could accelerate learning in a resource-constrained public-school system, in and around Benin City, Nigeria.

Objectives

Roughly 800 first-year senior-secondary students across nine public schools were randomly assigned to an after-school English program to test whether teacher-guided use of Microsoft Copilot could accelerate English learning.

Activities

The treatment group met twice a week for six weeks and worked through grammar and writing tasks using Microsoft Copilot (running on GPT-4), with teachers introducing each topic and mediating every AI interaction.

Results

Students in the treatment group scored 0.31 standard deviations higher on English assessments than the control group — a gain researchers equated to roughly 1.5 to 2 years of typical schooling in six weeks — and the effect carried over into end-of-year curricular exams covering material beyond the programme itself. Gains were largest among girls and among students who started with higher baseline performance.

Conclusions

The World Bank has been explicit that the 'two years of learning' framing is an extrapolation from a six-week intervention, not a durability claim; independent commentary has stressed the central role of teacher mediation and cautioned against scaling the model before longer-run and unsupervised-use evidence is available.

Implementation

Indicative cost
Medium (€50k–€500k) — Required Microsoft Copilot (GPT-4) access, computer-lab infrastructure across 9 schools, and teacher time to mediate every session — moderate cost for a 6-week after-school pilot.
Time to results
Short (< 1 year) — Six-week, twice-weekly after-school intervention; the World Bank explicitly cautions against scaling before longer-run evidence.
Staffing & skills
classroom teachers mediating every AI interaction, Edo State Ministry of Education, World Bank education team

Conditions for success

  • teacher-guided/mediated use of AI rather than unsupervised student use
  • computer-lab access for after-school sessions
  • structured grammar/writing tasks aligned to curriculum

Common failure modes

  • gain figures are an extrapolation from a 6-week intervention, not a durability claim
  • World Bank and independent commentary caution against scaling before longer-run and unsupervised-use evidence is available

Where it fits

Governance type
state ministry of education + World Bank pilot
Scale
9 public schools, ~800 students
Income level
lower-middle-income (Nigeria)

Commonly funded by

National / regional programmes

Indicative funding routes for practices of this type — always check each programme's current calls and eligibility rules.

Replication kit

Reusable artefacts from this practice — as published by their sources.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful