Medly AI's Micro-Randomised GCSE Science Trial — Higher Attainment After Four Weeks of AI Tutoring
United Kingdom
A four-week, individually randomised trial of 929 English GCSE Biology, Chemistry and Physics students found those using the Medly AI …
Nigeria · Benin City · See the Nigeria profile · See the Benin City profile
Evidence: Randomised controlled trial Top 3% 80/100 · Ask Evidence Copilot about this practice
A six-week World Bank RCT in nine Edo State public schools showed GPT-4 tutoring (Microsoft Copilot) delivered English gains equivalent to two academic years in 800 senior secondary students; improvements transferred to non-tutored subjects.
A World Bank randomised controlled trial (Education Global Department, with Mastercard Foundation support) tested GPT-4-based English tutoring (via Microsoft Copilot) in nine public secondary schools in Benin City, Edo State, Nigeria, in June–July 2024. Eight hundred first-year senior secondary students attended twice-weekly after-school sessions combining teacher-framed topics with AI-assisted practice.
To test whether short-term, AI-assisted after-school tutoring can improve English-language proficiency among under-resourced public secondary school students, and to assess transfer effects to other subjects and cost-effectiveness relative to human tutoring.
Randomised assignment of students to treatment (AI-tutoring) and control groups; twice-weekly after-school sessions over six weeks in which teachers framed a topic before students practised English with Microsoft Copilot (GPT-4); teachers acted as facilitators ('orchestra conductors') rather than direct instructors during AI practice.
Treatment students significantly outperformed controls on English proficiency (the primary outcome) and on AI knowledge/digital skills. The six-week intervention produced English learning gains equivalent to two full academic years of conventional schooling. Gains transferred to end-of-year exam performance in subjects not covered by the programme. A cost-effectiveness analysis found the approach substantially cheaper per learning unit than comparable human-tutor interventions.
The World Bank published a seven-lesson brief recommending scale-up conditional on teacher capacity-building, data-privacy safeguards, and reliable electricity/device access.
Implementation detail (cost, timeline, staffing, conditions for success) is not yet available for this practice.
National / regional programmes
Indicative funding routes for practices of this type — always check each programme's current calls and eligibility rules.
Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.
Where this practice's information was retrieved from, and when.
United Kingdom
A four-week, individually randomised trial of 929 English GCSE Biology, Chemistry and Physics students found those using the Medly AI …
Denmark
Two experiments (175 university, 234 high-school students) found a learning-theory-based chatbot beat ChatGPT on conceptual knowledge, trust and enjoyment; gains …
Nigeria
A World Bank RCT in Edo State, Nigeria found 800 secondary students using Microsoft Copilot in teacher-guided after-school English classes …
Hungary
A 13-week controlled study at four Hungarian universities found a ChatGPT-based adaptive tutor using Bayesian Knowledge Tracing nearly doubled programming …
Open full copilot Grounded in cited practices — always check the sources.