evidoria

← Back to browse

Good practice

bettermarks — Real-World Effectiveness of an AI-Adaptive Maths Platform Across German State School Systems

Germany · Berlin · See the Germany profile

Germany's bettermarks AI-adaptive maths platform — statewide in 9 of 16 federal states, ~500,000 students — got its most rigorous independent test yet in 2026: a field study of 587 disadvantaged-school students found real but usage-dependent gains, near-zero on average.

587 students, 60 classes, 25 schools
German field-study sample (Sept 2024 - Mar 2025)
9.2 minutes/week
Average weekly system use (Germany)
β=.13 (p<.01)
Individual-level in-school usage effect
2,143 students, 237 schools
Uruguay (PAM) study sample (study published Oct 2017)
0.20 standard deviations
Uruguay (PAM) learning-gain effect
~500,000 students, 500+ schools, 9 of 16 German federal states
Platform deployment scale (as of August 2025)
bettermarks — Real-World Effectiveness of an AI-Adaptive Maths Platform Across German State School Systems

Details

Maturity
Established
Promoter
bettermarks GmbH
Period
2009 pilot – ongoing; cited field study Sept 2024 – Mar 2025
Keywords
adaptive learning, mathematics, intelligent tutoring system, K-12

Context

bettermarks is a German-developed AI-adaptive mathematics platform that generates individualised practice problems and step-by-step feedback based on each student's error patterns. Following a 2009 pilot study by the ZNL Transfer Center for Neuroscience and Learning at the University of Ulm (34 schools, one semester, a significant positive effect on fractions performance), the platform scaled to statewide licences in at least 9 of Germany's 16 federal states, with the company reporting roughly 500,000 student users and 500+ schools as of August 2025.

Activities

Its most rigorous independent evaluation to date is a peer-reviewed 2026 field study by Schaaf, Rolfes, Nagy and Heinze (Frontiers in Education), which followed 587 grade 8-9 students across 60 classes in 25 socioeconomically disadvantaged Schleswig-Holstein schools from a pretest (Sept-Oct 2024) to a posttest (Feb-Mar 2025). An earlier October 2017 impact evaluation by Perera and Aboal (Centro de Investigaciones Económicas, commissioned by Uruguay's Plan Ceibal) tracked 2,143 primary-school students across 237 schools using the same platform, locally called PAM.

Results

Average system use in the German study was just 9.2 minutes/week (4.6 in school, 4.5 at home). Average learning gains across the full sample were near zero, but students who used the system more than their classmates during school hours showed a small, statistically significant individual-level benefit (β=.13, p<.01); home use and class-level (aggregate) usage effects were non-significant. In Uruguay, the earlier study found a robust 0.20-standard-deviation positive effect on mathematics learning gains, with the effect growing larger for students completing more exercises — a clear dose-response pattern.

Conclusions

Read together, bettermarks can help — particularly students who actually use it consistently, especially in a structured, in-school setting — but average, unconditional effects are small or null, and impact depends heavily on dosage and implementation, not the software alone.

Implementation

Indicative cost
Medium (€50k–€500k)
Time to results
Long (> 3 years)
Staffing & skills
ZNL Transfer Center for Neuroscience and Learning, University of Ulm (original pilot research), bettermarks GmbH (platform vendor), 52 teachers involved in the 2009 ZNL pilot

Conditions for success

  • Consistent, sustained in-school usage (dose-response relationship between usage and learning gain)
  • Structured classroom integration rather than unsupervised home use

Common failure modes

  • Average, unconditional effects are small or null without sufficient dosage
  • Home use showed no significant effect
  • No independent data-protection or algorithmic-transparency audit found

Where it fits

Governance type
statewide licensing by German federal state education authorities; commissioned national evaluation in Uruguay (Plan Ceibal)
Scale
multi-state/national, ~500,000 students
Income level
high-income (Germany) and upper-middle-income (Uruguay) deployments

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful