evidoria

← Back to browse

Good practice

OU Analyse — The Open University's Predictive Learning-Analytics Early-Warning System

United Kingdom · Milton Keynes · See the United Kingdom profile

The UK's Open University has run OU Analyse, a machine-learning early-warning system flagging at-risk distance learners weekly, in production since 2014 — scaling from 2 pilot courses to dozens — with over a decade of peer-reviewed publications on its methodology, fairness and tu

~1,500 and ~3,000 students
Students in initial 2014 pilot courses (spring 2014)
18 courses
Courses using the system (autumn 2014-spring 2015)
22 courses, 32,593 students, 10.6M+ VLE interaction records
OULAD dataset coverage (published 2017)
OU Analyse — The Open University's Predictive Learning-Analytics Early-Warning System

Details

Maturity
Established
Promoter
The Open University (Knowledge Media Institute)
Period
2014–ongoing
Keywords
learning analytics, predictive modelling, student retention, early-warning system, distance education

Context

OU Analyse is a machine-learning early-warning system built by the Open University's (UK) Knowledge Media Institute that produces weekly predictions of which distance-learning students are at risk of failing an upcoming assessment, based on demographic data and clickstream interactions with the university's Virtual Learning Environment. Predictions are shared with course tutors and Student Support Teams to prioritise outreach.

Objectives

The system aims to enable timely, targeted support for students identified as at risk, with the university describing timely intervention as the goal the predictions enable rather than a separately quantified causal outcome.

Activities

The system has run in continuous production since spring 2014, when it was piloted on two introductory courses (roughly 1,500 and 3,000 students); it expanded to 18 courses by autumn 2014/spring 2015 and has continued operating institution-wide for over a decade.

Results

The underlying methodology and dataset (OULAD) were published in Nature's peer-reviewed journal Scientific Data in 2017, covering 22 courses, 32,593 students and over 10.6 million logged VLE-interaction records - one of the largest openly published learning-analytics datasets, widely reused by other researchers. Subsequent peer-reviewed research has examined prediction-accuracy trade-offs (precision rising but recall falling as more within-course data accumulates), how tutors use and trust the dashboards, and algorithmic fairness across student demographic groups.

Conclusions

The source material is explicit that what has been demonstrated is prediction accuracy and sustained operational use across many courses and years, not a randomised or quasi-experimental causal estimate of how much the predictions themselves raise pass or retention rates relative to a comparison group.

Implementation

Implementation detail (cost, timeline, staffing, conditions for success) is not yet available for this practice.

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful