evidoria

← Back to browse

Good practice

AI-Adaptive Programming Education for Socially Disadvantaged Students — A 13-Week Study Across Four Hungarian Universities

Hungary · Dunaújváros · See the Hungary profile

A 13-week study across four Hungarian universities gave disadvantaged students an AI adaptive programming tutor built on ChatGPT and Bayesian Knowledge Tracing. Test-score gains (d=1.40, n=61) more than doubled the control group's (d=0.74, n=61), p<0.001.

1.4 Cohen's d
Test-score effect size, experimental group (AI-adaptive tutor) (13-week study, 2024–2025)
0.74 Cohen's d
Test-score effect size, control group (traditional instruction) (13-week study, 2024–2025)
5.1 mean score
Experimental group mean test score, pre-test (13-week study, 2024–2025)
7.1 mean score
Experimental group mean test score, post-test (13-week study, 2024–2025)
5.0 mean score
Control group mean test score, pre-test (13-week study, 2024–2025)
6.0 mean score
Control group mean test score, post-test (13-week study, 2024–2025)
1.1 Cohen's d
Behavioural engagement effect size (13-week study, 2024–2025)
1.0 Cohen's d
Emotional engagement effect size (13-week study, 2024–2025)
1.4 Cohen's d
Cognitive engagement effect size (13-week study, 2024–2025)
0.89 Cronbach's alpha
Engagement scale reliability (Cronbach's α) (13-week study, 2024–2025)
61 students
Experimental group sample size (13-week study, 2024–2025)
61 students
Control group sample size (13-week study, 2024–2025)
122 students
Total study participants (13-week study, 2024–2025)
AI-Adaptive Programming Education for Socially Disadvantaged Students — A 13-Week Study Across Four Hungarian Universities

Details

Maturity
Pilot
Promoter
University of Dunaújváros / Óbuda University / John von Neumann University / Budapest University of Economics and Business
Period
13-week study, 2024–2025; published in TechTrends, 2025
Keywords
AI adaptive learning, programming education, higher education, digital divide, Bayesian Knowledge Tracing

Context

A research team from the University of Dunaújváros, Óbuda University, John von Neumann University, and Budapest University of Economics and Business ran a quasi-experimental study to test whether an AI adaptive learning system could narrow programming-skill gaps for socially disadvantaged students. 122 students aged 18-21 across four Hungarian universities took part, split into a 61-student experimental group and a 61-student control group. The study ran over 13 weeks during 2024-2025 and was published in TechTrends (Springer) in 2025.

Activities

The experimental group used a ChatGPT-based adaptive tutor employing Bayesian Knowledge Tracing to model each learner's knowledge state and adjust task difficulty in real time. The control group received the same 13-week curriculum, covering control structures, functions, loops and algorithms, via traditional instruction. Both groups were taught by the same instructor with identical labs, hardware and internet access, isolating the AI tutor as the variable of interest.

Results

Test scores rose from a mean of 5.1 to 7.1 in the experimental group (d=1.40) versus 5.0 to 6.0 in the control group (d=0.74), both p<0.001. Engagement also increased across behavioural (d=1.10), emotional (d=1.00) and cognitive (d=1.40) subscales (Cronbach's α=0.89), all p<0.001. The experimental group's gains were substantially larger than the control group's across every measured outcome.

Conclusions

The authors note that the 13-week duration 'limits any conclusion about long-term retention', and that participants were recruited via survey response rather than full random sampling, raising a risk of selection bias. The study covers a single subject, introductory programming, and has not yet been replicated or scaled beyond these four universities.

Implementation

Indicative cost
Low (< €50k)
Time to results
Short (< 1 year)

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful