AI Chatbot Co-Facilitator for Online Discussions — Kyoto University's RCT with Afghan Students Amid the Taliban's Education Ban

Afghanistan is the only country that systematically bans women and girls from secondary and higher education under Taliban rule since 2021; many Afghan women now rely on online learning provided by non-profits as their main route to education, but large online classes often struggle to sustain meaningful interaction.

Researchers at Kyoto University's Graduate School of Informatics tested whether adding a GPT-4 chatbot co-facilitator to online post-lecture discussions could raise participation and confidence among Afghan students.

80 undergraduate computer science students (40 women, 40 men, aged 18-26) were recruited from a pool of 3,432 qualified applicants and randomly assigned to control or treatment groups. All students attended an identical 50-minute Zoom lecture, then joined 40-minute post-lecture discussions in gender-balanced groups of 10 on the open-source, Discourse-based 'Hyper-Democracy' platform. In the treatment condition, discussions were additionally co-facilitated by a GPT-4-based chatbot seeded with 17 human-authored facilitation prompts, alongside the same human instructor used in the control condition.

Students in the AI-facilitated group posted significantly more messages (mean 8.73 vs 5.11 per student, p<0.01) and reported significantly higher post-session confidence in the material (p=0.037). Replies and word count were also higher but not statistically significant, and control-group posts received more peer 'likes' (2.88 vs 0.78, p<0.001) -- a pattern the authors attribute to a bandwagon effect concentrating likes on fewer control-group posts.

The trial was a single-day, single-course intervention, adequately powered only for large effects (Cohen's d >= 0.65), and the authors call for replication across longer courses and subjects before generalising. The work was funded by JSPS KAKENHI and JST CREST and published under a CC-BY-4.0 licence with a public data-access statement.