A six-week, peer-reviewed study at Austria's University College of Teacher Education Burgenland deployed an AI chatbot recommending professional-development options to 1,125 teachers: 2,030 interactions, 85.6% accurate responses, a 14.4% fallback rate, 85% positive sentiment.
4,235 teachers
Eligible teachers
1,125 teachers
Teachers who used chatbot (15 Apr-31 May 2024)
2,030 interactions
Valid interactions logged (15 Apr-31 May 2024)
1.69 queries/teacher
Average queries per teacher
85.6 %
Response accuracy
14.4 %
Fallback rate
85 %
Positive user sentiment
0.36 Spearman's rho
Query specificity-satisfaction correlation
0.012 p-value
Statistical significance of correlation
2.05 OR
Odds ratio for domain-specific keyword queries
Details
Maturity
Pilot
Promoter
University College of Teacher Education Burgenland (Centre for Digital Education)
Period
15 April - 31 May 2024 (field study); published September-October 2025
Region (NUTS)
AT11
Keywords
teacher professional development, AI chatbot, higher education
Context
Researchers Thomas Leitgeb and Michael Leitgeb at the Centre for Digital Education, University College of Teacher Education Burgenland (Austria), built and evaluated an AI-based chatbot that gives teachers context-sensitive, personalised recommendations for professional-development (PD) courses, grounded in TPACK theory and self-determination theory.
Objectives
The premise: generic, one-size-fits-all PD catalogues get low uptake because they ignore a teacher's subject, career stage and specific pedagogical needs.
Activities
Over a six-week field deployment (15 April-31 May 2024), 1,125 of 4,235 eligible teachers used the chatbot, generating 2,030 valid interactions (an average of 1.69 queries per teacher), analysed using a convergent parallel mixed-methods design -- logistic regression, correlation analysis, and qualitative content and sentiment coding.
Results
The researchers measured 85.6% accurate responses against a 14.4% fallback rate (below the field's ~20% benchmark), 85% positive user sentiment, and a moderate positive correlation (Spearman's rho = 0.36, p = 0.012) between how specific a teacher's query was and how satisfied they were with the response; domain-specific keywords such as 'digital didactics' roughly doubled the odds of positive feedback (OR = 2.05). Teachers most often asked about digital competencies, AI and inclusion, and qualitative feedback praised the tool's timely, context-specific suggestions, while criticism centred on cases where recommendations still felt generic.
Conclusions
The study, published in the peer-reviewed journal Artificial Intelligence in Education (October 2025), is a single-institution, single-region pilot: it demonstrates a well-instrumented, quantitatively evaluated PD-recommendation tool, not yet a multi-institution or cross-border deployment, and it measures chatbot performance and teacher satisfaction rather than downstream classroom or student outcomes.
Implementation
Indicative cost
Low (< €50k) — No budget figures published; scale limited to one institution's chatbot deployment over six weeks.
Time to results
Short (< 1 year) — Six-week field deployment (15 April-31 May 2024); findings published September-October 2025.
Staffing & skills
Researchers Thomas Leitgeb and Michael Leitgeb, Centre for Digital Education, University College of Teacher Education Burgenland
Conditions for success
Grounding recommendations in TPACK and self-determination theory rather than a generic catalogue
Personalisation to a teacher's subject, career stage and pedagogical needs
Rigorous mixed-methods instrumentation (logistic regression, correlation analysis, sentiment coding) to monitor accuracy and satisfaction
Common failure modes
14.4% fallback rate where the chatbot could not answer
Qualitative criticism that some recommendations still felt generic
Where it fits
Governance type
single higher-education institution (teacher-training college)
Scale
single-institution, single-region pilot (Burgenland, Austria)