evidoria

← Back to browse

Good practice Imported

AI-Chatbot Professional-Development Recommender — University College of Teacher Education Burgenland

Austria · Eisenstadt · See the Austria profile

Evidence: Observational / pre–post Top 28% 60/100 · Ask Evidence Copilot about this practice

A six-week, peer-reviewed study at Austria's University College of Teacher Education Burgenland deployed an AI chatbot recommending professional-development options to 1,125 teachers: 2,030 interactions, 85.6% accurate responses, a 14.4% fallback rate, 85% positive sentiment.

4,235 teachers
Eligible teachers
1,125 teachers
Teachers who used chatbot (15 Apr-31 May 2024)
2,030 interactions
Valid interactions logged (15 Apr-31 May 2024)
1.69 queries/teacher
Average queries per teacher
85.6 %
Response accuracy
14.4 %
Fallback rate
85 %
Positive user sentiment
0.36 Spearman's rho
Query specificity-satisfaction correlation
0.012 p-value
Statistical significance of correlation
2.05 OR
Odds ratio for domain-specific keyword queries

Details

Maturity
Pilot
Promoter
University College of Teacher Education Burgenland (Centre for Digital Education)
Period
15 April - 31 May 2024 (field study); published September-October 2025
Region (NUTS)
AT11
Keywords
teacher professional development, AI chatbot, higher education

Context

Researchers Thomas Leitgeb and Michael Leitgeb at the Centre for Digital Education, University College of Teacher Education Burgenland (Austria), built and evaluated an AI-based chatbot that gives teachers context-sensitive, personalised recommendations for professional-development (PD) courses, grounded in TPACK theory and self-determination theory.

Objectives

The premise: generic, one-size-fits-all PD catalogues get low uptake because they ignore a teacher's subject, career stage and specific pedagogical needs.

Activities

Over a six-week field deployment (15 April-31 May 2024), 1,125 of 4,235 eligible teachers used the chatbot, generating 2,030 valid interactions (an average of 1.69 queries per teacher), analysed using a convergent parallel mixed-methods design -- logistic regression, correlation analysis, and qualitative content and sentiment coding.

Results

The researchers measured 85.6% accurate responses against a 14.4% fallback rate (below the field's ~20% benchmark), 85% positive user sentiment, and a moderate positive correlation (Spearman's rho = 0.36, p = 0.012) between how specific a teacher's query was and how satisfied they were with the response; domain-specific keywords such as 'digital didactics' roughly doubled the odds of positive feedback (OR = 2.05). Teachers most often asked about digital competencies, AI and inclusion, and qualitative feedback praised the tool's timely, context-specific suggestions, while criticism centred on cases where recommendations still felt generic.

Conclusions

The study, published in the peer-reviewed journal Artificial Intelligence in Education (October 2025), is a single-institution, single-region pilot: it demonstrates a well-instrumented, quantitatively evaluated PD-recommendation tool, not yet a multi-institution or cross-border deployment, and it measures chatbot performance and teacher satisfaction rather than downstream classroom or student outcomes.

Implementation

Indicative cost
Low (< €50k) — No budget figures published; scale limited to one institution's chatbot deployment over six weeks.
Time to results
Short (< 1 year) — Six-week field deployment (15 April-31 May 2024); findings published September-October 2025.
Staffing & skills
Researchers Thomas Leitgeb and Michael Leitgeb, Centre for Digital Education, University College of Teacher Education Burgenland

Conditions for success

  • Grounding recommendations in TPACK and self-determination theory rather than a generic catalogue
  • Personalisation to a teacher's subject, career stage and pedagogical needs
  • Rigorous mixed-methods instrumentation (logistic regression, correlation analysis, sentiment coding) to monitor accuracy and satisfaction

Common failure modes

  • 14.4% fallback rate where the chatbot could not answer
  • Qualitative criticism that some recommendations still felt generic

Where it fits

Governance type
single higher-education institution (teacher-training college)
Scale
single-institution, single-region pilot (Burgenland, Austria)
Income level
high-income (Austria/EU)

Commonly funded by

Horizon Europe Erasmus+

Indicative funding routes for practices of this type — always check each programme's current calls and eligibility rules.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Similar practices you may find useful