AI4T Italy — INDIRE's Tutor-Led Online Pathway Trains 275 Teachers in a Randomised Trial (Erasmus+)

In 2022-23 INDIRE ran the Italian arm of AI4T, a school-randomised evaluation across 91 schools and 438 recruited teachers (275 provided usable baseline and endline surveys). The pathway combined the shared AI4T MOOC and open textbook with online, guided group sessions in tutor-led subgroups, using tools such as ChatGPT, DALL-E, Duolingo, Cymath and MathSolver.
The evaluation, led by Cnesco-Cnam with INDIRE as national evaluator, reports regression effects on teachers' AI knowledge (self-assessed knowledge +0.54, familiarity with AI technologies +0.92, identifying AI in AI-based tools +0.79, knowledge of how AI works +0.38; all significant), plus higher use of AI (+0.42) and perceived ease of use (+0.44). Effects on anxiety, enjoyment, perceived usefulness and frequent (weekly or more) use were not significant.
Caveats: outcomes are mainly self-reported, the follow-up was a single school year, the use effect was concentrated among maths teachers (+0.78, versus not significant for language teachers), and the report notes that teachers tested tools rather than embedding them in routine practice.

Read the full analysis: https://cnesco.fr/wp-content/uploads/2024/05/AI4T_WP3_D3.3_Comparative-European-Evaluation-Report.pdf