Jisc TeacherMatic Pilots — 15 UK Colleges and Universities Test a Generative-AI Resource Generator with Survey-Based Time-Saving Evidence

Jisc, the UK's digital agency for tertiary education, ran two member pilots of TeacherMatic, a generative-AI platform with 50+ generators for lesson plans, quizzes, schemes of work and feedback.

Further-education pilot: eight colleges (including Basingstoke College of Technology, Milton Keynes College, NPTC Group and West College Scotland), chosen from over 60 applicants, each received 50 licences for 12 months, giving around 400 participants (May 2023 to February 2024). A mid-pilot survey drew 102 responses (87% reported saving time; 93% would continue). The final survey drew 179 responses: 79% said it saved time, with an average of 2 hours 10 minutes per week; 85% rated content accuracy very or somewhat accurate; 70% rated content quality good or very good.

Higher-education pilot: seven universities, around 350 participants (January to July 2024). 51% said it saved time creating teaching resources, with an average of about two hours a week; 63% would recommend it for HE; 70% rated accuracy somewhat or very accurate. The feedback generator was singled out as useful.

Honest limits: results are self-reported surveys with response rates well under half of participants, and Jisc itself flags possible survivorship bias. Participants reported repetitive activities, content too basic for detailed subjects, and presentations with irrelevant images and without screen-reader-friendly formatting. Pilot leads stressed that users must check generated content for suitability and accessibility, and some skilled users found general chatbots gave richer output. No learner-outcome data was collected.

Read the full analysis: https://teachermatic.com/wp-content/uploads/2024/05/Jisc-AI-TeacherMatic-FE-pilot-report.pdf