evidoria

← Retour à la liste

Bonne pratique Importée

Letrus, retour d'écriture par IA — Réduire l'écart de notation à l'ENEM dans l'Espírito Santo

Brésil · Vitória · Voir le profil de Brésil

Les écoles publiques de l'Espírito Santo ont utilisé la plateforme d'IA Letrus pour donner un retour rapide aux élèves préparant la dissertation de l'ENEM ; une évaluation randomisée du J-PAL sur environ 19 000 élèves a montré une hausse de 0,09 écart-type des notes, comblant environ 9 % de l'écart public-privé, avec des soumissions en hausse de 28-32 %.

19000 students (approx.)
Students in the randomized evaluation
178
Schools in the evaluation
110
Schools with Letrus access
68
Comparison schools
0,09 SD (~17 points on a 1,000-point scale)
Gain in official ENEM essay scores
9 %
Public-private achievement gap closed
0.14-0.16 SD
Gain in the policy-proposal sub-grade
28-32 %
Increase in essay submissions
35 %
Increase in individual essay discussions with teachers
28000
Active student users in Espírito Santo (2024)
100000 users (over)
Total users since 2020
Letrus, retour d'écriture par IA — Réduire l'écart de notation à l'ENEM dans l'Espírito Santo

Détails

Maturité
En expansion
Promoteur
Secretaria de Estado da Educação do Espírito Santo (Sedu), with Letrus, J-PAL and Google.org
Période
2019–present (statewide since 2022)
Mots-clés
AI writing feedback, natural language processing, public education, exam preparation

Contexte

Espírito Santo's State Department of Education (Sedu) piloted Letrus, an automated writing evaluation platform combining natural-language processing with human review, to help public high-school seniors prepare for the essay component of Brazil's ENEM university-entrance exam.

Objectifs

Economists Bruno Ferman, Lycia Lima and Flavio Riva evaluated the 2019 rollout as a three-arm randomized study covering roughly 19,000 seniors across 178 public schools, 110 with Letrus access and 68 comparison schools.

Activités

Students wrote practice essays on the platform and received rapid, rubric-aligned feedback across ENEM's five official competencies, with human correctors refining the AI's semantic feedback in a subset of schools.

Résultats

Official ENEM essay scores rose by about 0.09 standard deviations (roughly 17 points on the 1,000-point scale), closing an estimated 9% of Brazil's public-private school achievement gap in the essay component; the policy-proposal sub-grade rose 0.14-0.16 SD, essay submissions increased 28-32%, and students discussed about 35% more essays individually with teachers, with both the AI-only and AI-plus-human versions producing similar score gains.

Conclusions

Following the pilot, Espírito Santo rolled Letrus out statewide in 2022 and it has since been adopted by education departments in Mato Grosso do Sul, Alagoas, Paraíba, Pará, Mato Grosso, Goiás and Ceará, with USAID Development Innovation Ventures funding a 2024-2026 follow-up evaluation and around 28,000 active student users in Espírito Santo alone by 2024.

Mise en œuvre
Coût indicatif
Moyen (50 k€–500 k€)
Délai jusqu’aux résultats
Long (> 3 ans)
Personnel et compétences
Delivered jointly by Espírito Santo's State Department of Education (Sedu), the Letrus platform team, J-PAL researchers and Google.org, with human correctors reviewing AI feedback in a subset of schools.

Conditions de réussite

  • A human-review layer refining the AI's semantic feedback in some schools produced similar gains to the AI-only version.
  • Teachers redirected time from routine error-flagging to individualized coaching once the AI handled routine feedback.
  • External funding (Google.org, later USAID DIV) supported evaluation and scale-up.

Kit de réplication

Artefacts réutilisables de cette pratique — tels que publiés par leurs sources.

Vous portez cette pratique ? Revendiquez-la — les porteurs vérifiés obtiennent un contact public sur la page et peuvent proposer des corrections.

Sources de données

D'où proviennent les informations de cette pratique, et quand.

Pièces jointes

Pratiques similaires qui pourraient vous être utiles