evidoria

← Voltar à navegação

Boa prática Importada

Feedback de Escrita com IA da Letrus — Reduzindo o Hiato na Redação do ENEM no Espírito Santo

Brasil · Vitória · Ver o perfil de Brasil

Escolas públicas do Espírito Santo usaram a plataforma de IA Letrus para dar feedback rápido aos estudantes na redação do ENEM; uma avaliação randomizada do J-PAL com ~19.000 alunos encontrou aumento de 0,09 DP nas notas, fechando cerca de 9% do hiato entre escolas públicas e privadas, com envios de redações subindo 28-32%.

19000 students (approx.)
Students in the randomized evaluation
178
Schools in the evaluation
110
Schools with Letrus access
68
Comparison schools
0,09 SD (~17 points on a 1,000-point scale)
Gain in official ENEM essay scores
9 %
Public-private achievement gap closed
0.14-0.16 SD
Gain in the policy-proposal sub-grade
28-32 %
Increase in essay submissions
35 %
Increase in individual essay discussions with teachers
28000
Active student users in Espírito Santo (2024)
100000 users (over)
Total users since 2020
Feedback de Escrita com IA da Letrus — Reduzindo o Hiato na Redação do ENEM no Espírito Santo

Detalhes

Maturidade
Em expansão
Promotor
Secretaria de Estado da Educação do Espírito Santo (Sedu), with Letrus, J-PAL and Google.org
Período
2019–present (statewide since 2022)
Palavras-chave
AI writing feedback, natural language processing, public education, exam preparation

Contexto

Espírito Santo's State Department of Education (Sedu) piloted Letrus, an automated writing evaluation platform combining natural-language processing with human review, to help public high-school seniors prepare for the essay component of Brazil's ENEM university-entrance exam.

Objetivos

Economists Bruno Ferman, Lycia Lima and Flavio Riva evaluated the 2019 rollout as a three-arm randomized study covering roughly 19,000 seniors across 178 public schools, 110 with Letrus access and 68 comparison schools.

Atividades

Students wrote practice essays on the platform and received rapid, rubric-aligned feedback across ENEM's five official competencies, with human correctors refining the AI's semantic feedback in a subset of schools.

Resultados

Official ENEM essay scores rose by about 0.09 standard deviations (roughly 17 points on the 1,000-point scale), closing an estimated 9% of Brazil's public-private school achievement gap in the essay component; the policy-proposal sub-grade rose 0.14-0.16 SD, essay submissions increased 28-32%, and students discussed about 35% more essays individually with teachers, with both the AI-only and AI-plus-human versions producing similar score gains.

Conclusões

Following the pilot, Espírito Santo rolled Letrus out statewide in 2022 and it has since been adopted by education departments in Mato Grosso do Sul, Alagoas, Paraíba, Pará, Mato Grosso, Goiás and Ceará, with USAID Development Innovation Ventures funding a 2024-2026 follow-up evaluation and around 28,000 active student users in Espírito Santo alone by 2024.

Implementação
Custo indicativo
Médio (50 mil–500 mil €)
Tempo até resultados
Longo (> 3 anos)
Equipa e competências
Delivered jointly by Espírito Santo's State Department of Education (Sedu), the Letrus platform team, J-PAL researchers and Google.org, with human correctors reviewing AI feedback in a subset of schools.

Condições de sucesso

  • A human-review layer refining the AI's semantic feedback in some schools produced similar gains to the AI-only version.
  • Teachers redirected time from routine error-flagging to individualized coaching once the AI handled routine feedback.
  • External funding (Google.org, later USAID DIV) supported evaluation and scale-up.

Kit de replicação

Artefactos reutilizáveis desta prática — tal como publicados pelas suas fontes.

Implementa esta prática? Reivindique-a — implementadores verificados obtêm um contacto público na página e podem propor correções.

Fontes de dados

De onde foi obtida a informação desta prática, e quando.

Anexos

Práticas semelhantes que podem ser úteis