evidoria

← Back to browse

Good practice Imported

MCAS AI Grading Glitch Mis-scores 1,400 Student Essays Across Massachusetts — A Cautionary Case in Automated Assessment

United States of America · Malden · See the United States of America profile

Evidence: Observational / pre–post Top 89% 27/100 · Ask Evidence Copilot about this practice

A temporary AI scoring glitch caused roughly 1,400 of 750,000 MCAS essays to be mis-graded across some 145-200 Massachusetts school districts in 2025, including essays wrongly scored '0' that should have rated as high as 6; a teacher's tip triggered a full rescore.

1,400 essays (approx.)
MCAS essays mis-scored by the AI grading tool (2025 administration)
750,000 essays
Total MCAS essays scored (denominator) (2025 administration)
close to 200 schools
Schools affected (2025)
roughly 145 districts
Districts affected (2025)
10 % (approx.)
Share of AI-scored essays normally re-checked by human readers
MCAS AI Grading Glitch Mis-scores 1,400 Student Essays Across Massachusetts — A Cautionary Case in Automated Assessment

Details

Maturity
Established
Promoter
Massachusetts Department of Elementary and Secondary Education (DESE)
Period
2025 (error discovered July 2025, corrected August 2025)
Keywords
K-12 education, standardized testing, assessment technology

Context

During the 2025 Massachusetts Comprehensive Assessment System (MCAS) administration, an automated AI scoring tool — used to grade open-response essay questions, with roughly 10% of AI-scored essays normally re-checked by human readers — produced a temporary scoring glitch. A teacher at the Reilly Elementary School in Lowell noticed a discrepancy between a student's essay and its assigned score and alerted school and district leaders in mid-July 2025.

Results

The Massachusetts Department of Elementary and Secondary Education (DESE) subsequently found that roughly 1,400 of the state's 750,000 MCAS essays had been mis-scored, with some student responses wrongly marked '0' when they should have scored as high as 6 on a 1-to-7 scale. Districts across the state were affected, including Attleboro, Fall River, New Bedford and Taunton in Bristol County; DESE reported that close to 200 schools in roughly 145 districts were touched by the error, though the average impact was only one or two mis-scored students per affected district. All flagged essays were rescored and every affected district was notified, with corrected results issued by August 2025.

Conclusions

This is a documented failure, not a success story: an AI scoring tool operating at full state scale mis-scored student work, and the error was caught by a classroom teacher's vigilance, not by the AI system or its own quality-assurance process — with only about 10% of essays otherwise receiving routine human regrading. The case is included here as a cautionary example: it shows both the risk of automated assessment at state scale and the value of human oversight, and it illustrates a comparatively transparent post-incident response by the state education agency, which does not offset the fact that the underlying error and the thin human-review safety net were the root cause.

Implementation

Indicative cost
High (€500k–€5M)
Time to results
Short (< 1 year)
Staffing & skills
Massachusetts Department of Elementary and Secondary Education (DESE), a classroom teacher at Reilly Elementary School, Lowell, who identified the discrepancy, affected districts, including Attleboro, Fall River, New Bedford and Taunton

Conditions for success

  • DESE's transparent post-incident response: confirmed scope publicly, notified every affected district, and issued corrected results within about a month

Common failure modes

  • the AI scoring tool mis-scored roughly 1,400 of 750,000 essays, with some responses wrongly marked '0' when they should have scored as high as 6 on a 1-to-7 scale
  • the error was caught by a classroom teacher noticing a discrepancy, not by the AI system or its own quality-assurance process
  • only about 10% of AI-scored essays are routinely re-checked by human readers, leaving a significant blind spot for errors of this kind
  • the statewide scale of the deployment meant a single scoring glitch propagated across close to 200 schools in roughly 145 districts before being caught

Where it fits

Governance type
US state education agency
Scale
statewide standardized testing (Massachusetts)
Income level
high-income country (United States)

Commonly funded by

National / regional programmes

Indicative funding routes for practices of this type — always check each programme's current calls and eligibility rules.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful