evidoria

← Back to browse

Good practice Imported

INEGI Rolls Out AI Coding to Cut Manual Classification Load in Mexico's Household Surveys

Mexico · Aguascalientes · See the Mexico profile

Evidence: Observational / pre–post Top 24% 73/100 · Ask Evidence Copilot about this practice

Mexico's statistics institute INEGI is scaling BERT/FastText-based AI coding from its household income survey to the national employment survey, formally targeting up to a 50% cut in manual coding workload for occupation and industry classification without losing accuracy.

48.2 %
ENIGH occupation cases auto-coded (50% confidence) (December 2024)
89.4 %
ENIGH occupation auto-coding agreement with human coders (December 2024)
84.8 %
ENOE occupation-code agreement with manual coding (2024-2025)
76.7 %
ENOE economic-activity-code agreement with manual coding (2024-2025)
up to 50 %
Target reduction in manual coding workload (2025 target)
28 of 52 projects
Approved 2025 research projects, out of proposals reviewed (2025)

Details

Maturity
Scaling
Promoter
Instituto Nacional de Estadística y Geografía (INEGI)
Period
2022-2025
Keywords
official statistics, labour market, public administration

Context

Mexico's national statistics institute, INEGI, runs three major household surveys that require coding open-text answers into standard occupation (SINCO) and economic-activity (SCIAN/NAICS) categories: the quarterly ENIGH income-and-expenditure survey (40,000 records, 260 coders), the ENOE employment survey (30,000 records, 10 coders), and the five-yearly Intercensal Survey (over 1 million records, 600 coders). INEGI describes the manual coding process as labour-intensive, resource-heavy and prone to human error.

Objectives

Starting with ENIGH, INEGI's data-science team aimed to reduce manual coding workload for occupation and economic-activity variables while maintaining the quality achieved by traditional methods.

Activities

The team built a coding pipeline that combines deterministic keyword-matching algorithms with machine-learning classifiers (BERT and FastText), then routes low-confidence cases to human coders for quality validation. INEGI's official 2025 Annual Research Program, one of 28 projects approved from 52 proposals reviewed by its governing board, formally extends the approach to the full ENOE survey.

Results

At a 50% confidence threshold on ENIGH, presented at a December 2024 UN Statistics Division workshop, the models auto-coded 48.2% of occupation cases while matching human coders' classifications 89.4% of the time; applying the same pipeline to the full ENOE survey reached 84.8% occupation-code agreement and 76.7% economic-activity agreement with manual coding.

Conclusions

INEGI's own presentation cautions that model performance is 'strongly linked to the quality and curation of the training data,' and its next step is to build a larger, dedicated ground-truth database and test large language models directly, beyond the BERT/FastText classifiers used so far; as of the 2025 program, INEGI has published its efficiency target but not yet a post-rollout accuracy figure for full production use on ENOE.

Implementation

Indicative cost
Low (< €50k)
Time to results
Medium (1–3 years) — Piloted on the ENIGH survey, formally extended to the ENOE employment survey under INEGI's 2025 Annual Research Program, with a further large-language-model phase planned.
Staffing & skills
INEGI's in-house data-science team, Human coders across ENIGH (260), ENOE (10) and the Intercensal Survey (600) who validate low-confidence cases

Conditions for success

  • Routing low-confidence cases to human coders rather than fully automating classification
  • A formal institutional research-approval process (the 2025 Annual Research Program) to fund and govern scale-up
  • Building a larger, dedicated ground-truth database before further scaling

Common failure modes

  • INEGI's own presentation cautions that model performance is strongly linked to the quality and curation of the training data.
  • No post-rollout production accuracy figure has yet been published for full ENOE deployment.

Where it fits

Governance type
national statistics institute
Scale
national (three household surveys)
Income level
upper-middle-income

Commonly funded by

National / regional programmes

Indicative funding routes for practices of this type — always check each programme's current calls and eligibility rules.

Replication kit

Reusable artefacts from this practice — as published by their sources.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Similar practices you may find useful