IGC and ZamStats Use GPT Models to Speed Up Zambia's Labour Force Survey Coding
Zambia
Zambia's national statistics agency and the IGC tested seven LLMs against 1,059 human-coded Labour Force Survey responses: the best models …
Mexico · Aguascalientes · See the Mexico profile
Evidence: Observational / pre–post Top 24% 73/100 · Ask Evidence Copilot about this practice
Mexico's statistics institute INEGI is scaling BERT/FastText-based AI coding from its household income survey to the national employment survey, formally targeting up to a 50% cut in manual coding workload for occupation and industry classification without losing accuracy.
Mexico's national statistics institute, INEGI, runs three major household surveys that require coding open-text answers into standard occupation (SINCO) and economic-activity (SCIAN/NAICS) categories: the quarterly ENIGH income-and-expenditure survey (40,000 records, 260 coders), the ENOE employment survey (30,000 records, 10 coders), and the five-yearly Intercensal Survey (over 1 million records, 600 coders). INEGI describes the manual coding process as labour-intensive, resource-heavy and prone to human error.
Starting with ENIGH, INEGI's data-science team aimed to reduce manual coding workload for occupation and economic-activity variables while maintaining the quality achieved by traditional methods.
The team built a coding pipeline that combines deterministic keyword-matching algorithms with machine-learning classifiers (BERT and FastText), then routes low-confidence cases to human coders for quality validation. INEGI's official 2025 Annual Research Program, one of 28 projects approved from 52 proposals reviewed by its governing board, formally extends the approach to the full ENOE survey.
At a 50% confidence threshold on ENIGH, presented at a December 2024 UN Statistics Division workshop, the models auto-coded 48.2% of occupation cases while matching human coders' classifications 89.4% of the time; applying the same pipeline to the full ENOE survey reached 84.8% occupation-code agreement and 76.7% economic-activity agreement with manual coding.
INEGI's own presentation cautions that model performance is 'strongly linked to the quality and curation of the training data,' and its next step is to build a larger, dedicated ground-truth database and test large language models directly, beyond the BERT/FastText classifiers used so far; as of the 2025 program, INEGI has published its efficiency target but not yet a post-rollout accuracy figure for full production use on ENOE.
National / regional programmes
Indicative funding routes for practices of this type — always check each programme's current calls and eligibility rules.
Reusable artefacts from this practice — as published by their sources.
Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.
Where this practice's information was retrieved from, and when.
Zambia
Zambia's national statistics agency and the IGC tested seven LLMs against 1,059 human-coded Labour Force Survey responses: the best models …
United Kingdom
ONS's Data Science Campus benchmarked ML autocoding for SIC/SOC survey classification, reaching 73–85% match rates across five surveys versus 50–62% …
Belgium
A 20-entity, 300-civil-servant pilot of Microsoft 365 Copilot run by Digitaal Vlaanderen found 41% more productive and 64% wanting to …
United Kingdom
The UK ONS built the open-source ClassifAI package to auto-code survey text into official classifications, halving processing time for occupation …
Open full copilot Grounded in cited practices — always check the sources.