Colombia's DANE uses Ridge regression on Google Trends and news data to estimate agricultural GDP 30 days before official publication. The Q2 2022 benchmark reached 8,188 billion COP, with Ridge achieving the lowest prediction error among all methods tested.
8,188 billion COP
Estimated agricultural GDP, Q2 2022 (produced ~30 days before the official figure) (Q2 2022)
~30 days
Lead time before official quarterly figure
Details
Maturity
Pilot
Promoter
Departamento Administrativo Nacional de Estadística (DANE)
Period
2022–present
Keywords
statistics, economic forecasting, agriculture, data analytics
Context
Colombia's national statistics institute DANE developed a machine-learning nowcasting model that produces an early estimate of agricultural-sector GDP approximately 30 days before the official quarterly figure is published by the national accounts team. The initiative sits within DANE's broader 'Data for Now' programme, which also applies satellite imagery analysis, night-lights data and natural language processing to accelerate other parts of the statistical production process.
Objectives
To generate a timely proxy indicator of agricultural GDP ahead of the official release, supporting early economic signalling relevant to fiscal and agricultural policy planning.
Activities
The system ingests Google News headlines, Google Trends search volumes and DANE's own administrative data series, applying Ridge regression and Zero Shot Classification (a transformer-based method) to generate the early estimate.
Results
In its first published benchmark the model estimated agricultural GDP for Q2 2022 at 8,188 billion Colombian pesos. Of the methods tested, Ridge regression achieved the lowest mean prediction error, outperforming both the Zero Shot classifier and simpler baselines. The work was peer-reviewed and published in the SciELO academic journal Estudios de Economía and was featured by the Global Partnership for Sustainable Development Data as an example of ML-driven statistical innovation.
Conclusions
Formal integration of the indicator into official DANE statistical releases, and uptake by other national statistics offices, remain works in progress.
Implementation
Indicative cost
Low (< €50k) — Uses low-cost, freely available external data sources (Google Trends, Google News) combined with DANE's existing administrative data; no dedicated infrastructure budget described.
Time to results
Medium (1–3 years) — Model developed and first benchmarked in 2022; part of an ongoing, multi-year 'Data for Now' programme with formal integration still in progress.
Staffing & skills
DANE national accounts team, DANE data science / 'Data for Now' programme staff
Conditions for success
Access to DANE's own administrative data series alongside free external signals (Google Trends, Google News)
Institutional backing via DANE's broader 'Data for Now' programme (also covering satellite imagery, night-lights and NLP)
Support from the Global Partnership for Sustainable Development Data
Common failure modes
Formal integration into official DANE statistical releases is still a work in progress
Uptake by other national statistics offices has not occurred
Where it fits
Governance type
national statistics office
Scale
national
Income level
upper-middle-income (Colombia)
Data sources
Where this practice's information was retrieved from, and when.
Mongolia's National Statistics Office piloted satellite-and-drone machine-learning models in Arkhangai province, identifying large livestock with 81.6% accuracy and traditional ger …
FAO and Timor-Leste's government built an XGBoost-corrected seasonal drought index that triggered the country's first Anticipatory Action protocol in October …