evidoria

← Back to browse

Good practice

DANE Early GDP Estimator — Colombia’s ML agricultural nowcasting model

Colombia · Bogotá · See the Colombia profile

Colombia's DANE uses Ridge regression on Google Trends and news data to estimate agricultural GDP 30 days before official publication. The Q2 2022 benchmark reached 8,188 billion COP, with Ridge achieving the lowest prediction error among all methods tested.

8,188 billion COP
Estimated agricultural GDP, Q2 2022 (produced ~30 days before the official figure) (Q2 2022)
~30 days
Lead time before official quarterly figure

Details

Maturity
Pilot
Promoter
Departamento Administrativo Nacional de Estadística (DANE)
Period
2022–present
Keywords
statistics, economic forecasting, agriculture, data analytics

Context

Colombia's national statistics institute DANE developed a machine-learning nowcasting model that produces an early estimate of agricultural-sector GDP approximately 30 days before the official quarterly figure is published by the national accounts team. The initiative sits within DANE's broader 'Data for Now' programme, which also applies satellite imagery analysis, night-lights data and natural language processing to accelerate other parts of the statistical production process.

Objectives

To generate a timely proxy indicator of agricultural GDP ahead of the official release, supporting early economic signalling relevant to fiscal and agricultural policy planning.

Activities

The system ingests Google News headlines, Google Trends search volumes and DANE's own administrative data series, applying Ridge regression and Zero Shot Classification (a transformer-based method) to generate the early estimate.

Results

In its first published benchmark the model estimated agricultural GDP for Q2 2022 at 8,188 billion Colombian pesos. Of the methods tested, Ridge regression achieved the lowest mean prediction error, outperforming both the Zero Shot classifier and simpler baselines. The work was peer-reviewed and published in the SciELO academic journal Estudios de Economía and was featured by the Global Partnership for Sustainable Development Data as an example of ML-driven statistical innovation.

Conclusions

Formal integration of the indicator into official DANE statistical releases, and uptake by other national statistics offices, remain works in progress.

Implementation

Indicative cost
Low (< €50k) — Uses low-cost, freely available external data sources (Google Trends, Google News) combined with DANE's existing administrative data; no dedicated infrastructure budget described.
Time to results
Medium (1–3 years) — Model developed and first benchmarked in 2022; part of an ongoing, multi-year 'Data for Now' programme with formal integration still in progress.
Staffing & skills
DANE national accounts team, DANE data science / 'Data for Now' programme staff

Conditions for success

  • Access to DANE's own administrative data series alongside free external signals (Google Trends, Google News)
  • Institutional backing via DANE's broader 'Data for Now' programme (also covering satellite imagery, night-lights and NLP)
  • Support from the Global Partnership for Sustainable Development Data

Common failure modes

  • Formal integration into official DANE statistical releases is still a work in progress
  • Uptake by other national statistics offices has not occurred

Where it fits

Governance type
national statistics office
Scale
national
Income level
upper-middle-income (Colombia)

Data sources

Where this practice's information was retrieved from, and when.

Similar practices you may find useful