evidoria

← Back to browse

Good practice Imported

CGU's MCP Bridge for Brazil's Open Data — Testing Whether LLMs Can Be Trusted with Government Datasets

Brazil · Brasília · See the Brazil profile · See the Brasília profile

Evidence: Descriptive / self-reported Top 46% 60/100 · Ask Evidence Copilot about this practice

Brazil's anti-corruption watchdog CGU and Uruguay's AGESIC piloted an open-source bridge letting citizens query government open data in plain language via LLMs — and found the real risk wasn't the technical link but the model inventing facts absent from the data.

CGU's MCP Bridge for Brazil's Open Data — Testing Whether LLMs Can Be Trusted with Government Datasets

Details

Maturity
Pilot
Promoter
Controladoria-Geral da União (CGU) — Brazil's Office of the Comptroller General
Period
2026 (prototype phase)
Keywords
open data, transparency, digital government, artificial intelligence, public data access

Context

Brazil's Controladoria-Geral da União (CGU), the federal transparency and anti-corruption body, partnered with the Open Knowledge Foundation (OKFN) and Uruguay's e-government agency AGESIC to test whether large language models can be trusted to answer citizens' questions about official open data.

Objectives

Test whether LLMs, connected via the Model Context Protocol (MCP) to CKAN (the open-source software powering most public data portals, including Brazil's federal transparency portal), can reliably answer plain-language citizen questions about open government data, and produce a reproducible blueprint other CKAN-based governments could adopt.

Activities

In Brazil, the pilot targeted congressional parliamentary amendments data. In a parallel pilot, Uruguay connected the same architecture to its National Energy Balance dataset (energy imports, generation and installed capacity).

Results

The technical connection worked; the harder problem was trust. Answer quality depended less on the pipeline than on how well the underlying data was described (units, field definitions, valid assumptions). In testing on the Uruguayan dataset, the model fabricated "climate factors" as part of its explanation even though no climate data existed anywhere in the source — a concrete, publicly documented hallucination.

Conclusions

The team argues for mandatory domain-expert review of dataset descriptions before any citizen-facing deployment. As of publication the work remains a two-dataset prototype; the next planned phase is user testing with real-world citizen questions rather than production rollout.

Implementation

Indicative cost
Low (< €50k)
Time to results
Short (< 1 year)
Staffing & skills
CGU technical team, Open Knowledge Foundation (OKFN), Uruguay's AGESIC

Conditions for success

  • well-described datasets (clear units, field definitions, valid assumptions)
  • mandatory domain-expert review of dataset descriptions before citizen-facing deployment
  • reuse of the MCP + CKAN pattern to keep the design portable across governments

Common failure modes

  • LLM hallucination of facts/fields absent from the source data (documented "climate factors" fabrication)
  • risk of citizen-facing deployment without adequate domain-expert review of the underlying data

Where it fits

Governance type
national anti-corruption/transparency authority, working with an international nonprofit and a foreign e-government agency
Scale
prototype — two datasets across two countries
Income level
upper-middle-income

Commonly funded by

National / regional programmes

Indicative funding routes for practices of this type — always check each programme's current calls and eligibility rules.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful