evidoria

← Back to browse

Good practice Imported

STT's Machine-Learning Risk Model for Public-Procurement Fraud and Corruption

Lithuania · Vilnius · See the Lithuania profile · See the Vilnius profile

Evidence: Observational / pre–post Top 22% 73/100 · Ask Evidence Copilot about this practice

Lithuania's STT, with the OECD and Government Transparency Institute (EU-funded), built a Hellinger Distance Random Forest on 11 merged datasets. Its top-risk quartile of contracts captured 60% of known criminal-offence cases, versus 25% at random.

60 %
Contracts with proven/suspected offences captured in top-risk quartile
25 %
Expected capture rate under random selection
about 5x
Known-case capture multiplier in top decile vs chance
11
Administrative datasets integrated into the analytical database
STT's Machine-Learning Risk Model for Public-Procurement Fraud and Corruption

Details

Maturity
Pilot
Promoter
Special Investigation Service of the Republic of Lithuania (STT)
Period
2024–2025
Region (NUTS)
LT01
Keywords
anti-corruption, public procurement, law-enforcement analytics

Context

Lithuania's Special Investigation Service (STT) worked with the OECD and the Government Transparency Institute, funded by the European Commission's Technical Support Instrument, to build a machine-learning risk-assessment tool for public procurement. The team integrated eleven administrative datasets — covering criminal and administrative offences, company registries, beneficial ownership, blacklisting and EU-funded project data — into a single analytical database, restructuring procurement records from tender-level to lot-level to capture bidding dynamics.

Objectives

The goal was to help STT analysts prioritise investigative attention on the procurement contracts most likely to involve fraud or corruption, while keeping every prediction explainable so it guides investigator judgement rather than replacing it.

Activities

Because only a small share of contracts are linked to confirmed offences, the team used a Hellinger Distance Stratified Random Forest, a method designed for Positive-Unlabelled learning and severe class imbalance. Every prediction is paired with SHAP (SHapley Additive exPlanations) values in an interactive dashboard, so analysts can trace which factors — bidding patterns, ownership concentration, network position — drove a given contract's risk score.

Results

In back-testing, focusing investigative attention on the top 25% of contracts by predicted risk captured roughly 60% of contracts linked to proven or suspected criminal offences, versus the 25% expected under random selection, and the top 10% captured about five times more known cases than chance.

Conclusions

The OECD's published case study is explicit that this is a proof-of-concept, not an operational system: it recommends an initial phase of annual updates backed by a stable data pipeline before wider deployment, and stresses that the tool is meant to guide investigator judgement, not replace it.

Implementation

Indicative cost
Medium (€50k–€500k) — No published budget figure; the work was delivered as technical assistance funded by the European Commission's Technical Support Instrument, with OECD and Government Transparency Institute expertise rather than a large capital build.
Time to results
Short (< 1 year) — Developed during 2024–2025 as a proof-of-concept; the OECD recommends an initial phase of annual model updates on a stable data pipeline before any wider operational rollout.
Staffing & skills
STT (Special Investigation Service of Lithuania) analysts using the SHAP dashboard, OECD technical-assistance team, Government Transparency Institute researchers

Conditions for success

  • integration of eleven administrative datasets into a single analytical database
  • a Positive-Unlabelled learning method (Hellinger Distance Stratified Random Forest) suited to severe class imbalance in offence labels
  • SHAP-based explainability so investigators can trace and trust individual risk scores
  • a stable, regularly-updated data pipeline before wider operational deployment

Common failure modes

  • remains a proof-of-concept without the annual-update data pipeline the OECD recommends before operational use
  • only a small share of contracts carry confirmed offence labels, limiting how confidently the model generalises.

Where it fits

Governance type
national anti-corruption/law-enforcement agency
Scale
national
Income level
high-income

Replication kit

Reusable artefacts from this practice — as published by their sources.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful