evidoria

← Back to browse

Good practice Imported

ISED's Four-Model Classification Pipeline for Canada's Largest-Ever AI Strategy Consultation

Canada · Ottawa · See the Canada profile · See the Ottawa profile

Top 93% 27/100 · Ask Evidence Copilot about this practice

ISED's 30-day consultation on Canada's next AI strategy drew 11,300 respondents and 64,600 answers, the largest in the department's history, then used four competing LLMs to classify themes — though critics flagged undisclosed prompts and methodology before the report shipped.

Details

Promoter
Innovation, Science and Economic Development Canada (ISED)
Period
2025-2026
Keywords
public policy, artificial intelligence, digital government

Description

Between 1 and 31 October 2025, Innovation, Science and Economic Development Canada (ISED) ran a public consultation on the country's next national AI strategy. It drew submissions from more than 11,300 participants answering 26 questions, generating over 64,600 individual responses — the largest public consultation in ISED's history.

To process that volume, ISED combined the commercial platform SimpleSurvey's natural-language-processing tools with an internally built classification pipeline that ran every submission through four different large language models — Cohere's Command A, OpenAI's GPT-5 nano, Anthropic's Claude Haiku and Google's Gemini Flash — to identify recurring themes across open-ended answers.

Independent legal scholars who reviewed the process, including University of Ottawa law professor Teresa Scassa, noted that ISED did not disclose the prompts, data flows, classification criteria or agreement thresholds used to reconcile the four models' outputs, raising questions about how reproducible or auditable the theme extraction was. ISED extended its own reporting timeline into 2026 given the volume of submissions, and the resulting 'AI for All' strategy was published in June 2026 drawing on the consultation's findings.

Read the full analysis: https://ised-isde.canada.ca/site/ised/en/public-consultations/engagements-canadas-next-ai-strategy-summary-inputs

Implementation

Implementation detail (cost, timeline, staffing, conditions for success) is not yet available for this practice.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Similar practices you may find useful