evidoria

← Back to browse

Good practice Imported

CS50 Duck (CS50.ai) — Harvard's Guardrailed AI Teaching Assistant for a Massive Introductory Programming Course

United States of America · Cambridge · See the United States of America profile · See the Cambridge profile

Top 40% 53/100 · Ask Evidence Copilot about this practice

Since spring 2023 Harvard's CS50 has deployed a deliberately 'less helpful' LLM duck debugger that guides rather than answers; authors report positive student feedback, while admitting guardrails are probabilistic.

CS50 Duck (CS50.ai) — Harvard's Guardrailed AI Teaching Assistant for a Massive Introductory Programming Course

Details

Promoter
Harvard University (CS50)
Period
2023–present
Keywords
higher education, computer science, AI tutor, guardrails

Description

CS50, Harvard's introductory computing course (also delivered online as CS50x), launched the CS50 Duck in spring 2023 as part of CS50.ai. It is built on a commercial LLM API but wrapped in prompts and code checks intended to stop it giving outright solutions, plus a 'heart' system that limits questions per period.
The course team's SIGCSE 2024 paper (Liu, Zenke, Liu, Holmes, Thornton, Malan) reports student feedback in which roughly 75% used the tools frequently and 94% found them helpful; this is self-reported feedback, not a controlled learning-outcome study.
Harvard Gazette coverage records the team's own caveats: guardrails are not deterministic, the Duck can still emit code blocks in up to a quarter of responses, and some students asked around 200 questions. The course positions the tool as a net positive that eases demand on staff in a very large class, with explicit academic-honesty rules on permitted AI use.
Value for other institutions: a documented, openly described design for scaling tutor-like support, with honest reporting of failure modes; missing is causal evidence on learning gains.

Read the full analysis: https://cs50.harvard.edu/x/notes/ai/

Implementation

Implementation detail (cost, timeline, staffing, conditions for success) is not yet available for this practice.

Do you run this practice? Claim it — verified implementers get a public contact pathway and can propose corrections.

Data sources

Where this practice's information was retrieved from, and when.

Attachments

Similar practices you may find useful

★ 73

Khanmigo — Khan Academy's AI tutor

United States of America

Khan Academy's LLM tutor that guides students with questions rather than answers, scaled to 700,000+ students across 380+ US districts …