BRIGHT EVIDENCE PACK / Demonstrated
When the answer arrives too soon.
A preregistered randomized trial in a Turkish high school compared a standard GPT-4 chat interface, a teacher-informed GPT tutor with guardrails, and no generative-AI resource during mathematics study sessions.
Canonical Bright record · JSON evidence pack · Key-facts embed
Dates and assessment
- Source published
- 2025-06-25
- Bright published
- 2026-09-07
- Substantive update
- None recorded
- Evidence state
- Demonstrated
- Independent verification
- Not established by this source review
- Last source review
- 2026-09-07
The claim in context
The human problem
A tool that makes practice easier can also let a learner bypass the thinking needed to solve a problem alone.
The prior constraint
Widely available chat interfaces are designed to be helpful in the moment, not necessarily to protect learning.
AI’s actual role
The study compared GPT-4 assistance that resembled ordinary chat with a version whose prompts and boundaries were designed with teacher input to support learning.
The documented result
The paper's preregistered primary analysis of unassisted exams found that generative AI without guardrails could harm learning. The teacher-informed guardrailed tutor largely mitigated that negative effect.
Why it may matter
It makes the design of help visible: a system can improve assisted performance yet leave less learning when the assistance disappears.
Limitations
- The study examined short-term exam outcomes in one high-school mathematics setting.
- The paper says the guardrailed tutor mitigated harm; it does not establish a complete or universally effective learning design.
- Long-term retention and transfer were not measured.
Original evidence
Attribution
Credit Bright AI Future and link the canonical Bright record.
- Link to the canonical Bright record.
- Keep material limitations with the claim they qualify.
- Link to the original evidence when repeating a substantive claim.
- Do not describe a source check or organization-reported result as independent verification.
Linked source material, quotations, trademarks and media remain subject to their owners’ terms. No reuse right is granted for third-party media.
