Sam Gilson

One-Shot GenAI Resistance

Definition

In this research, One-Shot GenAI Resistance means that a specified chatbot scores below the study’s rubric threshold on three attempts with the same question.

Explanation

The label describes a test result under stated conditions. The AIED procedure used a 60% threshold. A record should identify the model and access route, the exact question, the rubric, and when the attempts were made.

“One-shot” refers to asking the question without an extended corrective dialogue. A student may still obtain a better answer by changing the prompt, providing additional context, or working through several exchanges. That possibility is part of what makes the subsequent conversation interesting to study.

Three unsuccessful attempts give an instructor a practical selection rule. They do not establish a failure probability, a permanent capability boundary, or a guarantee that students cannot obtain a passing answer.

Scope and evidence

This is an operational label used in the AIED work. It is specific to the tested configuration and should travel with those conditions whenever it is cited.