Why Students Engage in “Gaming the System” Behavior in Interactive Learning Environments
📜 Abstract
In recent years there has been increasing interest in the phenomena of “gaming the system,” where a learner attempts to succeed in an educational environment by exploiting properties of the system’s help and feedback rather than by attempting to learn the material. Developing environments that respond constructively and effectively to gaming depends upon understanding why students choose to game. In this article, we present three studies, conducted with two different learning environments, which present evidence on which student behaviors, motivations, and emotions are associated with the choice to game the system. We also present a fourth study to determine how teachers’ perspectives on gaming behavior are similar to, and different from, researchers’ perspectives and the data from our studies. We discuss what motivational and attitudinal patterns are associated with gaming behavior across studies, and what the implications are for the design of interactive learning environment.
✨ Summary
Findings
The paper investigates why students engage in “gaming the system”: attempting to complete educational tasks by exploiting help, feedback, or answer-validation mechanisms rather than learning the underlying material. It reports three questionnaire studies involving Cognitive Tutors and ASSISTments, plus a survey of teachers’ beliefs about gaming. Gaming was detected using both machine-learned and knowledge-engineered behavioral models. (pact.cs.cmu.edu)
Across the student studies, the most consistent correlates of gaming were dislike of mathematics, lack of educational self-drive, and frustration—especially frustration caused by difficult problems. There was weaker or mixed evidence for associations with disliking computers, disliking the learning environment, believing mathematical ability is innate, and believing that tutor help is not useful. The studies found no convincing relationship between gaming and performance goals, anxiety, believing mathematics is unimportant, desire for control, passive-aggressiveness, or perceiving the tutor as uncaring. Teachers correctly identified frustration and lack of self-drive as important factors, but, like earlier researchers, incorrectly predicted a strong role for performance goals. (pact.cs.cmu.edu)
The design implications are to reduce avoidable frustration while preserving productive challenge. The authors propose clearer and more concise hints and feedback, shorter problems or lessons, carefully calibrated difficulty, opportunities to skip or select problems, and limited learner choice. The central design claim is that systems should address the affective and contextual causes of gaming rather than merely detecting and suppressing the behavior.
Influence on later research and practice
Later research explicitly cites this work as part of the seminal foundation for studying gaming the system and uses its definition when investigating the behavior in other digital learning environments. Subsequent studies expanded automated detection beyond Cognitive Tutors and ASSISTments, examined how contextual and task-design variation affects detection, and analyzed gaming in additional systems such as Newton’s Playground and digital learning games. (pmc.ncbi.nlm.nih.gov)
The paper also contributed to a continuing research program on student affect, engagement, detection, and interventions. The authors’ later project documentation describes follow-on work on affective states, gaming detectors, and adaptive responses, while later intervention research has evaluated methods for discouraging gaming and improving learning outcomes. (cs.cmu.edu)
In summary, the paper’s concrete influence is primarily methodological and conceptual: it helped establish gaming the system as a measurable form of behavioral disengagement, linked it to motivation and affect, and motivated detector, intervention, and learning-environment design research across multiple platforms.