Evaluating the Effect of Program Visualization on Students’ Motivation

Abstract

An increase in student motivation is often cited as an expected effect of software visualization, but, as far as the authors are aware, no controlled experiments have yet demonstrated this. This paper therefore presents a controlled evaluation of this effect, conducted within the framework of self-determination theory. Students were tasked with removing redundant recursion in a multiple recursive algorithm. The experimental group (N = 19) used the SRec program visualization system, while the control group (N = 17) could use any programming tool in which they were proficient, such as BlueJ or Eclipse. The increase in motivation was measured by the difference between student scores in pre- and post-tests of their motivation. Statistically significant increases were observed for the two more determined forms of motivation, intrinsic motivation (p = 0.01), and extrinsic motivation via identified regulation (p = 0.03). Student feedback about their subjective acceptance of SRec reinforced these results. These findings give experimental support to expectations for software visualization in terms of motivation. Several paths for future work are identified, in particular, the need for more experiments under various conditions to achieve deeper understanding of the motivational effect of program visualization.