• OpenAccess
  • Fine-Grained Detection of Programming Students’ Frustration Using Keystrokes, Mouse Clicks and Interaction Logs  [ICETR 2016]
  • DOI: 10.4236/jss.2016.49002   PP.9 - 18
  • Author(s)
  • Fwa Hua Leong
  • Prolonged frustration leads to loss of confidence and eventual disinterest in the learn-ing itself. The modelling of frustration in learning is thus important as it informs on the appropriate time to intervene to sustain the interest and motivation of students. To automatically detect learner’s frustration in a naturalistic learning environment, the novel use of keystrokes, mouse clicks and interaction patterns of students captured within the context of a tutoring system was proposed. The modelling approach was described and a comparison was made between the proposed model using Bayesian Network and the baseline Na?ve Bayes model. With the formulation of an overlapped sliding window mechanism, the granularity of detection was also investigated. The re-sults confirm the hypothesis that a combination of keystrokes, mouse clicks and inter-action logs can be used to accurately distinguish affective states of frustration and non-frustration amongst novice learners of computer programming in a granular fashion.
  • Learning, Frustration, Detect, Keystrokes, Programming
  • References
  • [1]
    [1] Merrill, D.C., Reiser, B.J., Ranney, M. and Trafton, J.G. (1992) Effective Tutoring Tech-niques: A Comparison of Human Tutors and Intelligent Tutoring Systems. The Journal of the Learning Sciences, 2, 277-305.
    Pekrun, R., Goetz, T., Titz, W. and Perry, R.P. (2002) Academic Emotions in Students’ Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research. Educational Psychologist, 37, 91-105.
    Stein, N.L., Levine, L.J., Stein, N., Le-venthal, B. and Trabasso, T. (1990) Making Sense out of Emotion: The Representation and Use of Goal-Structured Knowledge. Psychological and Biological Approaches to Emotion, 45-73.
    Kort, B., Reilly, R. and Picard, R.W. (2001) An Affective Model of Interplay between Emotions and Learning: Reengineering Educational Pedagogy-Building a Learning Companion. IEEE International Conference on Advanced Learning Technologies, IEEE Computer Society, 0043.
    Linnenbrink-Garcia, L. and Pekrun, R. (2011) Students’ Emotions and Academic Engagement: Introduction to the Special Issue. Contemporary Educational Psychology, 36, 1-3.
    Pekrun, R. (2006) The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice. Educational Psychology Review, 18, 315-341.
    Bartlett, M.S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I. and Movellan, J. (2006) Fully Automatic Facial Action Recognition in Spontaneous Behavior. 7th International Conference on Automatic Face and Gesture Recognition, 2006, FGR 2006, 223-230.
    Grafsgaard, J.F., Wiggins, J.B., Boyer, K.E., Wiebe, E.N. and Lester, J.C. (2013) Automatically Recognizing Facial Expression: Predicting Engagement and Frustration. Proceedings of the 6th International Conference on Educational Data Mining.
    Kapoor, A., Mota, S. and Picard, R.W. (2001) Towards a Learning Com-panion that Recognizes Affect. AAAI Fall Symposium, 2-4.
    D'Mello, S. and Graesser, A. (2009) Automatic Detection of Learner’s Affect from Gross Body Language. Applied Artificial Intelligence, 23, 123-150.
    Haag, A., Goronzy, S., Schaich, P. and Williams, J. (2004) Emotion Recognition Using Bio-Sensors: First Steps towards an Automatic System. ADS Springer, 36-48.
    Healey, J.A. and Picard, R.W. (2005) Detecting Stress during Real-World Driving Tasks Using Physiological Sensors. IEEE Transactions on Intelligent Transportation Systems, 6, 156-166.
    Dowland, P., Furnell, S. and Papadaki, M. (2002) Keystroke Analysis as a Method of Advanced User Authentication and Response. In: Security in the Information Society, Springer, 215-226.
    Joyce, R. and Gupta, G. (1990) Identity Authentication Based on Keystroke Latencies. Communications of the ACM, 33, 168-176.
    Leong, F.H. (2015) Automatic Detection of Fru-stration of Novice Programmers from Contextual and Keystroke Logs. 2015 10th International Conference on Computer Science & Education (ICCSE), 373-377.
    Baker, R.S. (2007) Modeling and Understanding Students’ Off-Task Behavior in Intelligent Tutoring Systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1059-1068.
    Carter, J. and Dewan, P. (2010) Design, Implementation, and Evaluation of an Approach for Determining when Programmers Are Having Difficulty. Proceedings of the 16th ACM International Conference on Supporting Group Work, ACM, 215-224.
    Conati, C. and Maclaren, H. (2009) Empir-ically Building and Evaluating a Probabilistic Model of User Affect. User Modeling and Us-er-Adapted Interaction, 19, 267-303.
    Scheirer, J., Fernandez, R., Klein, J. and Picard, R.W. (2002) Frustrating the User on Purpose: A Step toward Building an Affective Computer. Interacting with Computers, 14, 93-118.
    Bloom, B.S. (1984) The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring. Educational Researcher, 4-16.
    Pearl, J. (1988) Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Reasoning. Morgan Kaufmann Publishers, Los Altos.
    Jordan, M.I. (1998) Learning in Graphical Models. Proceedings of the NATO Advanced Study Institute, Ettore Mairona Center, Erice, 27 September-7 October 1996, Springer Science & Business Media.
    Murphy, K. (2001) The Bayes Net Toolbox for Matlab. Computing Science and Statistics, 33, 1024-1034.
    John, G.H. and Langley, P. (1995) Estimating Continuous Distributions in Bayesian Classifiers. Proceedings of the Eleventh conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann Publishers Inc., 338-345.
    Kotsiantis, S. and Kanellopoulos, D. (2006) Discretization Techniques: A Recent Survey. GESTS International Transactions on Computer Science and Engineering, 32, 47-58.
    Kurgan, L. and Cios, K.J. (2004) CAIM Discretization Algorithm. IEEE Transactions on Knowledge and Data Engineering, 16, 145-153.
    Fawcett, T. (2006) An Introduction to ROC Analysis. Pattern Recognition Letters, 27, 861-874.

Engineering Information Institute is the member of/source content provider to