skip to main content
10.1145/3132847.3132929acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Tracking Knowledge Proficiency of Students with Educational Priors

Published: 06 November 2017 Publication History

Abstract

Diagnosing students' knowledge proficiency, i.e., the mastery degrees of a particular knowledge point in exercises, is a crucial issue for numerous educational applications, e.g., targeted knowledge training and exercise recommendation. Educational theories have converged that students learn and forget knowledge from time to time. Thus, it is necessary to track their mastery of knowledge over time. However, traditional methods in this area either ignored the explanatory power of the diagnosis results on knowledge points or relied on a static assumption. To this end, in this paper, we devise an explanatory probabilistic approach to track the knowledge proficiency of students over time by leveraging educational priors. Specifically, we first associate each exercise with a knowledge vector in which each element represents an explicit knowledge point by leveraging educational priors (i.e., Q-matrix ). Correspondingly, each student is represented as a knowledge vector at each time in a same knowledge space. Second, given the student knowledge vector over time, we borrow two classical educational theories (i.e., Learning curve and Forgetting curve ) as priors to capture the change of each student's proficiency over time. After that, we design a probabilistic matrix factorization framework by combining student and exercise priors for tracking student knowledge proficiency. Extensive experiments on three real-world datasets demonstrate both the effectiveness and explanatory power of our proposed model.

References

[1]
Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2014. Engaging with massive online courses. In Proceedings of the 23rd international conference on World wide web. ACM, 687--698.
[2]
Michel Jose Anzanello and Flavio Sanson Fogliatto. 2011. Learning curve models and applications: Literature review and research directions. International Journal of Industrial Ergonomics, Vol. 41, 5 (2011), 573--583.
[3]
Allan Birnbaum. 1968. Some latent trait models and their use in inferring an examinee's ability. Statistical theories of mental test scores (1968).
[4]
Léon Bottou. 2010. Large-scale machine learning with stochastic gradient descent. Proceedings of COMPSTAT'2010. Springer, 177--186.
[5]
Hugh Burns, Carol A Luckhardt, James W Parlett, and Carol L Redfield. 2014. Intelligent tutoring systems: Evolutions in design. Psychology Press.
[6]
Hao Cen, Kenneth Koedinger, and Brian Junker. 2006. Learning factors analysis--a general method for cognitive model evaluation and improvement Intelligent tutoring systems. Springer, 164--175.
[7]
Albert T Corbett and John R Anderson. 1994. Knowledge tracing: Modeling the acquisition of procedural knowledge. User modeling and user-adapted interaction Vol. 4, 4 (1994), 253--278.
[8]
Jimmy De La Torre. 2009. DINA model and parameter estimation: A didactic. Journal of educational and behavioral statistics, Vol. 34, 1 (2009), 115--130.
[9]
Louis V DiBello, Louis A Roussos, and William Stout. 2006. 31a review of cognitively diagnostic assessment and a summary of psychometric models. Handbook of statistics Vol. 26 (2006), 979--1030.
[10]
Hermann Ebbinghaus. 2013. Memory: a contribution to experimental psychology. Annals of neurosciences Vol. 20, 4 (2013), 155--156.
[11]
Susan E Embretson and Steven P Reise. 2013. Item response theory. Psychology Press.
[12]
Rebecca Grossman and Eduardo Salas. 2011. The transfer of training: what really matters. International Journal of Training and Development, Vol. 15, 2 (2011), 103--120.
[13]
Zhenya Huang, Qi Liu, Enhong Chen, Hongke Zhao, Mingyong Gao, Si Wei, Yu Su, and Guoping Hu. 2017. Question Difficulty Prediction for READING Problems in Standard Tests. AAAI. 1352--1359.
[14]
Brian W Junker and Klaas Sijtsma. 2001. Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement Vol. 25, 3 (2001), 258--272.
[15]
Mohammad Khajah, Rowan Wing, Robert Lindsey, and Michael Mozer. 2014. Integrating latent-factor and knowledge-tracing models to predict individual differences in learning. In Educational Data Mining 2014.
[16]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer, Vol. 42, 8 (2009).
[17]
Chih-Jen Lin. 2007. Projected gradient methods for nonnegative matrix factorization. Neural computation, Vol. 19, 10 (2007), 2756--2779.
[18]
Jingchen Liu, Gongjun Xu, and Zhiliang Ying. 2012. Data-driven learning of Q-matrix. Applied psychological measurement Vol. 36, 7 (2012), 548--564.
[19]
Qi Liu, Yong Ge, Zhongmou Li, Enhong Chen, and Hui Xiong. 2011. Personalized travel package recommendation. In Data Mining (ICDM), 2011 IEEE 11th International Conference on. IEEE, 407--416.
[20]
Zachary A Pardos and Neil T Heffernan. 2011. KT-IDEM: introducing item difficulty to the knowledge tracing model International Conference on User Modeling, Adaptation, and Personalization. Springer, 243--254.
[21]
Philip I Pavlik Jr, Hao Cen, and Kenneth R Koedinger. 2009. Performance Factors Analysis--A New Alternative to Knowledge Tracing. Online Submission (2009).
[22]
Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. 2015. Deep knowledge tracing. In Advances in Neural Information Processing Systems. 505--513.
[23]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence. AUAI Press, 452--461.
[24]
Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic Matrix Factorization. In Nips, Vol. Vol. 1. 2--1.
[25]
Jiliang Tang, Huiji Gao, Xia Hu, and Huan Liu. 2013. Exploiting homophily effect for trust prediction. Proceedings of the sixth ACM international conference on Web search and data mining. ACM, 53--62.
[26]
Nguyen Thai-Nghe, Lucas Drumond, Artus Krohn-Grimberghe, and Lars Schmidt-Thieme. 2010 a. Recommender system for predicting student performance. Procedia Computer Science Vol. 1, 2 (2010), 2811--2819.
[27]
Nguyen Thai-Nghe, Tomávs Horváth, and Lars Schmidt-Thieme. 2010 b. Factorization models for forecasting student performance Educational Data Mining 2011.
[28]
Heinz Von Foerster. 2007. Understanding understanding: Essays on cybernetics and cognition. Springer Science & Business Media.
[29]
Xiaojing Wang, James O Berger, Donald S Burdick, et almbox. 2013. Bayesian analysis of dynamic item response models in educational testing. The Annals of Applied Statistics Vol. 7, 1 (2013), 126--153.
[30]
Le Wu, Yong Ge, Qi Liu, Enhong Chen, Richang Hong, Junping Du, and Meng Wang. 2017 a. Modeling the Evolution of Users' Preferences and Social Links in Social Networking Services. IEEE Transactions on Knowledge and Data Engineering, Vol. 29, 6 (2017), 1240--1253.
[31]
Runze Wu, Guandong Xu, Enhong Chen, Qi Liu, and Wan Ng. 2017 b. Knowledge or Gaming?: Cognitive Modelling Based on Multiple-Attempt Response Proceedings of the 26th International Conference on World Wide Web Companion. International World Wide Web Conferences Steering Committee, 321--329.
[32]
Run-ze Wu, Qi Liu, Yuping Liu, Enhong Chen, Yu Su, Zhigang Chen, and Guoping Hu. 2015. Cognitive Modelling for Predicting Examinee Performance. IJCAI. 1017--1024.
[33]
Liang Xiong, Xi Chen, Tzu-Kuo Huang, Jeff Schneider, and Jaime G Carbonell. 2010. Temporal collaborative filtering with bayesian probabilistic tensor factorization Proceedings of the 2010 SIAM International Conference on Data Mining. SIAM, 211--222.
[34]
Michael V Yudelson, Kenneth R Koedinger, and Geoffrey J Gordon. 2013. Individualized bayesian knowledge tracing models. International Conference on Artificial Intelligence in Education. Springer, 171--180.
[35]
Jiani Zhang, Xingjian Shi, Irwin King, and Dit-Yan Yeung. 2017. Dynamic Key-Value Memory Networks for Knowledge Tracing Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 765--774.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management
November 2017
2604 pages
ISBN:9781450349185
DOI:10.1145/3132847
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. dynamic modeling
  2. educational priors
  3. explanatory power
  4. knowledge diagnosis

Qualifiers

  • Research-article

Funding Sources

  • the Youth Innovation Promotion Association of CAS
  • the National High Technology Research and Development Program of China
  • the National Natural Science Foundation of China
  • the Anhui Provincial Natural Science Foundataion

Conference

CIKM '17
Sponsor:

Acceptance Rates

CIKM '17 Paper Acceptance Rate 171 of 855 submissions, 20%;
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)61
  • Downloads (Last 6 weeks)6
Reflects downloads up to 25 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media