Many of these challenges are won by neural network models created by full-time artificial intelligence scientists. Due to this origin, they have a black-box character that makes their use and application less clear to learning scientists. We describe our experience with competition from the perspective of educational data mining, a field founded in the learning sciences and connected with roots in psychology and statistics. We describe our efforts from the perspectives of learning scientists and the challenges to our methods, some real and some imagined. We also discuss some basic results in the Kaggle system and our thoughts on how those results may have been improved. Finally, we describe how learner model predictions are used to make pedagogical decisions for students. Their practical use entails a) model predictions and b) a decision rule (based on the predictions). We point out how increased model accuracy can be of limited practical utility, especially when paired with simple decision rules and argue instead for the need to further investigate optimal decision rules.
翻译:其中许多挑战都是由全时人工智能科学家创造的神经网络模型所赢得的。由于这个原因,它们具有黑盒特性,使得它们的使用和应用对学习的科学家来说不那么清楚。我们从教育数据挖掘的角度描述我们的竞争经验,这是一个以学习科学为基础并与心理学和统计根源相联系的领域。我们从学习科学家的角度来描述我们的努力,以及对我们方法的挑战,有些是真实的,有些是想象的。我们还讨论了卡格勒系统中的一些基本结果,以及我们关于如何改进这些结果的想法。最后,我们描述了学习者模型预测是如何用来为学生作出教学决定的。其实际使用意味着一个模型预测和(b)一个决定规则(以预测为基础)。我们指出,提高模型准确性如何能够有有限的实际效用,特别是当与简单的决策规则相结合时,我们提出需要进一步调查最佳决策规则。