With the increasing importance of Computational Thinking (CT) at all levels of education, it is essential to have valid and reliable assessments. Currently, there is a lack of such assessments in upper primary school. That is why we present the development and validation of the competent CT test (cCTt), an unplugged CT test targeting 7-9 year-old students. In the first phase, 37 experts evaluated the validity of the cCTt through a survey and focus group. In the second phase, the test was administered to 1519 students. We employed Classical Test Theory, Item Response Theory, and Confirmatory Factor Analysis to assess the instruments' psychometric properties. The expert evaluation indicates that the cCTt shows good face, construct, and content validity. Furthermore, the psychometric analysis of the student data demonstrates adequate reliability, difficulty, and discriminability for the target age groups. Finally, shortened variants of the test are established through Confirmatory Factor Analysis. To conclude, the proposed cCTt is a valid and reliable instrument, for use by researchers and educators alike, which expands the portfolio of validated CT assessments across compulsory education. Future assessments looking at capturing CT in a more exhaustive manner might consider combining the cCTt with other forms of assessments.
翻译:在第一阶段,37名专家通过调查和重点小组评估了CCT的有效性; 在第二阶段,对1519名学生进行了测试; 我们使用古典试验理论、项目反应理论和确认系数分析来评估仪器的心理测量特性; 专家评估表明,CCT测试的面貌、构建和内容有效性良好; 此外,对学生数据进行的精神测定分析表明,目标年龄组有足够的可靠性、难度和差异性; 最后,通过确认系数分析确定了测试的简化变式; 最后,拟议的CCTt是一种有效可靠的工具,供研究人员和教育工作者使用,以扩大CCT评估在义务教育中经过验证的组合。