Adaptation of the Multi-Concept Multivariate Elo Rating System to Medical Students' Training Data - ENS - École normale supérieure Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Adaptation of the Multi-Concept Multivariate Elo Rating System to Medical Students' Training Data

Résumé

Accurate estimation of question difficulty and prediction of student performance play key roles in optimizing educational instruction and enhancing learning outcomes within digital learning platforms. The Elo rating system is widely recognized for its proficiency in predicting student performance by estimating both question difficulty and student ability while providing computational efficiency and real-time adaptivity. This paper presents an adaptation of a multi-concept variant of the Elo rating system to the data collected by a medical training platform-a platform characterized by a vast knowledge corpus, substantial inter-concept overlap, a huge question bank with significant sparsity in user-question interactions, and a highly diverse user population, presenting unique challenges. Our study is driven by two primary objectives: firstly, to comprehensively evaluate the Elo rating system's capabilities on this real-life data, and secondly, to tackle the issue of imprecise earlystage estimations when implementing the Elo rating system for online assessments. Our findings suggest that the Elo rating system exhibits comparable accuracy to the well-established logistic regression model in predicting final exam outcomes for users within our digital platform. Furthermore, results underscore that initializing Elo rating estimates with historical data remarkably reduces errors and enhances prediction accuracy, especially during the initial phases of student interactions. CCS CONCEPTS • Human-centered computing → User models; • Applied computing → E-learning.
Fichier principal
Vignette du fichier
LAK24_96_preprint_HAL.pdf (5.06 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04371748 , version 1 (04-01-2024)

Licence

Paternité

Identifiants

Citer

Erva Nihan Kandemir, Jill-Jênn Vie, Adam Hegel Sanchez Ayte, Olivier Palombi, Franck Ramus. Adaptation of the Multi-Concept Multivariate Elo Rating System to Medical Students' Training Data. LAK 2024 - The 14th Learning Analytics and Knowledge Conference, Mar 2024, Kyoto, Japan. pp.1-10, ⟨10.1145/3636555.3636858⟩. ⟨hal-04371748⟩
50 Consultations
7 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More