Home › Articles› Abstract
Research Article

Unbias me! Mitigating Algorithmic Bias for Less-studied Demographic Groups in the Context of Language Learning Technology

Nathalie Rzepka1 · Linda Fernsel1 · Hans-Georg Müller2 · Katharina Simbeck1 · Niels Pinkwart3

1 Department of Computer Science, University of Applied Sciences (HTW) Berlin, 2 Department of German Studies, University of Potsdam, 3 Department of Computer Science, Humboldt-University Berlin

Published: May 2024 · Vol. 6 No. 1 · pp. 1-23

DOI: https://doi.org/10.5281/zenodo.7996194

Full Text

Abstract

Algorithms and machine learning models are being used more frequently in educational settings, but there are concerns that they may discriminate against certain groups. While there is some research on algorithmic fairness, there are two main issues with the current research. Firstly, it often focuses on gender and race and ignores other groups. Secondly, studies often find algorithmic bias in educational models but don't explore ways to reduce it. This study evaluates three drop-out prediction models used in an online learning platform to teach German spelling skills. The aim is to assess the fairness of the models for (in part) less-studied demographic groups, including first spoken language, home literacy environment, parental education background, and gender. To evaluate the models, four fairness metrics are used: predictive parity, equalized odds, predictive equality, and ABROCA. The study also examines ways to reduce algorithmic bias by analyzing the models at each stage of the machine learning process. The results show that all three models had biases that affected the fairness of all four demographic groups to varying degrees. However, the study found that most biases could be mitigated during the process. The methods used to mitigate bias differed by demographic group, and some methods improved fairness for one group but worsened it for others. Therefore, the study concludes that reducing algorithmic bias for lessstudied demographic groups is possible, but finding the right method for each algorithm and demographic group is crucial. Rzepka, N., Fernsel, L., Müller, H., Simbeck, K., & Pinkwart, N., (2023) Unbias me! Mitigating Algorithmic Bias for Less-studied Demographic Groups in the Context of Language Learning Technology. Computer-Based Learning in Context, 6 (1), 1-23.
Keywords: Algorithmic BiasDiscriminationFairnessEducational Data MiningPredictionDropout PredictionLanguage Learning