Quota-based debiasing can decrease representation of the most under-represented groups

• Published in: Royal Society open science Vol. 8; no. 9; p. 210821
• Main Authors: Smirnov, I., Lemmerich, F., Strohmaier, M.
• Format: Journal Article
• Language: English
• Published: The Royal Society 22.09.2021
• Subjects: algorithmic fairness; Computer Science and Artificial Intelligence; debiasing; intersectionality; quota
• ISSN: 2054-5703; 2054-5703
• DOI: 10.1098/rsos.210821

Many important decisions in societies such as school admissions, hiring or elections are based on the selection of top-ranking individuals from a larger pool of candidates. This process is often subject to biases, which typically manifest as an under-representation of certain groups among the selected or accepted individuals. The most common approach to this issue is debiasing, for example, via the introduction of quotas that ensure a proportional representation of groups with respect to a certain, often binary attribute. This, however, has the potential to induce changes in representation with respect to other attributes. For the case of two correlated binary attributes, we show that quota-based debiasing based on a single attribute can worsen the representation of the most under-represented intersectional groups and decrease the overall fairness of selection. Our results demonstrate the importance of including all relevant attributes in debiasing procedures and that more efforts need to be put into eliminating the root causes of inequalities as purely numerical solutions such as quota-based debiasing might lead to unintended consequences.