In the United States, leading HR software company Workday is currently facing a lawsuit over its use of job screening tools powered by AI which allegedly discriminated against applicants based on factors such as age, disability and race.
The company, whose hiring software is widely used by large employers around the world, has denied the allegations.
The case is one of many examples of AI systems alleged to have caused discriminatory harm. When AI systems replicate and amplify discrimination, they blur the boundary between technical error and systemic injustice, turning bias into a digital harm.
And while our first instinct might be to blame the algorithms, they don’t decide what they can generate, what safeguards are built into them, or how a company responds when incidents of discrimination are reported. People make those calls long before an AI produces any output.
That is why technical fixes to AI systems are not enough. What is needed is an overhaul of AI ecosystems to ensure they are more inclusive.
