Discriminatory algorithms are a major problem for authorities, watchdog warns
NOS News•Tuesday, July 2, 5:27 PM
Discriminatory algorithms are a major problem for authorities, watchdog warns
The use of discriminatory algorithms seems widespread among government agencies. Chairman Aleid Wolfsen of the Data Protection Authority (AP) warns against this. “People are often not aware of it,” he says in the NOS Radio 1 Journal.
These are algorithms that governments use to detect fraud. “If you make a distinction based on age or educational level, you need to have a good basis for that.” The director of the privacy watchdog states that it often does not appear to be there.
As examples, he gives the controversial fraud scorecard from a number of municipalities. And the abuses at the Department of Education Implementation (DUO) with student loans. NOS op 3 and research firm Investico found out that DUO students with a migration background or a lower educational level accused of fraud far more often.
Painful
Wolfsen calls it particularly painful that there was no good basis for using these risk indicators in DUO's algorithm. In an interview with de Volkskrant he says today: “The fact that we find these types of systems with every tile we light worries me. So it is likely that there is widespread discrimination.”
Before the problem has been warned for years. Authorities say they are struggling with the pressure to detect misuse of taxpayers' money with limited resources. 100 percent control is unattainable, so investigations are being conducted where the risk of fraud is highest.
It is logical that these kinds of choices are made, Wolfsen agrees. “Only then do you have to have a substantive reason for the selection criteria.”
Awareness
According to the AP director, awareness is an important part of the solution. “Systems are created by programmers, who often have less idea on what basis you can make a distinction. While people who make policies are usually less familiar with how the algorithm works. That's where things often go wrong,” he explains.
Another recommendation is transparency about the use of algorithms to detect fraud. Let us know what factors are singling out a person based on, advises Wolfsen. In addition, the AP itself wants to do more and double the watchdog agency's workforce. “We should investigate spontaneously more often, rather than after a complaint.”
The director refers back to the controversial algorithm that DUO used to detect abuses. “That system has been used for ten years and we have had no complaint about it. Victims were not aware that they were selected based on an algorithm.”
The functioning of the AP has also been criticized in recent years. The National Ombudsman concluded in 2021 that many citizens with a complaint were in front of a closed door. Even the following year, there were still problems due to backlogs and long waiting times.
- Outback
.avif)