The right goal, the wrong approach
In an interview with the newspaper taz, Steen, spokesman for the AI section of the German Informatics Society, agreed that speeding up and digitalising procedures is a good idea. But he said the draft sets no uniform system architecture or usage process, leaves each authority to decide how to use AI, and ignores the cost of training decision-makers.
“What is in the draft law seems ill-considered and gives the authorities involved a blank cheque for the unreflective use of technology.” – Alexander Steen, professor of computer science at the University of Greifswald
When people trust machines more than themselves
Steen is particularly concerned about “automation bias,” in which people trust the recommendations of automated systems more than their own judgement. Although humans formally still make the final decision, the risk is that AI recommendations are increasingly accepted without question.














