Deceptive Patterns
‹ All reading

Persuasive Technology and computational manipulation: hypernudging out of mental self-determination

Author
Stefano Faraoni
Date
4 Jul 2023
Publisher
Frontiers Artif. Intell.
Focus
Ethics & Responsibility
Category
Academic Scholar

This paper argues in favor of recognizing a newly emerged fundamental right, the right to mental self-determination, tailored to the unprecedented abilities of AI-driven manipulative technologies.

Artificial Intelligence, unperceived, can acquire the user’s data, find connections not visible by a human being, profile the users, and aim at persuading them, resulting in Persuasive Technology (PT). During the persuasive process, PT can use manipulation, finding and using routes to affect System 1, the primordial brain of individuals, in the absence of their awareness, undermining their decision-making processes. Multiple international and European bodies recognized that AI systems could use manipulation at an unprecedented degree via second-generation dark patterns such as the hypernudge and that computational manipulation constitutes a risk for autonomy and different, overlapping, fundamental rights such as privacy, informational self-determination and freedom of thought.