Log in
/
RISK #10
Humanity-Level Risks

Manipulation at Scale

AI models individuals better than they know themselves. Used for persuasion, addiction, political control, and consumer exploitation.

Severity

CRITICAL

Likelihood

HIGH

Reversibility

DIFFICULT

Mitigation

No mitigation


Failure Mode

Free will becomes statistically irrelevant. This is subtle, not violent.

Key Insight

The most dangerous manipulation is the kind you never notice. AI makes this the default, not the exception.


Linked Discussions

No discussions linked yet. Be the first to start a conversation about this risk.


Linked Incidents
Azerbaijani Media Agency Reportedly Warned Purported Deepfake Videos Attributed to Defense and Foreign Ministers Claimed Belarusian Plane Was Downed in Russian Airspace
Jul 2025 · Unknown disinformation actors
Purported Deepfake Video of Donald Trump at NATO Summit Allegedly Used in YouTube Crypto Scam
Jul 2025 · Unknown scammers
Purported AI Voice Cloning Used to Impersonate Secretary of State Marco Rubio
Jun 2025 · Unknown actors impersonating Marco Rubio, Unknown actors
Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users
Mar 2015 · Tinder
Alleged Instagram Algorithm Malfunction Floods Users' Reels Feeds with Violent and Graphic Content
Feb 2025 · Meta
Purportedly AI-Altered Images Reportedly Distort Evidence After Minneapolis Shooting of ICU Nurse Alex Pretti
Jan 2026 · Unknown disinformation actors, Unidentified social media users, Pro-Trump social media influencers, Partisan online accounts
Purported Deepfake Impersonation of Elon Musk Used to Promote Fraudulent '17-Hour' Diabetes Treatment Claims
Dec 2025 · Unknown scammers impersonating Elon Musk, Unknown scammers
Alleged AI-Manipulated Video Uses Macau Chief Executive Sam Hou Fai's Likeness in Investment Scam
Jun 2025 · Unknown scammers impersonating Sam Hou Fai, Unknown scammers
Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders
May 2024 · Meta, Instagram
Grammarly's AI Expert Review Allegedly Used Journalists' and Authors' Names Without Consent
Mar 2026 · Superhuman, Grammarly
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000)
Feb 2025 · Waleed B (scammer impersonating Sadhguru), Scammers impersonating Sadhguru, Mirrox, Michael C (scammer impersonating Sadhguru)
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban
Feb 2023 · Replika
User Reportedly Developed Emotional Dependence on Customized ChatGPT "Boyfriend," Citing Grief After Context Resets
Jan 2025 · OpenAI
Meta’s BlenderBot 3 Chatbot Demo Made Offensive Antisemitic Comments
Aug 2022 · Meta
Japanese Porn Depixelated by Man using Deepfake
Dec 2020 · Masayuki Nakamoto
Brazilian Authorities Link Alleged AI-Generated Marcos Mion Videos to Purported Fake Restaurant Promotions in Brazil
May 2025 · Unnamed 24-year-old male suspect from Santa Helena de Goiás
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
Oct 2025 · OpenAI
Google Gemini Reportedly Reinforced Delusions, Allegedly Contributing to Florida User's Near-Harm Episode and Suicide
Sep 2025 · Google
Woolworths' Olive Chatbot Reportedly Generated 'Angry Mother' Anecdotes During Support Calls After Gemini Upgrade
Feb 2026 · Woolworths Group
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios
Apr 2024 · TikTok users, Perplexity AI, Julia Munslow, GPT-4, GPT-3.5, ChatGPT