Log in
/
RISK #2
Existential / Civilization-Level

Loss of Human Control

Humans increasingly defer decisions to AI systems. Control becomes theoretical, not practical. Humans can technically override AI — but don't understand it, are too slow to intervene, and are economically punished for doing so.

Severity

CRITICAL

Likelihood

HIGH

Reversibility

DIFFICULT

Mitigation

No mitigation


Failure Mode

Humans "in charge" the way pilots are in a fully autonomous aircraft. This is more likely than Skynet.

Key Insight

Control erosion is gradual, not sudden. By the time you notice, the reversal cost is prohibitive.


Linked Discussions

No discussions linked yet. Be the first to start a conversation about this risk.


Linked Incidents
Houston Schools Must Face Teacher Evaluation Lawsuit
May 2017 · Houston Independent School District
Malicious OpenClaw Skills Reportedly Delivered AMOS Stealer and Exfiltrated Credentials via ClawHub
Feb 2026 · Unknown threat actors distributing malicious OpenClaw skills, Unknown threat actors, Unknown malicious actors
Amazon's Monitoring System Allegedly Pushed Delivery Drivers to Prioritize Speed over Safety, Leading to Crash
Mar 2021 · Amazon
Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses
Jan 2023 · Cruise
Australian Automated Debt Assessment System Issued False Notices to Thousands
Jul 2015 · Australian Department of Human Services
Facebook’s Advertisement Moderation System Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers
Feb 2021 · Instagram, Facebook
Cruise AV Ran Over Fire Hose in Active Fire Scene
Jun 2022 · Cruise
Australian Telco’s Incident Management Bot Excessively Sent Technicians in the Field by Mistake, Allegedly Costing Millions
Feb 2018 · unnamed Australian telecommunications company
Wikipedia Vandalism Prevention Bot Loop
Feb 2017 · Wikipedia
Amazon Reportedly Sold Products and Recommended Frequently Bought Together Items That Aid Suicide Attempts
Feb 2022 · Amazon
Anthropic Said DeepSeek, Moonshot, and MiniMax Used Fraudulent Accounts and Proxies to Illicitly Distill Claude Capabilities at Scale
Feb 2026 · Proxy reseller services, Moonshot AI, MiniMax, DeepSeek
AWS Outage Reportedly Caused AI-Enabled Eight Sleep Smart Beds to Overheat and Malfunction
Oct 2025 · Eight Sleep
Cruise's Self-Driving Cars Allegedly Lost Connection to Their Server, Causing Traffic Blockages in San Francisco
May 2022 · Cruise
Cartels Reportedly Using AI to Expand Operations into Financial Fraud and Human Trafficking
Mar 2024 · Organized crime groups, Jalisco New Generation Cartel, Cartels
OpenAI's Operator Agent Reportedly Executed Unauthorized $31.43 Transaction Despite Safety Protocol
Feb 2025 · OpenAI
UT Austin GRADE Algorithm Allegedly Reinforced Historical Inequalities
Dec 2012 · University of Texas at Austin's Department of Computer Science
Alleged LLMjacking Targets AI Cloud Services with Stolen Credentials
May 2024 · LLMjacking Attackers Exploiting Laravel, Entities engaging in Russian sanctions evasion
Uber Allegedly Wrongfully Accused Drivers of Fraud via Automated Systems
Jul 2018 · Uber
Driverless Cruise Cars Immobilized in San Francisco Traffic Jam
Aug 2023 · Cruise
Moltbook Database Exposure Allegedly Revealed Users' Private Communications and API Authentication Tokens
Jan 2026 · Moltbook platform operators, Moltbook