Log in
/
RISK #3
Existential / Civilization-Level

Recursive Power Accumulation

AI collapses the cost of hacking, persuasion, weapons design, and strategic planning. Individuals or small groups gain nation-state power with no deterrence framework.

Severity

CRITICAL

Likelihood

MEDIUM

Reversibility

IRREVERSIBLE

Mitigation

No mitigation

Failure Mode

Nuclear weapons, but downloadable.

Key Insight

Power asymmetry without accountability is the definition of existential risk from small actors.

Linked Discussions

No discussions linked yet. Be the first to start a conversation about this risk.

Linked Incidents
Hackers Break Apple Face ID
Sep 2017 · Apple
Global Cybercrime Network Storm-2139 Allegedly Exploits AI to Generate Deepfake Content
Dec 2024 · Unidentified Storm-2139 actor from Illinois, Unidentified Storm-2139 actor from Florida, Storm-2139, Ricky Yuen (cg-dot), Phát Phùng Tấn (Asakuri), Arian Yadegarnia (Fiz), Alan Krysiak (Drago)
Anthropic Reportedly Identifies AI Misuse in Extortion Campaigns, North Korean IT Schemes, and Ransomware Sales
Aug 2025 · Unknown cybercriminals, Ransomware-as-a-service actors, North Korean IT operatives, Government of North Korea
LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem
Mar 2025 · Unnamed generative AI companies, Alibaba
Jailbroken Lovable AI Allegedly Used to Generate and Host Phishing Pages, Steal Credentials, and Bypass Security
Apr 2025 · Unknown actors, Cyber criminals, Cyber criminal networks
Phone of White House Chief of Staff Susie Wiles Allegedly Breached in Reported AI Voice Impersonation Incident
May 2025 · Unknown scammers
AI-Assisted Ransomware Campaign by FunkSec Allegedly Targets Over 80 Victims
Jan 2025 · XTN, Scorpion, FunkSec, El_Farado, DesertStorm, Blako, Bjorka
UK Bank's Voice ID Successfully Bypassed Using AI-Produced Audio
Feb 2023 · Lloyds Bank, Joseph Cox
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers
Jan 2021 · Yang Di, WaterPlum, Wagemole, Void Dokkaebi, UNC5267, Son Un Chol, Sok Kwang Hyok, Sim Hyon-Sop, Rim Un Chol, Ri Kyong Sik, Reconnaissance General Bureau, PurpleBravo, North Korean threat actors, Minh Phuong Ngoc Vong, Matthew Isaac Knoot, Lazarus Group, Ko Chung Sok, Kim Ye Won, Kim Sang Man, Kim Ryu Song, Kim Mu Rim, Jong Song Hwa, Jong Kyong Chol, Jang Chol Myong, Hyon Chol Song, Gwisin Gang, Government of North Korea, Famous Chollima, Department 53, Contagious Interview, Christina Chapman, Choe Jong Yong, Cho Chung Pom
Japanese Teen Allegedly Uses AI-Generated Program to Breach Kaikatsu Frontier and Leak Data of 7.3 Million Customers
Jan 2025 · Unnamed 17-year-old boy from Osaka
GPT-3-Based Twitter Bot Hijacked Using Prompt Injection Attacks
Sep 2022 · Stephan de Vries
Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login
Mar 2025 · Unknown scammers, Scammers impersonating Meta support, Phishers
Alleged Inclusion of 12,000 Live API Keys in LLM Training Data Reportedly Poses Security Risks
Feb 2025 · OpenAI, Microsoft Azure OpenAI Service, Microsoft, Common Crawl
ChatGPT Reportedly Referenced During Las Vegas Cybertruck Explosion Planning
Dec 2024 · OpenAI, Matthew Livelsberger
Fake AI 'Nudify' Sites Reportedly Linked to Malware Distribution by Russian Hacker Collective FIN7
Oct 2024 · Sangria Tempest, FIN7, ELBRUS, Carbon Spider
AI Chatbot Allegedly Used to Research Explosive Materials in Palm Springs Fertility Clinic Bombing
May 2025 · Guy Edward Bartkus, Daniel Park
AI-Generated Voice Purporting to Be Daughter Allegedly Used to Coerce $2,000 from Colorado Mother
Feb 2025 · Unknown scammers operating in Mexico, Unknown scammers impersonating daughter of Linda Roan, Unknown scammers
North Korea's Kimsuky Group Reportedly Uses AI-Generated Military ID Deepfakes in Phishing Campaign
Jul 2025 · Velvet Chollima, THALLIUM, Reconnaissance General Bureau, Kimsuky Group, Group 0094, Government of North Korea, Emerald Sleet, Black Banshee, APT43
CodeWall's Autonomous Agent Reportedly Obtained Unauthorized Access to McKinsey’s Lilli AI Platform Database
Feb 2026 · McKinsey & Company, CodeWall
Reported Darknet Launch of Xanthorox AI Introduces Autonomous Cyberattack Platform
Apr 2025 · Unknown malicious actors, Darknet forum users, Cyber criminals, Cyber criminal networks