Anthropic CEO Warns of AI Dangers, Doubts Society's Readiness for Superintelligence

• Dario Amodei, Anthropic CEO, published a 38-page essay detailing existential and societal risks of powerful AI, despite his company's continued development.
• Amodei warns that humanity is entering a turbulent phase where AI will grant 'unimaginable power,' questioning society's maturity to handle it.
• The essay identifies five major concerns: autonomy, individual misuse (biology), state misuse (authoritarian regimes), economic disruption, and cultural/psychological effects.
• He uses the metaphor 'a country of geniuses in a datacenter' to describe millions of superintelligent AIs coordinating at machine speed, posing a 'civilizational risk'.
• Amodei advocates for incremental, evidence-based regulation like transparency laws and export controls on advanced chips, rather than sweeping bans.

Why It Matters: Anthropic CEO warns of AI's immense power and risks, urging cautious regulation while acknowledging development continues.