Copium: Why We Don't Even Think About AI Risk
Relocated to
out-of-distribution.ai/copium/prop…
Relocated to
out-of-distribution.ai/copium/prop…
Friends and contemporaries: I want to draw on any respect or affection you have for me, and ask for some minutes of your time and attention.
I have never cared about anything more than this - if I only get to cash what I’ve earned from you once, I want to spend it on this post. Please read and engage.

There's a rough consensus that very capable artificial intelligence - systems that could change the world - are pretty likely within some number of decades.
Further, increasingly folk can see this happening within fewer years, and for the changes to be very large and to happen very fast. Good or bad, the outcomes are expected to be unprecedented and transformative.
Many experts currently worry about existential risks (“x-risks”.) The term got weaker over time, so to be explicit: that by default advanced AI may kill everybody. That there are several plausible risks that build on each other; that various subsets of those manifesting in combination lead to terrible outcomes.
Others don't buy this, and judge the aggregate risk negligible. Or ridiculous.
Currently, a mostly unregulated market is driving frontier AI labs to experimentally grow these systems before we understand how they work, or whether they are safe.
I think the above facts (about opinions, attitudes and beliefs) are all objectively true and backed by evidence. They involve disagreement because prediction in this area is hard, and uncertainty is large.