How dangerous is AI?

This guy confidently says AI is going to kill us all. He makes some compelling arguments. It is really worth reading his blog post. AGI Ruin: A List of Lethalities - LessWrong. Below is a drastically reduced summary.

1. AGI will not be upper-bounded by human ability or human learning speed. Things much smarter than human would be able to learn from less evidence than humans require.

2. An AGI smarter than ourselves will not find it difficult to escape counter-measures and bootstrap existing human infrastructure to kill us all. (He gives the example of shipping instructions to a biolab to make nanobots or a virus)

3. We need to get the alignment problem right on the first critical try. We do not get to try again. Science is full of blunders soooo this is not good if his assumptions are true.

4. We cannot say "Lets not build AGI" because GPU's are everywhere, and countries and companies are in an arms race to build bigger, faster, stronger.

I just started a topic on mitigating the potential dangers of artifical intelligence check it out.

Yikes that was a scary podcast

By At_moon_what_now

· Reply

More to explore:

Dopamine and habits

Habits are the autopilot of our lives, but what keeps them running smoothly? The answer lies in the complex interplay of neural pathways and chemicals, with dop...

Taking on the Camino for Ovarian Cancer

Shortcuts

  • Follow Ingrid Clancy’s progress step by step, on her picture blog at http://bit.ly/IngridClancy2024 (please “Follow” and “Comment” there to give her ...

AI & Over Optimization

Artificial Intelligence is based on optimization. A measurable goal is set, and the system updates to better achieve that goal. This ALWAYS involves maximizing ...