Geek Quote of the Day
For Armstrong, the AI we should be afraid of is not the “beatable humanoid robot we see in the movies” but rather a computer program or even a digital avatar that has been freed from our “biological limitations” to demonstrate “skills and abilities beyond what is considered to be human”; whether the ability to plan centuries ahead, to see patterns that we cannot or to link instantly to the internet, or even the social skill of “being always able to say the right thing at the right time” to get what it wants without humans even realising the game play. “AI would be able to use its superpowers to accumulate vast fortunes on the stock exchange, or even ‘be Google’, as AI would be cheaper and more productive than the human workers currently employed. It could even be a Super Clinton or Super Goebbels, able to take over by persuading us to let it.” Or it may gain more powers that we have not even thought of, given that “the space beyond human intelligence is vast”.
Luke Muehlauser agrees that AI is a threat, but believes that a friendly AI can be built that would “be benign to humans”. “Any intelligence is dangerous, and any intelligence that doesn’t share your goals is doubly dangerous, and any constraint we could devise for the AI merely pits human intelligence against superhuman intelligence, and we should expect the latter to prevail. That’s why we need advanced AIs to want the same things we want.
“So friendly AI is an AI that has a positive rather than negative effect on human beings. To be a friendly AI, we think an AI must want what humans want. Once a superintelligent AI wants something different than we want, we’ve already lost.”
- - “AI uprising: humans will be outsourced, not obliterated” by Mark Piesing, May 17, 2012.
Originally posted by Wired UK.

