I hear you guys talking about the Singularity, or the superintelligence, or whatever-the-buzz-word-is, but of course, as usual, no one really understands what that is.
It basically says a super computer will surpass human intelligence and the human race will live thenceforth in the shadows of the Mighty Artificial Intelligence.
And that is no gonna happen.
Human race is really silly not to realize that. What is that super computer good for, the ultimate answer to the universe, and everything? (42, by the way) Stop the war, and make poverty go away? Cure cancer (well, this one might happen)?
Intelligence is evolutionarily good for satisfying our desires. Our desires does not arise from intelligence. Even intellectual desire, e.g. the desire to understand the universe, is governed by our reward center, not our rational thinking center.
Intellectual strength, just like physical strength, though awesome, are meant to serve purpose. And purpose analytically can not be reasonable. If the purpose can be reasoned, then what is the reason for this purpose, and how can we call it the end if it really is not the end, only the beginning of the chain of logical deductions that ultimately arrives at the TRUE END?
Complicated, you say.
Yes and much harder than NP.
What I’m saying is this: to understand an inferior intelligence is really not easy. You do not understand the little baby. You have no full grasp of what the dog is thinking. You could hardly imagine the happy life of a virus. (O.K. virus may be pushing this too far, how about Amoeba?）
So couldn’t the superintelligence understand what human want, lest do something about it.
If they are only slightly better than us, they may want to enslave us. However, if they are magnitudes better than us, they wouldn’t even be interested in us. They’ll foresee, with a much better confidence level than we could ever arrived at, the inevitable demise of the human race. They’d even know on which day, for those of them who are really computy. They’d be computing something much more advanced. The human world is not gonna be much changed besides we’d have better iPhones and MacBooks.
Long live the infinitely computing bandwidth computer god who cannot compute the incomputable problem yet. May the HALT never happen to you.