Do the pros of computers being in control outweigh the cons?
Superintelligence is defined as intelligence that greatly
exceeds human intelligence in all domains. As computers are
rapidly becoming smarter, experts predict that computers
will reach the stage of superintelligence within less than
50 years. A superintelligent computer will be capable of
solving universal problems like global warming or world
hunger and invent technology that humans could never even
think of.
However, experts predict that we will not have control over
superintelligence. Computers are becoming increasingly
independent at making big decisions. For example, computer
algorithms have been allowed to predict future criminals and
shape how parole is denied or granted to prisoners, without
judges, or even programmers being able to understand how
these algorithms work. This is because these types of
algorithms learn and calculate based on very large, and
complex, sets of data.
Because we will not have control and because the computer
will be much stronger than any person, a superintelligent
computer whose goal or value system is even slightly
misaligned with ours, will result in huge ethical problems.
For example, experts say it could dictate society, enforce
strict rules and eliminate anyone who stands in its way.
Does the efficiency in problem solving on a global scale
outweigh being powerless and the risks that go with that?