Technological Risk Quotes

With artificial intelligence, we are summoning the demon. In all those stories where there is the guy with the pentagram and the holy water, … he’s sure he can control the demon. But it doesn’t work out.

Elon Musk, Stephen Hawking, and others have stated that they think AI is an existential risk. I disagree. I don't see a risk to humanity of a 'Terminator' scenario or anything of the sort.

Man has mounted science, and is now run away with. I firmly believe that before many centuries more, science will be the master of men. The engines he will have invented will be beyond his strength to control. Someday science may have the existence of mankind in its power, and the human race commit suicide, by blowing up the world.

People are spending way too much time thinking about climate change, way too little thinking about AI.

The danger of computers becoming like humans is not as great as the danger of humans becoming like computers.

Technological progress is like an axe in the hands of a pathological criminal.

The human race has today the means for annihilating itself—either in a fit of complete lunacy ... or by a careless handling of atomic technology, through the slow poisoning and of deterioration in its genetic structure.

It is possible that a scientific discovery will be made that humans will later regret because it has awful consequences. The problem is, we probably would not know in advance and, once the discovery is made, it cannot be undiscovered.

Above all, I would not expect a wise race, at great expense, to set loose an army of self-replicating robots.

We have also arranged things so that almost no one understands science and technology. This is a prescription for disaster. We might get away with it for a while, but sooner or later this combustible mixture of ignorance and power is going to blow up in our faces.

Technology causes problems as well as solves problems. Nobody has figured out a way to ensure that, as of tomorrow, technology won't create problems. Technology simply means increased power, which is why we have the global problems we face today.

I am not a Luddite. I am suspicious of technology. I am perfectly aware of its benefits, but I also try to pay attention to some of the negative effects.

I think we should be very careful about artificial intelligence. If I had to guess at what our biggest existential threat is, it's probably that. So we need to be very careful...With artificial intelligence we're summoning the demon.

Any mechanical invention whatsoever has been more harmful to humanity than a century of war.

I'm definitely a techno-optimist. I think we can do amazing things. But in my experience, if a thing has great potential, there is also a risk of great downsides, so to speak. Coming from a truly, really enthusiastic 'wow decade,' we are now moving into waters where we are somewhat more cautious.

If we continue to develop our technology without wisdom or prudence, our servant may prove to be our executioner.

When you invent the ship, you also invent the shipwreck; when you invent the plane you also invent the plane crash; and when you invent electricity, you invent electrocution...Every technology carries its own negativity, which is invented at the same time as technical progress.

The modern technologist is less 'sorcerer' and more 'sorcerer's apprentice'.

Many people recognize that technology often comes with unintended and undesirable side effects.

Some day science may have the existence of mankind in its power, and the human race can commit suicide by blowing up the world.

Technology tends toward avoidance of risks by investors. Uncertainty is ruled out if possible. People generally prefer the predictable. Few recognize how destructive this can be, how it imposes severe limits on variability and thus makes whole populations fatally vulnerable to the shocking ways our universe can throw the dice.

Modern Man is the victim of the very instruments he values most. Every gain in power, every mastery of natural forces, every scientific addition to knowledge, has proved potentially dangerous, because it has not been accompanied by equal gains in self-understanding and self-discipline.

If we had a reliable way to label our toys good and bad, it would be easy to regulate technology wisely. But we can rarely see far enough ahead to know which road leads to damnation. Whoever concerns himself with big technology, either to push it forward or to stop it, is gambling in human lives.

The prospect of cheap fusion energy is the worst thing that could happen to the planet.