Why give a robot an order to obey orders—why aren't the original orders enough? Why command a robot not to do harm—wouldn't it be easier never to command it to do harm in the first place? Does the universe contain a mysterious force pulling entities toward malevolence, so that a positronic brain must be programmed to withstand it? Do intelligent beings inevitably develop an attitude problem? (…) Now that computers really have become smarter and more powerful, the anxiety has waned. Today's ubiquitous, networked computers have an unprecedented ability to do mischief should they ever go to the bad. But the only mayhem comes from unpredictable chaos or from human malice in the form of viruses. We no longer worry about electronic serial killers or subversive silicon cabals because we are beginning to appreciate that malevolence—like vision, motor coordination, and common sense—does not come free with computation but has to be programmed in. (…) Aggression, like every other part of human behavior we take for granted, is a challenging engineering problem!

Why give a robot an order to obey orders—why aren't the original orders enough? Why command a robot not to do harm—wouldn't it be easier never to command it to do harm in the first place? Does the universe contain a mysterious force pulling entities toward malevolence, so that a positronic brain must be programmed to withstand it? Do intelligent beings inevitably develop an attitude problem? (…) Now that computers really have become smarter and more powerful, the anxiety has waned. Today's ubiquitous, networked computers have an unprecedented ability to do mischief should they ever go to the bad. But the only mayhem comes from unpredictable chaos or from human malice in the form of viruses. We no longer worry about electronic serial killers or subversive silicon cabals because we are beginning to appreciate that malevolence—like vision, motor coordination, and common sense—does not come free with computation but has to be programmed in. (…) Aggression, like every other part of human behavior we take for granted, is a challenging engineering problem!

Steven Pinker
Save QuoteView Quote
Similar Quotes by steven-pinker

Many artists and scholars have pointed out that ultimately art depends on human nature.

Steven Pinker
Save QuoteView Quote

There is no society ever discovered in the remotest corner of the world that has not had something that we would consider the arts. Visual arts - decoration of surfaces and bodies - appears to be a human universal.

Steven Pinker
Save QuoteView Quote

Art works because it appeals to certain faculties of the mind. Music depends on details of the auditory system, painting and sculpture on the visual system. Poetry and literature depend on language.

Steven Pinker
Save QuoteView Quote

The decline of violence isn't a steady inclined plane from an original state of maximal and universal bloodshed. Technology, ideology, and social and cultural changes periodically throw out new forms of violence for humanity to contend with.

Steven Pinker
Save QuoteView Quote

Technology, ideology, and social and cultural changes periodically throw out new forms of violence for humanity to contend with.

Steven Pinker
Save QuoteView Quote

Reading is a technology for perspective-taking. When someone else's thoughts are in your head, you are observing the world from that person's vantage point.

Steven Pinker
Save QuoteView Quote

The rules of friendship are tacit, unconscious; they are not rational. In business, though, you have to think rationally.

Steven Pinker
Save QuoteView Quote

The art of photography is all about directing the attention of the viewer.

Steven Pinker
Save QuoteView Quote

America had, for one thing, lived in anarchy for - until much more recently than Europe. We had the Wild West, where the cliche of the cowboy movies was the nearest sheriff is 90 miles away, and so you had to pack a gun and defend yourself.

Steven Pinker
Save QuoteView Quote

Though knowledge itself increasingly ignores boundaries between fields, professors are apt to organize their pedagogy around the methods and history of their academic subculture rather than some coherent topic in the world.

Steven Pinker
Save QuoteView Quote