Scientists worry machines may outsmart man

A robot that can open doors and find electrical outlets to recharge itself. Computer viruses that no one can stop.

A robot that can open doors and find electrical outlets to recharge itself. Computer viruses that no one can stop. Predator drones,which,though still controlled remotely by humans,come close to a machine that can kill autonomously.

Impressed and alarmed by advances in artificial intelligence,a group of computer scientists is debating whether there should be limits on research that might lead to loss of human control over computer-based systems that carry a growing share of societys workload,from waging war to chatting with customers on the phone.

Their concern is that further advances could create profound social disruptions and even have dangerous consequences.

As examples,the scientists pointed to a number of technologies as diverse as experimental medical systems that interact with patients to simulate empathy,and computer worms and viruses that defy extermination.

While the computer scientists agreed we are a long way from Hal,the computer that took over the spaceship in 2001: A Space Odyssey,they said there was concern that technological progress would transform the work force by destroying a widening range of jobs,as well as force humans to learn to live with machines that increasingly copy humans.

The researchers leading computer scientists,artificial intelligence researchers and roboticists who met at the Asilomar Conference Grounds on Monterey Bay in California generally discounted the possibility of highly centralised superintelligences and the idea that intelligence might spring spontaneously from the Internet. But they agreed that robots that can kill autonomously are either already here or will be soon.

They focused particular attention on the specter that criminals could exploit artificial intelligence systems as soon as they were developed. The researchers also discussed possible threats to human jobs,like self-driving cars and software-based personal assistants.

Story continues below this ad

A report from the conference,which took place in private on February 25,is to be issued later this year. Some attendees discussed the meeting for the first time with other scientists this month and in interviews.

The conference was organised by the Association for the Advancement of Artificial Intelligence. Eric Horvitz,a Microsoft researcher who is now president of the association,said he believed computer scientists must respond to the notions of superintelligent machines and artificial intelligence systems run amok.

The AAAI report will try to assess the possibility of the loss of human control of computer-based intelligences. It will also grapple with socioeconomic,legal and ethical issues,as well as changes in human-computer relationships.