If you were already worried about how intelligent computers are getting, this new breakthrough probably won’t set your mind at ease.
In a world first, IBM pitted an advanced AI against two humans in a live debate that a public audience then had to vote on.
Known as Project Debater, the computer was asked to make a case for government-funded space research. To make things hard the computer couldn’t study in advance and yet it still managed to champion the topic fiercely with just a few gaps in reasoning.
“Subsidising space exploration is like investing in really good tyres,” argued the computer system, its female voice embodied in a 5ft-tall machine shaped like a monolith with TV screens on its sides.
Such research would enrich the human mind, inspire young people and be a “very sound investment”, it said, making it more important even than good roads, schools or health care.
The computer delivered its opening argument by pulling in evidence from its huge internal repository of newspapers, journals and other sources, then listened to a professional human debater’s counter-argument and spent four minutes rebutting it.
An IBM research team based in Israel began working on the project not long after IBM’s Watson computer beat two human quiz masters on a Jeopardy challenge in 2011.
Rather than just scanning a giant trove of data in search of factoids, IBM’s latest project taps into several more complex branches of AI.
Search engine algorithms used by Google and Microsoft’s Bing use similar technology to digest and summarise written content and compose new paragraphs; voice assistants such as Amazon’s Alexa rely on listening comprehension to answer questions posed by people; and Google recently demonstrated an eerily human-like voice assistant that can call hair salons or restaurants to make appointments.
But IBM says it is breaking new ground by creating a system that tackles deeper human practices of rhetoric and analysis, and how they are used to discuss big questions whose answers are not always clear.
“If you think of the rules of debate, they’re far more open-ended than the rules of a board game,” said Ranit Aharonov, who manages the debater project.
As expected, the machine tends to be better than humans at bringing in numbers and other detailed supporting evidence. It is also able to latch on to the most salient and attention-getting elements of an argument, and can even deliver some self-referential jokes about being a computer.
But it lacks tact, researchers said – sometimes the jokes do not come out right – and on Monday, some of the sources it cited — such as a German official and an Arab sheikh — did not seem particularly germane.
“Humans tend to be better at using more expressive language, more original language,” said Dario Gil, IBM’s vice president of AI research.
“They bring in their own personal experience as a way to illustrate the point. The machine doesn’t live in the real world or have a life that it’s able to tap into.”
There are no immediate plans to turn Project Debater into a commercial product, but Mr Gil said it could be useful in the future in helping lawyers or other human workers make informed decisions.