Watson's win on Wednesday was made very likely because enough of the
problems could be solved by simple look-up. These could have been answered
by definition look-ups, quotation completion, or searches based on key
words in the question. Any question that went beyond these techniques
was not answered, or not answered correctly by Watson. (01)
The vaunted ability to handle humor and mental twists did not show up in
the problems presented. (02)
For some reason, Watson lost on the buzzer on every question in the
category "Actors who Direct", even though it got the correct response for
each of them with 84-96% confidence. The clues were the movie names, so
looking up the director of each movie and verifying that the director was
also an actor in the movie, would be straight forward. (03)
Watson could not get any problem in the category, "ALSO ON YOUR COMPUTER
KEYS". It either ignored the category, could not figure out what the
category meant, or had no text describing the keys on computer keyboards.
On the last puzzle in this category, it considered "delete key", so it
was evidently learning the category. (04)
Some of the questions seemed designed to be easily answered from a database.
For example, the question about the "Coyote State" specified the state's
area as 75,885 square miles. No person would remember the exact area of
a state. Why not round it off to the nearest 100 sq. mi.? (05)
Alex also accepted answers from Watson that he probably would not have
accepted from a person. For "It's a poor man who blames these", Watson
responded "tools" instead of "his tools". With a person, Alex would
probably have axed for elaboration, but accepted Watson's response
without pause. He also accepted "Parliament" in response to "Elected
every 5 years, it has 736 members from 7 parties" instead of requiring
"European Parliament". (06)
=============================================================
doug foxvog doug@xxxxxxxxxx http://ProgressiveAustin.org (07)
"I speak as an American to the leaders of my own nation. The great
initiative in this war is ours. The initiative to stop it must be ours."
- Dr. Martin Luther King Jr.
============================================================= (08)
_________________________________________________________________
Message Archives: http://ontolog.cim3.net/forum/ontolog-forum/
Config Subscr: http://ontolog.cim3.net/mailman/listinfo/ontolog-forum/
Unsubscribe: mailto:ontolog-forum-leave@xxxxxxxxxxxxxxxx
Shared Files: http://ontolog.cim3.net/file/
Community Wiki: http://ontolog.cim3.net/wiki/
To join: http://ontolog.cim3.net/cgi-bin/wiki.pl?WikiHomePage#nid1J
To Post: mailto:ontolog-forum@xxxxxxxxxxxxxxxx (09)
|