IBM's 'Jeopardy!' match more than game playing

Big Blue sees Watson driving strides in analytics

The battle between man and machine opens a new chapter on Monday when an IBM computer named Watson takes on two "Jeopardy!" champions in a test of speed and trivia.

For the developers of Watson, named for the founder of the 100-year-old company, the "Jeopardy!" game is the culmination of a four-year project that had plenty of naysayers when it started.

The early knocks were that a computer could not understand the nuances of language such as puns, sarcasm and wordplay fast enough to match the human brain.


How did Watson fare on Day 1 of Jeopardy!

Other related story

IBM's Watson vs the human brain


Now many of those in the computer science world who said it couldn’t be done are now hailing Watson as a technological marvel.

But for IBM, Watson and the innovation behind it is much more than just playing a syndicated game show, said Dave McQueeney, vice president of IBM Research.

The company, which was founded in 1911 by Thomas J. Watson, hopes the success of Watson will drive more interest in computer science as a career.

“There is the potential to wake up a lot of young kids and reinvigorate interest in these technical fields,” McQueeney said.

Second, and probably most applicable to the government market, Watson will usher in a new era of analytics tools, he said.

Watson is powered by 10 racks of IBM Power 750 servers, running Linux. It uses 15 terabytes of RAM and 2,880 processor cores.

To prepare for "Jeopardy!", it has been loaded with a huge amount of information about books, movies, history, plays, music, current events, and the list goes on.

For each question, Watson evaluates information from about 200 million pages of content, or 1 million books, McQueeney said.

And it has to do it in 3 seconds.

To achieve that speed, Watson runs thousands of processes at once, using hundreds algorithms and Natural Language Processing and Statistical Machine Learning technologies. It also relies on Unstructured Information Management Architecture.

Unlike Watson’s chess playing cousin Deep Blue, Watson is built using technology that is commercially available today, McQueeney said.

Within a few years, Watson-like computers could be affordable for government agencies that need to analyze vast amounts of data, he said.

“There are these classes of problems where people want to reason over very large collections of data and pose questions,” McQueeney said.

Uses in government range from health care analytics to looking for patterns in eligibility decisions to being a tool for streamlining processes. 

“It really is designed to collaborate with people,” he said.

To play "Jeopardy!", Watson breaks down the clue looking at things such as grammar, context and relationships and generates hundreds of possible interpretations. It then runs those against its databases and builds an evidence profile to determine what are the most likely correct answers. Each answer has a confidence level.

Viewers watching the "Jeopardy!" match will see the top three answers and their confidence levels.

For some questions, one answer will have a high confidence level. This is when Watson is most likely to buzz in. For other questions, none of the answers will have a high confidence level and Watson will not buzz in.

“That’s the interesting thing,” McQueeney said. “The machine knows when it doesn’t know the answer.”

In a real world application, this type of computing makes Watson a collaboration tool for humans who want to work with large sets of data. For example, in the medical field, Watson would not generate the diagnosis, McQueeney said.

“The machine’s performance and the human’s performance would amplify each other,” he said. “The human understands the subtly, the depth and the reasoning. The machine then brings a tremendous breadth of analysis but it understands something of the human reasoning.”

The doctor would pose a question and include the information such as medical history. The machine would come back with possible interpretations. The doctor would prune those and do more analysis and come back with possible answers and the confidence level for each answer.

The confidence level would include links to the data such as medical journals and other reports that the doctor could consult before making a diagnosis.

“There are so many things that people want to get out of these huge stores of data,” McQueeney said. “They know the reasoning, but they haven’t had the tools to handle all the data. That’s what Watson does.”

The "Jeopardy!" showdown between Watson and past  champions Ken Jennings and Brad Rutter will air Feb. 14, 15 and 16, in a tournament of champions format. Two matches will be played over three days.

Any of Watson’s winnings will be donated to charity. Jennings and Rutter have agreed to donate half of their winnings to charity as well.

About the Author

Nick Wakeman is the editor-in-chief of Washington Technology. Follow him on Twitter: @nick_wakeman.

Reader Comments

Tue, Feb 22, 2011 Edmond Hennessy United States

Have spent my entire career (approaching 4 decades) in the High-Tech field - heavy emphasis on Defense & Military, Homeland Security and the Healthcare/Medical target segments. As impressive, as Watson performed on Jeopardy - there is a method to IBM's madness - and, the applications emphasis for this remarkable tool - will become clear shortly. On the comical side - Is Watson the catalyst for SKYNET? On the real-world, practical side can easily see Watson and next gens - having a significant impact on improving medecine, strengthening our Defense Systems, bringing Entertainment to a new level and redefining the high-end, sophisticated world of computing. Figure in a few years, when I tune into Jeopardy - there will still be three contestants - Watson Senior, Red Apple & Steve Balmer.

Sun, Feb 20, 2011 sasa serbia

supercomputer Watson defeated at the feet of human competitors in the popular American game show Only failed to answer the question: "What is the only republic of former Yugoslavia the EU?". Supercomputer is the wrong answer: "Serbia" instead of Slovenia. watch video: http://www.youtube.com/watch?v=ObspCSno- and go on this :http://europa.eu/abc/european_countries/index_en.htm

Tue, Feb 15, 2011

How much of Watson's round one success comes down to its mechanical ability to push the button faster?

Mon, Feb 14, 2011

Watson is the Apple IIe version of what will at a minimum become self aware and able to reason and make decisions and sadly write its own code... Don't worry till then.

Fri, Feb 11, 2011 HAL

Don't worry Dave...Ah'll be back.

Show All Comments

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

What is your e-mail address?

My e-mail address is:

Do you have a password?

Forgot your password? Click here
close
SEARCH
contracts DB

Trending

  • Dive into our Contract Award database

    In an exclusive for WT Insider members, we are collecting all of the contract awards we cover into a database that you can sort by contractor, agency, value and other parameters. You can also download it into a spreadsheet. Read More

  • Is SBA MIA on contractor fraud? Nick Wakeman

    Editor Nick Wakeman explores the puzzle of why SBA has been so silent on the latest contractor fraud scandal when it has been so quick to act in other cases. Read More

Webcasts

  • How Do You Support the Project Lifecycle?

    How do best-in-class project-based companies create and actively mature successful organizations? They find the right mix of people, processes and tools that enable them to effectively manage the project lifecycle. REGISTER for this webinar to hear how properly managing the cycle of capture, bid, accounting, execution, IPM and analysis will allow you to better manage your programs to stay on scope, schedule and budget. Learn More!

  • Sequestration, LPTA and the Top 100

    Join Washington Technology’s Editor-in-Chief Nick Wakeman as he analyzes the annual Top 100 list and reveals critical insights into how market trends have impacted its composition. You'll learn what movements of individual companies means and how the market overall is being impacted by the current budget environment, how the Top 100 rankings reflect the major trends in the market today and how the biggest companies in the market are adapting to today’s competitive environment. Learn More!