Search's Real Time Paradigm

This is part of an article by Mike Grehan that appeared in
ClickZ on 21st September 2009

On a recent trip to the U.K., I spoke with William Fischer, director of TwitterJobSearch, about the challenges of real-time search. He explained the signal/noise issue presents a huge challenge to search engines. But Work Digital's technology, based on a combination of methods, primarily uses natural language processing to avoid depending purely on keywords.

"Other search engines rely upon 'keywords' or hash tags to index tweets. One hundred forty characters just doesn't provide enough data unless you can make sense of the words in context. 'San Francisco job construction job losses continue in Q4' could very well appear to be an offer of employment or an employment news item if one doesn't use natural language processing to evaluate the words in context," Fischer said.

To read the rest of this great article click here