Net World
The Future of Internet Search
Esther Dyson
|
|
|
NEW YORK – Imagine that Googling an address gave you a list of the closest buildings, ranked by distance. Not exactly what you were looking for, most likely. But that is pretty close to what we still accept for most Internet searches. You don't get what you actually want to finish your task; you get a list of pages that might lead you to it.
That is beginning to change. Even as the online world has turned its attention from searching to social networking, search is getting interesting again.
Consider the development of online search in the broadest terms. First came Yahoo!, with its carefully cultivated (by human editors) catalogue of interesting web pages. Then along came Google, with co-founder Larry Page’s innovative ranking of Web pages not just by their content, but also by the quantity and quality of other pages that link to them.
Social networking brings a new insight. People are likely to buy what their friends recommend, which is why marketers should spend time on social networks and join the conversation, rather than interrupt it with traditional advertising.
But what happens when, influenced by their friends, people actually go to buy something or take some action? That long list of blue links to pages that may or may not contain what they want looks pretty old.
Now, however, something is happening to fix this, and it’s not just a prettier background. It’s structure – the same sort of context the old Yahoo! catalogue supplied, but this time automatically generated and deeper – and across more than just a few categories such as sports and travel.
For example, what people want (and are now getting) in product search is not a list of pages, but a set of products displayed in some meaningful fashion. They want a map of the product space, not a list. The challenge of course, is that each kind of product has a different structure and a different set of attributes.
Consider wines: you can sort them by price, year, or region of origin, by red, white, or rosé, or by sparkling or still. For clothes, you want sizes and colors – and perhaps some filters depending on your personal characteristics – and of course a “buy now” button.
Some areas, such as travel, are even more complex. To “map” travel properly, the software needs to understand such things as time zones, flight duration, layovers, and the like, along with concepts such as coach or first class, deluxe and standard rooms, double vs. single, and so on. That is why there is a whole separate vertical market for travel, but one that first Bing, and now Google (with the acquisition of ITA Software), may be claiming.
For a long time Google didn’t need to do much to remain the leader in Internet search, focusing primarily on the “access” part of its self-proclaimed mission “to organize the world’s information and make it universally accessible and useful.” But runner-up Microsoft went out and bought Medstory in 2007 and then Powerset in 2008. (I was an investor in both of them, so I have been watching these developments with interest, but I have no inside information on either company since the acquisitions.)
Medstory has a deep understanding of health care, including the relationships between diseases and treatments, drugs and symptoms, and side effects. Powerset, a tool for creating and defining such relationships in any sphere of interest, is broader but less deep.
This all happened a couple of years ago – just before Yahoo! gave up on search entirely and handed that part of its business over to Microsoft. Also around that time, Bill Gates uttered one of the smartest things he has ever said: “The future of search is verbs.” But he said it at a private dinner and it never spread.
To me, the meaning was clear: when people search, they aren't just looking for nouns or information; they are looking for action. They want to book a flight, reserve a table, buy a product, cure a hangover, take a class, fix a leak, resolve an argument, or occasionally find a person, for which Facebook is very handy. They mostly want to find something in order to do something.
As a result, Bing launched a few forays into vertical integration. And in the last few months Google has begun to react. First, it bought ITA Software, which provides the underlying data to several travel-booking sites (Hotwire and Orbitz) and to Kayak, as well as to Bing. Most resellers, a little nervous about Bing’s tool that sends users to book directly with airlines and hotels, are even more concerned about what Google might be up to.
Then, last month, Google acquired Metaweb and its user-generated database Freebase. While Powerset was a tool for understanding natural language and for structuring it “under the covers” (where programmers could see it), Metaweb lets partners and end-users create data structures or add information to structures created by others. For example, Metaweb/Freebase has an extensive structured database of movies, actors who appear in them, and their directors. You can ask (and get the answer) to “movies directed by Roman Polanski” and get only those movies – not those in which he only appeared. Try doing that with Google. You soon will be able to.
Other categories include business (with entities such as employers, industries, and employees), biology, space flight, and many more, and include representations – such as graphs, timelines, and tables – of how they are connected.
Most things don’t exist in isolation. They have complex relationships to other things, and by representing that information using verbs – for example, “the company that Google acquired” vs. “the company that Google competes with” – we can represent the world more accurately. And that means better, more meaningful responses when we search.
Esther Dyson, chairman of EDventure Holdings, is an active investor in a variety of start-ups around the world. Her interests include information technology, health care, private aviation, and space travel.
Copyright: Project Syndicate, 2010.
www.project-syndicate.org
For a podcast of this commentary in English, please use this link:
http://media.blubrry.com/ps/media.libsyn.com/media/ps/dyson23.mp3
You might also like to read more from Esther Dyson or return to our home page.
|
|
DonDodge 02:58 21 Aug 10
Esther, Excellent insights! The quote by Bill Gates is profound. Your deeper analysis is spot on. The future of search is action. We are already seeing this in primitive examples, but the trend to taking direct action from the search results is very clear. Verbs like buy, find, book, sell, reserve, register, coupled with nouns will result in direct action from search results.
Sophisticated searchers can now enter a search like "book me a table for two at Il Fornaio for 8:00PM" which launches OpenTable with the restaurant selected and availability checked. Just hit confirm and you are done.
Add location awareness from the GPS on your phone and you can do some amazingly powerful things with search.
Internet search still has a lot more potential, both in terms of new services and monetization of actions.
Don Dodge
online 12:49 21 Aug 10
The wisdom of the language ( http://news.english.net.in/wisdom-of-the-language/ ) is definitely growing at an increasing rate.
I plan to post more about the intersection of natural language information retrieval methods with particular reference to mobile information technology contexts -- I think this will definitely be an area to keep a close eye on, and I expect that there will be significant changes in where significant growth business communications will happen in the short to medium future (and these changes and economic shifts will also affect market demand -- hence, also business profitability).
I wrote a more extensive reply about the information science (in particular: information retrieval) implications you suggest here ( http://news.linked.in/904/bing-edyson-echoes-billgates-who-echoed-httpnews-english-net-inwisdom-of-the-language-cc-fredwilson ) -- and there are also significant implications in such fields as organizational theory (e.g. Max Weber, Herbert Simon, Charles Perrow, etc.). Although there has been ample research in the theory of large organizations (and I have done some of it, too ;), the future is not so much about large corporations (such as GM) as it is about networks of small companies (such as ebay shops) -- see also e.g. http://news.linked.in/613/size-matters
:) nmw
direwolff 07:43 21 Aug 10
Looks like Kevin O'Connor is seeing the world evolve in similar ways to you, especially w/his new startup findthebest.com, which appears to apply some of your thinking on unique attributes for diff products as means to generate more effective searches.
joec 02:59 22 Aug 10
Inverse searches would help solve the issue of relevant results. It's not all about products; it's about SMBs, services. I could run on, but you can read more here
NCoppedge 02:28 25 Apr 11
I would like to address the general question, philosophically and ativistically
First, I feel consumers want more complete suggestions. Packages can be formed like entire "built worlds"; it is okay to throw in extra psychological advice when it is perfect.
Secondly, the future of information is information perfectability. Objects are made of data which may have qualia-based patterns of recognition.
For example, a phone is not just "black, S-703" like a military weapon, instead it is "made for illuminati" or something. Personal appeal can be creative and expansive. Free images can be suggested like the scrolling Yahoo news.
Thirdly, the conjunction of applications and perfectible data (including images) creates a niche for A. complicated aesthetic applications, including case-specific environments, B. a new value for information hierarchies aesthetically or philosophically, yet objectively, (I'm picturing "this image means our project---it really does, based on typology and potentially corporatism), C. corporations are perfectible in their public information manifestations. Computers can have automatic reflections of corporate ideas, creating a separate corporate hierarchy that is embodied by idea alone.
Additionally, consider how literature may be eventually coordinated to individual genetics--- the same can be done earlier for consumer information.


SeoKungFu 11:12 19 Aug 10
The future of search is really intruguing topic, especially for people like me who work professionally in the search-engine related areas and are therefore more than tempted to be interested in it. It is a topic that is often discussed in the SEO training community called "the SEO Dojo" of which I'm a member - a high level community of SEO professionals from all over the world. The future of search is not only who of the big players is doing what in their own competitive race, but what is even more interesting is the underlying intellectual effort to bring search results as relevant as possible to the users' search intent - exactly what you have covered in your article here.
The "rabbit" hole goes even deeper - there are thousands of patents being released by all the R&D teams of all of the big search engine companies; things seems to happen not only fast but frequent :) - i.e. changes in algorythms and results evaluation, indexing, sorting and presenting happen so often that what has been applied say a month ago is already outdated - but this is an extremely good example of the positive effects of severe competition and demanding audience - people really want to perform activities using search engines, not to spend their time "hacking about it" and this brings more and more accuracy, precision and high quality in the search results.
Although I slightly disagree on some points ( being both picky and into the very same field ) and as it seems you are a bit more in favour of Bing, the article is great !
Thank for the wonderful reading !