Showing posts with label semantics. Show all posts
Showing posts with label semantics. Show all posts

Friday, April 13, 2007

Tag search vs. keyword search......substitution or complement


As you know, collaborative tagging systems (CTS) have become rather popular Web 2.0 applications (although I don't like the term 'Web 2.0'...please use 'Social Web' instead). A CTS allows each registered user to maintain her own tags that add semantic annotation to corresponding web links. Today, 'tags' are simple unformatted text data. Tags are transporting meaning, i.e. semantics. Because the user is free to choose any text string (symbol) for a certain semantics (concept) related to a given resource (web page or object). To communicate this semantics, two or more users have to agree upon using the same symbols denoting an object (remember the semiotic triangle [1]).

First difficulty is syntax: there are several posibilities to write a word (of course not all of them are necessarely correct or not all of them belong to the same language). The problem becomes even worse, if one tries to combine several words in a single string (how to separate words?...use CamelCase, underscores, blanks, ...).
Next comes language dependent problems such as polysemy (homonyms or synonyms). For homonyms we have the same symbol but different meanings, and for synonyms vice versa.

Syntax and language dependent problems alone cause tag based search to be more difficult to handle than traditional keyword based approaches (by keyword based approach we refer to full text search or keywords assigned to the resource by the resource author or by some designated expert). For full text search, a query string given by the user (or at least its word stem) has to match some string being part of the searched resource. Keywords given to a resource by some designated expert should meet some level of objectivity and thus, a user might be able to 'guess' the keyword while thinking of a well suited query string. Keywords provided by the author refer to her specific point of view (same with tagging). These 'subjective' keywords are much harder to guess for the arbitrary user, because she does not necessarely share the same context with the (tag) author.
In CTS we distinguish several distinct categories of tags [2]. Among others, there are two fundamental different tag categories: descriptive tags and functional tags. Descriptive tags refer to more objective tags, tags that are used to describe a resource in some general maner. Functional tags on the other hand do include an intended functional use esp. for the tag author and thus, are more subjective. While descriptive tags serve better for general web search, functional tags are useful most for their authors, but not for other users.
To analyse the benefit of tagging for web search, we have to take into account that many users are providing tags for a specific resource. Depending on the distribution of the tags attached to a specific resource, one can observe a power law (see also [2]). Few tags are used very often, while most of all the tags attached to a resource do occur only scarcely. Those few tags rather often can be identified with descriptive tags, while the so called 'long tail' of the other tags often belong to the category of functional tags.
So, how can we make use f that fact?
In [3] the authors propose to use tags for search query refinement. For that reason, they distinguish between two defferent categores of tags (that do not necessarely correspondent with descriptive and functional tags). They distinguish search keywords as being the most popular tags assigned to a resource, which can help to increase the hit rate if being used for query refinement, and exploration keywords, which cannot. Because exploration keywords reflect the personalized search context and information need of an individual user they are supposed to be helpful for the exploration process.

Monday, April 09, 2007

Tim Berners-Lee: The Web - Looking Back, Looking Forward


Another talk given by Tim Berners-Lee on 13th March 2007 in London as keynote on the start of this year's prestigious BCS Lovelace lecture. Tim Berners-Lee was granted the Lovelace Medal (named after Ada Lovelace, the daughter of Lord Byron and founder of scientific computing) in 2006. Here is the interview entitled 'Isn't it semantic?' from 2006 with TBL on winning the Lovelace medal. Usually the winner of the Lovelace medal has to give a lecture in the following year, and thus, this years Lovelace lecture is given by Berners-Lee.

The Lovelace Medal is presented to individuals who have made a contribution which is of major significance in the advancement of Information Systems or which adds significantly to the understanding of Information Systems. Among the winners are rather famous computer scientists such as Douglass Engelbart, inventor of the computer mouse and pioneer of GUI, networking, and hypertext systems, who received the medal in 2001, or Linus Torvalds, developer of the LINUX operating system, who received the award in 2000.

(video discovered at Serge Linckels)

Thursday, March 22, 2007

The Semantic Web will NOT fail .....


...well, maybe it will not develop as projected by the W3C...but there is something evolving :)
Just to answer the question raised at the DERI blog "The Semantic Web will fail?" and to make a statement to Stephen Downes' post on "Why the Semantic Web will fail".
First thing, I wonder why the DERI blog leaves Downes' statement uncommented. Isn't DERI doing a lot of Semantic Web research? Ok, but let's go into detail. Downes' first thesis is

"The Semantic Web will never work because it depends on businesses working together, on them cooperating."

Does it? Why do inter business relations work...? Although there's competition going on, the benefit of sharing common standards is pretty obvious. Maybe you're right that the Semantic Web will not develop as the W3C projects (just remember ISO/OSI and TCP/IP for the sake of standardization). Maybe it's not possible to design the Semantic Web in a top-down manner. But, on the other hand maybe we will see some bottom-up evolution as in the way of the social web (aka web 2.0). And why not thinking of some hybrid aproach? Then, business will adapt sooner or later...and they will. At least, when they face the situation that semantic technology is required to run money making applications. Maybe we are still lightyears away from what is promised by the Semantic Web, but from my point of view we are just about to see some major changes and developments in the upcoming 5-10 years.

Further he says that
"But the big problem is they believed everyone would work together:
- would agree on web standards (hah!)
- would adopt a common vocabulary (you don't say)
- would reliably expose their APIs so anyone could use them (as if)
"

The point is that one of the main purposes of the Semantic Web is to get together heterogeneous data. That means data that are coded with different vocabularies (but containing some additional encoded semantic that states how one vocabulary relates to the terms of another). And just look at RDF. There are already a lot of companies that suport RDF in their applications.

Anyway, the criticism is not new. Just remember Peter Norwig's argument...The nice thing about Stephen Downes' post is the discussion below that is definitely worth while reading...