Friday, August 17, 2012

Who Knows Movies - The 2nd Round

Play it
We are happy to announce that our paper
Andreas Thalhammer, Magnus Knuth and Harald Sack: "Evaluating Entity Summarizations Using a Game-Based Ground Truth" 
has been accepted for the Evaluations and Experiments Track of ISWC 2012. We want to thank all of you very much, who played our WhoKnowsMovies? game, which allowed us to collect the necessary data for this publication. And since we also want provide updated statistics for the final version of our paper, you are very welcome to play a little bit more... :)

There has been a little upgrade for the game including more questions and we need more data to achieve a more reliable proof of our assumption that our proposed fact ranking for entity summarization really is better than a random choice.

Therefore, please help us and play the game. Test your knowledge about movies! Can you challenge the highscore? 

P.S. The already gathered (anonymized) data is available at

Saturday, June 23, 2012

Who knows Movies? Another Game with a Purpose for the Semantic Web

Play it
Of course you will remember our last Quiz Game 'Who Knows' (cf. the post below), where we have used DBpedia facts to generate questionaires for a game with a purpose. The very first application of this game was to put to evaluate some newly developed entity/property heuristics via crowdsourcing. Then, we realized that the gathered data also had some collateral benefits such as the detection of inconsistencies and flaws within the Linked Data resources that we used for generating the questions.

Now, we are looking into another task: entity summarization. Entity summarization means that we are trying to wrap up only the most important facts that determine a distinct entity. Just think of the Google knowledge graph that displays entity summaries from Freebase. Thus, Entity summarization of course is rather similar to relevance ranking of facts.

To generate a ground truth for evaluation of entity summarization heuristics, we adapted our quiz game WhoKnows? to become WhoKnows?Movies! We are cooperating with Andreas Thalhammer from University of Innsbruck with this task and we have restricted the domain of questions to popular movies, adapted the gereration of questionaires by utilizing the Freebase knowledge Base. Now we have to gather data....

Therefore, please help us and play the game. Test your knowledge about movies! Can you challenge the highscore? 

P.S. Of course all the data gathered will be anonymized and made publicly avaible.