Thursday, December 04, 2014

The Fact Ranking Challenge continues....

Yes, you might remember our experiment with fact ranking [1,2,3,4]. After almost 4 months, this is the current state of intermediate results (cf. below).

To make it short: YES, there has been some progress. NO, it is not sufficient so far.

Therefore, PLEASE HELP!
If you have already started to work with the application [3], PLEASE CONTINUE!
If you don't know the application [3], PLEASE START!
PLEASE PARTICIPATE!



We know that is is not an easy task and we also know that it takes time. Therefore, WE REALLY DO APPRECIATE YOUR HELP VERY MUCH!!

Please keep on playing and help us to gather more data!
Please tell all your family and friends to support us!
Please tell all your colleagues and fellow students to support us!

THANK YOU VERY MUCH!

[1] The Fact Ranking Quiz Application, http://s16a.org/fr/
[2] Help us with a Research Problem, July 30, 2014
[3] The Importance of Relevance - Intermediate Results, Aug 19, 2014
[4] More intermediate Results from our Fact Ranking Challenge, Sep. 2, 2014


...and here are the statistics:

Number of users who participated: 465
Sum of concepts done: 2410
485 unique concepts are covered (out of 541). 
Average concepts done per user: 5.183

295 times concepts were skipped (relevance in Step2 hasn't been changed for any of the facts).

CONCEPTS DONE:
0 concepts were done by 97 users. 
1 concepts were done by 93 users. 
2 concepts were done by 78 users. 
3 concepts were done by 49 users. 
4 concepts were done by 33 users. 
5 concepts were done by 26 users. 
6 concepts were done by 10 users. 
7 concepts were done by 7 users. 
8 concepts were done by 9 users. 
9 concepts were done by 8 users. 
10 concepts were done by 8 users. 
11 concepts were done by 6 users. 
12 concepts were done by 2 users. 
13 concepts were done by 1 users. 
14 concepts were done by 5 users. 
15 concepts were done by 3 users. 
16 concepts were done by 3 users. 
17 concepts were done by 1 users. 
18 concepts were done by 1 users. 
19 concepts were done by 2 users. 
20 concepts were done by 3 users. 
21 concepts were done by 2 users. 
23 concepts were done by 1 users. 
24 concepts were done by 2 users. 
25 concepts were done by 1 users. 
26 concepts were done by 1 users. 
31 concepts were done by 1 users. 
36 concepts were done by 1 users. 
40 concepts were done by 1 users. 
42 concepts were done by 2 users. 
56 concepts were done by 1 users. 
58 concepts were done by 1 users. 
60 concepts were done by 1 users. 
64 concepts were done by 1 users. 
68 concepts were done by 1 users. 
70 concepts were done by 1 users. 
88 concepts were done by 1 users. 
201 concepts were done by 1 users. 

EDUCATION:
highschool : 47 users.
phd : 71 users.
other : 26 users.
bachelors : 105 users.
masters : 213 users.

AGE:
33+ :  261 users.
19-25 :  72 users.
26-32 :  122 users.
0-18 :  7 users.

GENDER:
female :  111 users.
male :  351 users.

COUNTRY OF ORIGIN:
Angola :  1 users.
Belarus :  1 users.
Portugal :  4 users.
Philippines :  2 users.
Morocco :  3 users.
Greece :  5 users.
Ukraine :  3 users.
Indonesia :  4 users.
Afghanistan :  2 users.
Sri Lanka :  1 users.
Italy :  15 users.
Iraq :  2 users.
India :  44 users.
France :  14 users.
Denmark :  1 users.
Latvia :  1 users.
Pakistan :  4 users.
Syrian Arab Republic :  2 users.
Montenegro :  1 users.
Armenia :  1 users.
Mexico :  2 users.
Canada :  1 users.
Brazil :  10 users.
Venezuela :  1 users.
Croatia :  2 users.
Macedonia, The Former Yugoslav Republic of :  1 users.
Romania :  2 users.
Western Sahara :  1 users.
Algeria :  5 users.
Sweden :  2 users.
United States :  24 users.
Serbia :  10 users.
Nigeria :  3 users.
Estonia :  1 users.
Spain :  9 users.
Taiwan, Republic of China :  2 users.
Ireland :  1 users.
Russian Federation :  12 users.
Israel :  1 users.
Colombia :  3 users.
Switzerland :  2 users.
Azerbaijan :  2 users.
Kenya :  2 users.
Yemen :  1 users.
Malaysia :  2 users.
Viet Nam :  1 users.
Australia :  5 users.
Peru :  1 users.
Albania :  1 users.
South Africa :  2 users.
Tunisia :  1 users.
Netherlands :  9 users.
China :  3 users.
Somalia :  1 users.
Slovenia :  1 users.
Finland :  3 users.
Lithuania :  1 users.
Austria :  7 users.
Sudan :  1 users.
United Kingdom :  15 users.
Egypt :  2 users.
Bahamas :  1 users.
Hungary :  1 users.
Belgium :  1 users.
Poland :  6 users.
Iran, Islamic Republic of :  2 users.
Bulgaria :  3 users.
Norway :  1 users.
Germany :  177 users.
New Zealand :  3 users.

COUNTRY OF RESIDENCE:
United Arab Emirates :  1 users.
null :  0 users.
Belarus :  1 users.
Portugal :  2 users.
Philippines :  1 users.
Morocco :  2 users.
Greece :  3 users.
Ukraine :  1 users.
Indonesia :  3 users.
Luxembourg :  1 users.
Sri Lanka :  1 users.
Italy :  14 users.
Iraq :  1 users.
India :  32 users.
France :  17 users.
Jordan :  1 users.
Denmark :  1 users.
Latvia :  1 users.
Pakistan :  3 users.
Syrian Arab Republic :  1 users.
Oman :  1 users.
Turkey :  1 users.
Czech Republic :  1 users.
Armenia :  1 users.
Canada :  4 users.
Brazil :  9 users.
Croatia :  1 users.
Romania :  3 users.
Algeria :  6 users.
Sweden :  3 users.
United States :  25 users.
Serbia :  5 users.
Nigeria :  1 users.
Saudi Arabia :  1 users.
Estonia :  2 users.
Spain :  7 users.
Taiwan, Republic of China :  1 users.
Ireland :  3 users.
Russian Federation :  6 users.
Israel :  2 users.
Colombia :  2 users.
Switzerland :  8 users.
Azerbaijan :  2 users.
Kenya :  2 users.
Norfolk Island :  1 users.
Yemen :  1 users.
Malaysia :  2 users.
Australia :  7 users.
Peru :  1 users.
Albania :  1 users.
South Africa :  2 users.
Netherlands :  13 users.
China :  1 users.
Somalia :  1 users.
Slovenia :  1 users.
Gambia :  1 users.
Finland :  3 users.
Lithuania :  1 users.
Austria :  6 users.
United Kingdom :  17 users.
Egypt :  1 users.
Bahamas :  1 users.
Belgium :  3 users.
Poland :  7 users.
Singapore :  2 users.
Iran, Islamic Republic of :  1 users.
Bulgaria :  3 users.
Norway :  1 users.
Germany :  197 users.
New Zealand :  3 users.

Overall average confidence of users about the seen concepts: 2.616

NO. OF USERS PER CONCEPT:
1 users for 67 concepts
2 users for 123 concepts
3 users for 108 concepts
4 users for 86 concepts
5 users for 73 concepts
6 users for 37 concepts
7 users for 11 concepts
8 users for 7 concepts
9 users for 2 concepts
10 users for 2 concepts
18 users for 1 concepts
On AVERAGE there are 3.398 users per concept.

NO. OF ANSWERS PER CONCEPT (STEP 1):
On AVERAGE there are 5.002 answers per concept.

NONSENSE STATEMENTS:
TOTAL number of nonsense sentences = 1771