Thursday, December 04, 2014

The Fact Ranking Challenge continues....

Yes, you might remember our experiment with fact ranking [1,2,3,4]. After almost 4 months, this is the current state of intermediate results (cf. below).

To make it short: YES, there has been some progress. NO, it is not sufficient so far.

Therefore, PLEASE HELP!
If you have already started to work with the application [3], PLEASE CONTINUE!
If you don't know the application [3], PLEASE START!
PLEASE PARTICIPATE!



We know that is is not an easy task and we also know that it takes time. Therefore, WE REALLY DO APPRECIATE YOUR HELP VERY MUCH!!

Please keep on playing and help us to gather more data!
Please tell all your family and friends to support us!
Please tell all your colleagues and fellow students to support us!

THANK YOU VERY MUCH!

[1] The Fact Ranking Quiz Application, http://s16a.org/fr/
[2] Help us with a Research Problem, July 30, 2014
[3] The Importance of Relevance - Intermediate Results, Aug 19, 2014
[4] More intermediate Results from our Fact Ranking Challenge, Sep. 2, 2014


...and here are the statistics:

Number of users who participated: 465
Sum of concepts done: 2410
485 unique concepts are covered (out of 541). 
Average concepts done per user: 5.183

295 times concepts were skipped (relevance in Step2 hasn't been changed for any of the facts).

CONCEPTS DONE:
0 concepts were done by 97 users. 
1 concepts were done by 93 users. 
2 concepts were done by 78 users. 
3 concepts were done by 49 users. 
4 concepts were done by 33 users. 
5 concepts were done by 26 users. 
6 concepts were done by 10 users. 
7 concepts were done by 7 users. 
8 concepts were done by 9 users. 
9 concepts were done by 8 users. 
10 concepts were done by 8 users. 
11 concepts were done by 6 users. 
12 concepts were done by 2 users. 
13 concepts were done by 1 users. 
14 concepts were done by 5 users. 
15 concepts were done by 3 users. 
16 concepts were done by 3 users. 
17 concepts were done by 1 users. 
18 concepts were done by 1 users. 
19 concepts were done by 2 users. 
20 concepts were done by 3 users. 
21 concepts were done by 2 users. 
23 concepts were done by 1 users. 
24 concepts were done by 2 users. 
25 concepts were done by 1 users. 
26 concepts were done by 1 users. 
31 concepts were done by 1 users. 
36 concepts were done by 1 users. 
40 concepts were done by 1 users. 
42 concepts were done by 2 users. 
56 concepts were done by 1 users. 
58 concepts were done by 1 users. 
60 concepts were done by 1 users. 
64 concepts were done by 1 users. 
68 concepts were done by 1 users. 
70 concepts were done by 1 users. 
88 concepts were done by 1 users. 
201 concepts were done by 1 users. 

EDUCATION:
highschool : 47 users.
phd : 71 users.
other : 26 users.
bachelors : 105 users.
masters : 213 users.

AGE:
33+ :  261 users.
19-25 :  72 users.
26-32 :  122 users.
0-18 :  7 users.

GENDER:
female :  111 users.
male :  351 users.

COUNTRY OF ORIGIN:
Angola :  1 users.
Belarus :  1 users.
Portugal :  4 users.
Philippines :  2 users.
Morocco :  3 users.
Greece :  5 users.
Ukraine :  3 users.
Indonesia :  4 users.
Afghanistan :  2 users.
Sri Lanka :  1 users.
Italy :  15 users.
Iraq :  2 users.
India :  44 users.
France :  14 users.
Denmark :  1 users.
Latvia :  1 users.
Pakistan :  4 users.
Syrian Arab Republic :  2 users.
Montenegro :  1 users.
Armenia :  1 users.
Mexico :  2 users.
Canada :  1 users.
Brazil :  10 users.
Venezuela :  1 users.
Croatia :  2 users.
Macedonia, The Former Yugoslav Republic of :  1 users.
Romania :  2 users.
Western Sahara :  1 users.
Algeria :  5 users.
Sweden :  2 users.
United States :  24 users.
Serbia :  10 users.
Nigeria :  3 users.
Estonia :  1 users.
Spain :  9 users.
Taiwan, Republic of China :  2 users.
Ireland :  1 users.
Russian Federation :  12 users.
Israel :  1 users.
Colombia :  3 users.
Switzerland :  2 users.
Azerbaijan :  2 users.
Kenya :  2 users.
Yemen :  1 users.
Malaysia :  2 users.
Viet Nam :  1 users.
Australia :  5 users.
Peru :  1 users.
Albania :  1 users.
South Africa :  2 users.
Tunisia :  1 users.
Netherlands :  9 users.
China :  3 users.
Somalia :  1 users.
Slovenia :  1 users.
Finland :  3 users.
Lithuania :  1 users.
Austria :  7 users.
Sudan :  1 users.
United Kingdom :  15 users.
Egypt :  2 users.
Bahamas :  1 users.
Hungary :  1 users.
Belgium :  1 users.
Poland :  6 users.
Iran, Islamic Republic of :  2 users.
Bulgaria :  3 users.
Norway :  1 users.
Germany :  177 users.
New Zealand :  3 users.

COUNTRY OF RESIDENCE:
United Arab Emirates :  1 users.
null :  0 users.
Belarus :  1 users.
Portugal :  2 users.
Philippines :  1 users.
Morocco :  2 users.
Greece :  3 users.
Ukraine :  1 users.
Indonesia :  3 users.
Luxembourg :  1 users.
Sri Lanka :  1 users.
Italy :  14 users.
Iraq :  1 users.
India :  32 users.
France :  17 users.
Jordan :  1 users.
Denmark :  1 users.
Latvia :  1 users.
Pakistan :  3 users.
Syrian Arab Republic :  1 users.
Oman :  1 users.
Turkey :  1 users.
Czech Republic :  1 users.
Armenia :  1 users.
Canada :  4 users.
Brazil :  9 users.
Croatia :  1 users.
Romania :  3 users.
Algeria :  6 users.
Sweden :  3 users.
United States :  25 users.
Serbia :  5 users.
Nigeria :  1 users.
Saudi Arabia :  1 users.
Estonia :  2 users.
Spain :  7 users.
Taiwan, Republic of China :  1 users.
Ireland :  3 users.
Russian Federation :  6 users.
Israel :  2 users.
Colombia :  2 users.
Switzerland :  8 users.
Azerbaijan :  2 users.
Kenya :  2 users.
Norfolk Island :  1 users.
Yemen :  1 users.
Malaysia :  2 users.
Australia :  7 users.
Peru :  1 users.
Albania :  1 users.
South Africa :  2 users.
Netherlands :  13 users.
China :  1 users.
Somalia :  1 users.
Slovenia :  1 users.
Gambia :  1 users.
Finland :  3 users.
Lithuania :  1 users.
Austria :  6 users.
United Kingdom :  17 users.
Egypt :  1 users.
Bahamas :  1 users.
Belgium :  3 users.
Poland :  7 users.
Singapore :  2 users.
Iran, Islamic Republic of :  1 users.
Bulgaria :  3 users.
Norway :  1 users.
Germany :  197 users.
New Zealand :  3 users.

Overall average confidence of users about the seen concepts: 2.616

NO. OF USERS PER CONCEPT:
1 users for 67 concepts
2 users for 123 concepts
3 users for 108 concepts
4 users for 86 concepts
5 users for 73 concepts
6 users for 37 concepts
7 users for 11 concepts
8 users for 7 concepts
9 users for 2 concepts
10 users for 2 concepts
18 users for 1 concepts
On AVERAGE there are 3.398 users per concept.

NO. OF ANSWERS PER CONCEPT (STEP 1):
On AVERAGE there are 5.002 answers per concept.

NONSENSE STATEMENTS:
TOTAL number of nonsense sentences = 1771



The Flipped Classroom Experiment - First Lessons Learned

Sailing in previously unknown seas...
As I already had announced in the previous post entitled "And Now for Something Completely Different..." this winter semester the Semantic Web Technologies lecture does not take place like an ordinary lecture. We follow the so-called Flipped Classroom Concept, i.e. the students "prepare" for the lecture (by watching the video recordings from the previous semesters), and we do the lecture in a more interactive way, driven by the needs of the students. So far the theory, but does it also hold in practice?
OK, now we have reached lecture No. 6, i.e. almost already half of the entire course. Let me tell you what happened so far.

  1. Lecture preparation: I have to admit, I was a little bit afraid whether it would really work. But, the students always seem to be very well prepared and I'm really happy about that!
  2. Interaction: Well, I have learned that it is me, who has to take over the incentive. Now, the game works as follows: every week, I publish so-called syllabus questions, i.e. essential questions that the students should be able to answer after they have understood the lecture. We start the lecture now always by going through these syllabus questions, which give us sufficient material for interactivity (=discussion).

    When I simply ask "Do you have any questions about the content of the lecture?", I rarely receive any answers. But, when I start to talk about some of the issues from the content, more and more people are contributing.
  3. Feedback: Well, according to the answers I receive for the syllabus questions, I can immediately recognize where potential problems might be and we can talk about it. For this, I usually keep the lecture slides at hand for visual support. I can then repeat what is important and can dive deeper into explanations as well as to give more examples

    Actually, I have asked the students whether they like the way of this lecture, and I have not received any negative answer so far.
What I have learned so far is that for me as a lecturer the effort is almost quite the same for the flipped classroom as for a 'traditional lecture'. Moreover, you have to be very well prepared, because you always encourage the students to ask all kind of questions. The nice thing is the direct feedback that guides you to exactly those points where more explanation is needed.  Personally, I like this way of the lecture very much. I never had any other lecture so far (well,  besides lab courses or seminars) with so much feedback from the students. 

...and of course I would also like to thank all of my students that they are willing to undergo this experiment together with me! :)