Results for Exercise Sheet 13 (Statistical Significance)
Please add your row to the table below, following the examples already there:
- The five precision numbers for TF-IDF.
- The five precision numbers for BM25.
- The p-value according to Student's T-Test, in percent with one digit after the dot.
- The p-value according to Fisher's Randomization Test, in percent with one digit after the dot.
- The p-value according to the Z-Test, in percent with one digit after the dot.
Note that your figures can (and probably will) vary, because of differences in how exactly you parsed the text collections, and how exactly you determined relevance of a returned document for a query.
Name |
Precision TF-IDF |
Precision BM25 |
p-value T-Test |
p-value R-Test |
p-value Z-Test |
Björn |
0.2, 0.2, 0.2, 0.4, 0.6 |
0.6, 0.2, 0.2, 0.6, 0.4 |
17.8% |
55.3% |
14.7% |
Janosch |
0.2, 0.4, 0.4, 0.8, 0.4 |
0.4, 0.4, 0.4, 0.8, 0.6 |
9.9% |
29.5% |
8.4% |
MartinM |
0.4, 0.2, 0.6, 0.8, 0.8 |
0.2, 0.2, 0.4, 0.8, 0.8 |
34.7% |
69.7% |
32.4% |
Jens |
0.2, 0.4, 0.4, 0.8, 1.0 |
0.6, 0.4, 0.4, 0.8, 1.0 |
18.4% |
39.4% |
17.3% |
Nico |
0.2, 0.2, 0.4, 0.6, 0.8 |
0.4, 0.2, 0.4, 0.6, 0.8 |
28.9% |
41.6% |
28.3% |
Pat |
0.4, 0.6, 0.6, 0.8, 1.0 |
1.0, 0.6, 0.6, 0.8, 0.8 |
9.9% |
30.0% |
8.4% |
Samuel |
0.2, 0.2, 0.4, 0.6, 0.8 |
0.4, 0.2, 0.4, 0.8, 0.6 |
28.9% |
43.3% |
28.3% |
Ramin |
0, 0, 0.4, 0.3, 1.0 |
0, 0, 0.6, 0.2, 1.0 |
6.6% |
97.7% |
8.2% |
Iradj |
0.6, 0.4, 0.4, 0.8, 0.8 |
0.8, 0.8, 0.6, 0.4, 0.4 |
50% |
82.4% |
50% |
StiglerJ |
0.2, 0.4, 0.4, 0.4, 0.8 |
0.2, 0.2, 0.2, 0.8, 0.6 |
|
|
|
Anastasia |
0.8, 0.6, 0.4, 0.6, 0.8 |
0.4, 0.6, 0.4, 0.6, 0.8 |
48.0% |
63.0% |
48.0% |
MartinK |
0.8, 0.6, 0.4, 0.8, 0.8 |
0.8, 0.4, 0.6, 0.6, 1.0 |
|
|
|
Rick |
0.2, 0.4, 0.2, 0.8, 1.0 |
0.2, 0.2, 0.4, 0.4, 1.0 |
21.8% |
65.9% |
20.9% |
Björn H |
0.4, 0.4, 0.6, 0.4, 0.8 |
0.4, 0.4, 0.6, 0.2, 0.6 |
7.4% |
21.7% |
5.4% |
Manuel |
0.4, 0.4, 0.4, 0.6, 0.6 |
0.4, 0.4, 0.4, 0.8, 0.8 |
5.7% |
54.3% |
7.3% |
André |
0.8, 0.7, 0.6, 0.8, 0.8 |
0.7, 0.4, 0.7, 0.8, 0.6 |
1.3% |
17.7% |
0.5% |
Jerome |
0.2, 0.6, 0.6, 0.8, 1.0 |
0.6, 0.6, 0.8, 1.0, 1.0 |
18.9% |
40.9% |
17.8% |
Melih&Gökçe |
0.2, 0.2, 0.4, 0.6, 0.6 |
0.4, 0.2, 0.4, 0.6, 1.0 |
|
|
|
Fabian |
0.4, 0.6, 0.2, 1.0, 1.0 |
0.4, 0.6, 0.8, 1.0, 0.4 |
|
|
|