1964
Comment:
|
← Revision 60 as of 2014-02-11 15:08:06 ⇥
2458
|
Deletions are marked like this. | Additions are marked like this. |
Line 19: | Line 19: |
||Samuel ||0.2, 0.2, 0.4, 0.6, 0.8 ||0.4, 0.2, 0.4, 0.8, 0.6 ||28.9% ||86.7% ||28.3% || | ||Samuel ||0.2, 0.2, 0.4, 0.6, 0.8 ||0.4, 0.2, 0.4, 0.8, 0.6 ||28.9% ||43.3% ||28.3% || |
Line 25: | Line 25: |
||Rick ||0.2, 0.4, 0.2, 0.8, 1 ||0.2, 0.2, 0.4, 0.4, 1 ||21.8% ||72.8% ||20.9% || |
||Rick ||0.2, 0.4, 0.2, 0.8, 1.0 ||0.2, 0.2, 0.4, 0.4, 1.0 ||21.8% ||65.9% ||20.9% || ||Björn H||0.4, 0.4, 0.6, 0.4, 0.8 || 0.4, 0.4, 0.6, 0.2, 0.6 ||7.4% ||21.7% ||5.4%|| ||Manuel ||0.4, 0.4, 0.4, 0.6, 0.6 ||0.4, 0.4, 0.4, 0.8, 0.8 ||5.7% ||54.3% ||7.3% || ||André ||0.8, 0.7, 0.6, 0.8, 0.8||0.7, 0.4, 0.7, 0.8, 0.6||1.3% ||17.7% ||0.5% || ||Jerome||0.2, 0.6, 0.6, 0.8, 1.0||0.6, 0.6, 0.8, 1.0, 1.0||18.9%||40.9%||17.8%|| ||Melih&Gökçe||0.2, 0.2, 0.4, 0.6, 0.6 ||0.4, 0.2, 0.4, 0.6, 1.0 || || || || ||Fabian||0.4, 0.6, 0.2, 1.0, 1.0||0.4, 0.6, 0.8, 1.0, 0.4|| || || || |
Results for Exercise Sheet 13 (Statistical Significance)
Please add your row to the table below, following the examples already there:
- The five precision numbers for TF-IDF.
- The five precision numbers for BM25.
- The p-value according to Student's T-Test, in percent with one digit after the dot.
- The p-value according to Fisher's Randomization Test, in percent with one digit after the dot.
- The p-value according to the Z-Test, in percent with one digit after the dot.
Note that your figures can (and probably will) vary, because of differences in how exactly you parsed the text collections, and how exactly you determined relevance of a returned document for a query.
Name |
Precision TF-IDF |
Precision BM25 |
p-value T-Test |
p-value R-Test |
p-value Z-Test |
Björn |
0.2, 0.2, 0.2, 0.4, 0.6 |
0.6, 0.2, 0.2, 0.6, 0.4 |
17.8% |
55.3% |
14.7% |
Janosch |
0.2, 0.4, 0.4, 0.8, 0.4 |
0.4, 0.4, 0.4, 0.8, 0.6 |
9.9% |
29.5% |
8.4% |
MartinM |
0.4, 0.2, 0.6, 0.8, 0.8 |
0.2, 0.2, 0.4, 0.8, 0.8 |
34.7% |
69.7% |
32.4% |
Jens |
0.2, 0.4, 0.4, 0.8, 1.0 |
0.6, 0.4, 0.4, 0.8, 1.0 |
18.4% |
39.4% |
17.3% |
Nico |
0.2, 0.2, 0.4, 0.6, 0.8 |
0.4, 0.2, 0.4, 0.6, 0.8 |
28.9% |
41.6% |
28.3% |
Pat |
0.4, 0.6, 0.6, 0.8, 1.0 |
1.0, 0.6, 0.6, 0.8, 0.8 |
9.9% |
30.0% |
8.4% |
Samuel |
0.2, 0.2, 0.4, 0.6, 0.8 |
0.4, 0.2, 0.4, 0.8, 0.6 |
28.9% |
43.3% |
28.3% |
Ramin |
0, 0, 0.4, 0.3, 1.0 |
0, 0, 0.6, 0.2, 1.0 |
6.6% |
97.7% |
8.2% |
Iradj |
0.6, 0.4, 0.4, 0.8, 0.8 |
0.8, 0.8, 0.6, 0.4, 0.4 |
50% |
82.4% |
50% |
StiglerJ |
0.2, 0.4, 0.4, 0.4, 0.8 |
0.2, 0.2, 0.2, 0.8, 0.6 |
|
|
|
Anastasia |
0.8, 0.6, 0.4, 0.6, 0.8 |
0.4, 0.6, 0.4, 0.6, 0.8 |
48.0% |
63.0% |
48.0% |
MartinK |
0.8, 0.6, 0.4, 0.8, 0.8 |
0.8, 0.4, 0.6, 0.6, 1.0 |
|
|
|
Rick |
0.2, 0.4, 0.2, 0.8, 1.0 |
0.2, 0.2, 0.4, 0.4, 1.0 |
21.8% |
65.9% |
20.9% |
Björn H |
0.4, 0.4, 0.6, 0.4, 0.8 |
0.4, 0.4, 0.6, 0.2, 0.6 |
7.4% |
21.7% |
5.4% |
Manuel |
0.4, 0.4, 0.4, 0.6, 0.6 |
0.4, 0.4, 0.4, 0.8, 0.8 |
5.7% |
54.3% |
7.3% |
André |
0.8, 0.7, 0.6, 0.8, 0.8 |
0.7, 0.4, 0.7, 0.8, 0.6 |
1.3% |
17.7% |
0.5% |
Jerome |
0.2, 0.6, 0.6, 0.8, 1.0 |
0.6, 0.6, 0.8, 1.0, 1.0 |
18.9% |
40.9% |
17.8% |
Melih&Gökçe |
0.2, 0.2, 0.4, 0.6, 0.6 |
0.4, 0.2, 0.4, 0.6, 1.0 |
|
|
|
Fabian |
0.4, 0.6, 0.2, 1.0, 1.0 |
0.4, 0.6, 0.8, 1.0, 0.4 |
|
|
|