|
Size: 944
Comment:
|
Size: 2225
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 3: | Line 3: |
| Line 6: | Line 5: |
| 1. The five precision numbers for TF-IDF. 2. The five precision numbers for BM25. 3. The p-value according to Fisher's Randomization Test, in percent with one digit after the dot. 4. The p-value according to the Z-Test, in percent with one digit after the dot. 5. The p-value according to Student's T-Test, in percent with one digit after the dot. |
1. The five precision numbers for TF-IDF. 1. The five precision numbers for BM25. 1. The p-value according to Student's T-Test, in percent with one digit after the dot. 1. The p-value according to Fisher's Randomization Test, in percent with one digit after the dot. 1. The p-value according to the Z-Test, in percent with one digit after the dot. |
| Line 12: | Line 11: |
Note that your figures can (and probably will) vary, because of differences in how exactly you parsed the text collections, and how exactly you determined relevance of a returned document for a query. ||'''Name''' ||'''Precision TF-IDF'''||'''Precision BM25'''||'''p-value R-Test'''||'''p-value Z-Test'''||'''p-value T-Test'''|| ||Björn || 0.2, 0.2, 0.2, 0.4, 0.6|| 0.6, 0.2, 0.2, 0.6, 0.4 || ?? ||?? || 15.9% || |
Note that your figures can (and probably will) vary, because of differences in how exactly you parsed the text collections, and how exactly you determined relevance of a returned document for a query. ||'''Name''' ||'''Precision TF-IDF''' ||'''Precision BM25''' ||'''p-value T-Test''' ||'''p-value R-Test''' ||'''p-value Z-Test''' || ||Björn ||0.2, 0.2, 0.2, 0.4, 0.6 ||0.6, 0.2, 0.2, 0.6, 0.4 ||17.8% ||55.3% ||14.7% || ||Janosch ||0.2, 0.4, 0.4, 0.8, 0.4 ||0.4, 0.4, 0.4, 0.8, 0.6 ||9.9% ||29.5% ||8.4% || ||MartinM ||0.4, 0.2, 0.6, 0.8, 0.8 ||0.2, 0.2, 0.4, 0.8, 0.8 ||34.7% ||69.7% ||32.4% || ||Jens ||0.2, 0.4, 0.4, 0.8, 1.0 ||0.6, 0.4, 0.4, 0.8, 1.0 ||18.4% ||39.4% ||17.3% || ||Nico ||0.2, 0.2, 0.4, 0.6, 0.8 ||0.4, 0.2, 0.4, 0.6, 0.8 ||28.9%||41.6% ||28.3%|| ||Pat ||0.4, 0.6, 0.6, 0.8, 1.0 ||1.0, 0.6, 0.6, 0.8, 0.8 ||9.9% ||30.0% ||8.4% || ||Samuel ||0.2, 0.2, 0.4, 0.6, 0.8 ||0.4, 0.2, 0.4, 0.8, 0.6 ||28.9% ||43.3% ||28.3% || ||Ramin ||0, 0, 0.4, 0.3, 1.0 ||0, 0, 0.6, 0.2, 1.0 ||6.6% ||97.7% ||8.2% || ||Iradj ||0.6, 0.4, 0.4, 0.8, 0.8 ||0.8, 0.8, 0.6, 0.4, 0.4 ||50% ||82.4% ||50% || ||StiglerJ ||0.2, 0.4, 0.4, 0.4, 0.8 ||0.2, 0.2, 0.2, 0.8, 0.6 || || || || ||Anastasia ||0.8, 0.6, 0.4, 0.6, 0.8 ||0.4, 0.6, 0.4, 0.6, 0.8 ||48.0% ||63.0% ||48.0% || ||MartinK ||0.8, 0.6, 0.4, 0.8, 0.8 ||0.8, 0.4, 0.6, 0.6, 1.0 || || || || ||Rick ||0.2, 0.4, 0.2, 0.8, 1.0 ||0.2, 0.2, 0.4, 0.4, 1.0 ||21.8% ||65.9 ||20.9% || ||Björn H||0.4, 0.4, 0.6, 0.4, 0.8 || 0.4, 0.4, 0.6, 0.2, 0.6 ||7.4% ||21.7% ||5.4%|| ||Manuel ||0.4, 0.4, 0.4, 0.6, 0.6 ||0.4, 0.4, 0.4, 0.8, 0.8 ||5.7% ||54.3% ||7.3% || ||André ||0.8, 0.7, 0.6, 0.8, 0.8||0.7, 0.4, 0.7, 0.8, 0.6||49.1% ||35.4% ||49.0% || |
Results for Exercise Sheet 13 (Statistical Significance)
Please add your row to the table below, following the examples already there:
- The five precision numbers for TF-IDF.
- The five precision numbers for BM25.
- The p-value according to Student's T-Test, in percent with one digit after the dot.
- The p-value according to Fisher's Randomization Test, in percent with one digit after the dot.
- The p-value according to the Z-Test, in percent with one digit after the dot.
Note that your figures can (and probably will) vary, because of differences in how exactly you parsed the text collections, and how exactly you determined relevance of a returned document for a query.
Name |
Precision TF-IDF |
Precision BM25 |
p-value T-Test |
p-value R-Test |
p-value Z-Test |
Björn |
0.2, 0.2, 0.2, 0.4, 0.6 |
0.6, 0.2, 0.2, 0.6, 0.4 |
17.8% |
55.3% |
14.7% |
Janosch |
0.2, 0.4, 0.4, 0.8, 0.4 |
0.4, 0.4, 0.4, 0.8, 0.6 |
9.9% |
29.5% |
8.4% |
MartinM |
0.4, 0.2, 0.6, 0.8, 0.8 |
0.2, 0.2, 0.4, 0.8, 0.8 |
34.7% |
69.7% |
32.4% |
Jens |
0.2, 0.4, 0.4, 0.8, 1.0 |
0.6, 0.4, 0.4, 0.8, 1.0 |
18.4% |
39.4% |
17.3% |
Nico |
0.2, 0.2, 0.4, 0.6, 0.8 |
0.4, 0.2, 0.4, 0.6, 0.8 |
28.9% |
41.6% |
28.3% |
Pat |
0.4, 0.6, 0.6, 0.8, 1.0 |
1.0, 0.6, 0.6, 0.8, 0.8 |
9.9% |
30.0% |
8.4% |
Samuel |
0.2, 0.2, 0.4, 0.6, 0.8 |
0.4, 0.2, 0.4, 0.8, 0.6 |
28.9% |
43.3% |
28.3% |
Ramin |
0, 0, 0.4, 0.3, 1.0 |
0, 0, 0.6, 0.2, 1.0 |
6.6% |
97.7% |
8.2% |
Iradj |
0.6, 0.4, 0.4, 0.8, 0.8 |
0.8, 0.8, 0.6, 0.4, 0.4 |
50% |
82.4% |
50% |
StiglerJ |
0.2, 0.4, 0.4, 0.4, 0.8 |
0.2, 0.2, 0.2, 0.8, 0.6 |
|
|
|
Anastasia |
0.8, 0.6, 0.4, 0.6, 0.8 |
0.4, 0.6, 0.4, 0.6, 0.8 |
48.0% |
63.0% |
48.0% |
MartinK |
0.8, 0.6, 0.4, 0.8, 0.8 |
0.8, 0.4, 0.6, 0.6, 1.0 |
|
|
|
Rick |
0.2, 0.4, 0.2, 0.8, 1.0 |
0.2, 0.2, 0.4, 0.4, 1.0 |
21.8% |
65.9 |
20.9% |
Björn H |
0.4, 0.4, 0.6, 0.4, 0.8 |
0.4, 0.4, 0.6, 0.2, 0.6 |
7.4% |
21.7% |
5.4% |
Manuel |
0.4, 0.4, 0.4, 0.6, 0.6 |
0.4, 0.4, 0.4, 0.8, 0.8 |
5.7% |
54.3% |
7.3% |
André |
0.8, 0.7, 0.6, 0.8, 0.8 |
0.7, 0.4, 0.7, 0.8, 0.6 |
49.1% |
35.4% |
49.0% |