Differences between revisions 8 and 18 (spanning 10 versions)

Results for Exercise Sheet 13 (Statistical Significance)

Please add your row to the table below, following the examples already there:

The five precision numbers for TF-IDF.
The five precision numbers for BM25.
The p-value according to Student's T-Test, in percent with one digit after the dot.
The p-value according to Fisher's Randomization Test, in percent with one digit after the dot.
The p-value according to the Z-Test, in percent with one digit after the dot.

Note that your figures can (and probably will) vary, because of differences in how exactly you parsed the text collections, and how exactly you determined relevance of a returned document for a query.

Name	Precision TF-IDF	Precision BM25	p-value T-Test	p-value R-Test	p-value Z-Test
Björn	0.2, 0.2, 0.2, 0.4, 0.6	0.6, 0.2, 0.2, 0.6, 0.4	17.8%	55.3%	14.7%
Janosch	0.2, 0.4, 0.4, 0.8, 0.4	0.4, 0.4, 0.4, 0.8, 0.6	9.9%	58.9%	8.4%

-  ⇤ ← Revision 8 as of 2014-02-04 17:06:12 → 
  Size: 948
  Editor: Björn Buchhold
  Comment:
+   ← Revision 18 as of 2014-02-05 21:54:09 → ⇥
  Size: 1046
  Editor: Björn Buchhold
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 15:
-||Björn || 0.2, 0.2, 0.2, 0.4, 0.6|| 0.6, 0.2, 0.2, 0.6, 0.4 || 15.9% ||78% || ?? ||
+||Björn || 0.2, 0.2, 0.2, 0.4, 0.6|| 0.6, 0.2, 0.2, 0.6, 0.4 || 17.8% ||55.3% || 14.7% ||
||Janosch || 0.2, 0.4, 0.4, 0.8, 0.4 || 0.4, 0.4, 0.4, 0.8, 0.6 || 9.9% || 58.9% || 8.4% ||