|
Size: 844
Comment:
|
Size: 1426
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| Describe InformationRetrievalWS1516/ResultsES12 here. | #acl All:read,write = Results for Exercise Sheet 12 (statistical significance tests) = Please add your row to the table below, following the examples already there. Report test results for each of the three test datasets in increasing size (test_ratings_50/test_ratings_200/test_ratings). Specify all numbers in percent, rounded to the first decimal place. Briefly specify your variant and any refinements you might have implemented. |
| Line 3: | Line 5: |
| '''Precision''': the precision in percent rounded to integer | |
| Line 5: | Line 6: |
| '''p-value (Z)''': the p-value of the Z-tests in percent rounded to integer | |
| Line 7: | Line 7: |
| '''p-value (T)''': the p-value of the T-tests in percent rounded to integer | ||<tablewidth="80%" tableheight="auto" style="text-align:center"> '''Name''' ||<:> '''Baseline Precisions''' ||<:> '''Variant Precisions''' ||<:> '''p-values T-Test''' ||<style="text-align:center">'''Additional Information''' || ||<:>Elmar ||<:>74.0% / 66.0% / 79.8%||<:>80.0% / 68.0% / 73.2%||<:>47.8% / 67.1% / 0.2% ||Variant: logistic regression || |
| Line 9: | Line 10: |
| ||<tablewidth="100%" tableheight="auto" style="text-align:center" |2> '''Name''' ||<:> '''Baseline''' |||||| '''Variant 1''' |||||| '''Variant 2''' ||<style="text-align:center" |2>'''Parameters''' || ||<:> '''Precision''' ||<:> '''Precision''' ||<:> '''p-value (Z)''' ||<:> '''p-value (T)''' ||<:> '''Precision''' ||<:> '''p-value (Z)''' ||<:> '''p-value (T)''' || ||Elmar ||<:>50 / 60 / 70||<:>50 / 60 / 72||<:>1.5 / 4.6 / 2 ||<:>1.5 / 4.6 / 2 ||<:>50 / 60 / 73||<:>1.5 / 4.6 / 0 ||<:>1.5 / 4.6 / 0 || V1: avg. perceptron, V2: log. regression || |
||<tablewidth="100%" tableheight="auto" style="text-align:center" |2> '''Name''' |||||| '''BM25''' |||||| '''Only LSI''' |||||| '''BM25 + LSI''' ||<style="text-align:center" |2>'''Parameters''' || ||<:> '''P@3''' ||<style="text-align:center"> '''P@R''' ||<:> '''MAP''' ||<:> '''P@3''' ||<:> '''P@R''' ||<:> '''MAP''' ||<:> '''P@3''' ||<:> '''P@R''' ||<:> '''MAP''' || ||Elmar ||<:> 50.0 ||<:> 39.0 ||<:> 37.5 ||<:> 3.3 ||<:> 1.9 ||<:> 1.4 ||<:> 56.7 ||<:> 37.9 ||<:> 37.8 || bm25k=1.75, bm25b=0.75, lambda=0.67, k=10, m=20000 || |
Results for Exercise Sheet 12 (statistical significance tests)
Please add your row to the table below, following the examples already there. Report test results for each of the three test datasets in increasing size (test_ratings_50/test_ratings_200/test_ratings). Specify all numbers in percent, rounded to the first decimal place. Briefly specify your variant and any refinements you might have implemented.
Name |
Baseline Precisions |
Variant Precisions |
p-values T-Test |
Additional Information |
Elmar |
74.0% / 66.0% / 79.8% |
80.0% / 68.0% / 73.2% |
47.8% / 67.1% / 0.2% |
Variant: logistic regression |
Name |
BM25 |
Only LSI |
BM25 + LSI |
Parameters |
||||||
P@3 |
P@R |
MAP |
P@3 |
P@R |
MAP |
P@3 |
P@R |
MAP |
||
Elmar |
50.0 |
39.0 |
37.5 |
3.3 |
1.9 |
1.4 |
56.7 |
37.9 |
37.8 |
bm25k=1.75, bm25b=0.75, lambda=0.67, k=10, m=20000 |