|
Size: 773
Comment:
|
Size: 3879
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 3: | Line 3: |
| Please add your row to the table below, following the examples already there. Report test results for each of the three test datasets in increasing size (test_ratings_50/test_ratings_200/test_ratings). Specify all numbers in percent, rounded to the first decimal place. Briefly specify your variant and any refinements you might have implemented. | Please add your row to the table below, following the examples already there. Report test results for each of the three test datasets in increasing size (50 examples/200 examples/all examples). Specify all numbers in percent, rounded to the first decimal place. Briefly specify your variant and any refinements you might have implemented. |
| Line 5: | Line 5: |
| ||<tablewidth="100%" tableheight="auto" style="text-align:center"> '''Name''' ||<:> '''Baseline Precisions''' ||<:> '''Variant Precisions''' ||<:>'''p-values t-Test''' ||'''Additional Information''' || ||Elmar ||<:>74.0% / 66.0% / 69.8%||<:>80.0% / 68.0% / 73.2%||<:>47.8% / 67.1% / 0.2% || Variant: logistic regression without batches, 10 iterations || ||Elias & Maxi ||<:>86.4% / 63.8% / 71.4%||<:>84.6% / 63.9% / 72.1%||<:>82.7% / 83.7% / 26.9% || Variant: logistic regression (no batches), 30 iterations || ||ES ||<:>68.0% / 64.0% / 71.1%||<:>74.0% / 69.0% / 73.1%||<:>64.0% / 45.3% / 21.0% || Variant: logistic regression (no batches), stop iteration if wrong predictions are less then 7% of documents, averaging || ||ID ||<:>68.0% / 65.0% / 68.2%||<:>76.0% / 66.0% / 72.4%||<:>52,8% / 88.2% / 1.04% || Variant: logistic regression without batches, 10 iterations + averaging || ||Hui Hui ||<:>74.0% / 66.0% / 69.8%||<:>78.0% / 67.0% / 71.3%||<:>69.5% / 81.8% / 15.9% || Variant: logistic regression || ||Perspective Daily ||<:>74.0% / 66.0% / 69.8%||<:>76.0% / 68.0% / 72.8%||<:>43.5% / 38.1% / 2.7% || Variant: Averaging || ||Alex ||<:>74.0% / 67.0% / 69.0%||<:>76.0% / 70.0% / 74.0%||<:>87.1% / 70.4% / 0.71% || Variant: logistic regression with averaging, 10 Iterations || ||David ||<:>75.2% / 67.0% / 69.7%||<:>76.9% / 67.3% / 72.8%||<:>47.3% / 49.2% / 16.9% || Variant: Averaging, 10 Iterations || |
|
| Line 6: | Line 15: |
||<tablewidth="100%" tableheight="auto" style="text-align:center"> '''Name''' ||<:> '''Baseline Precisions''' ||<:> '''Variant Precisions''' ||<:> '''p-values T-Test''' ||<:>'''Additional Information''' || || Elmar ||<:>74.0% / 66.0% / 79.8%||<:>80.0% / 68.0% / 73.2%||<:>47.8% / 67.1% / 0.2% ||Variant: logistic regression || |
||<tablewidth="100%" tableheight="auto" style="text-align:center" |2> '''Name''' |||||| '''50 Examples''' |||||| '''200 Examples''' |||||| '''3140 Examples''' ||<style="text-align:center" |2>'''Parameters''' || ||<:> '''Baseline''' ||<style="text-align:center"> '''Variant''' ||<:> '''p-Value''' ||<:> '''Baseline''' ||<:> '''Variant''' ||<:> '''p-Value''' ||<:> '''Baseline''' ||<:> '''Variant''' ||<:> '''p-Value''' || ||Elmar ||<:> 74.0% ||<:> 80.0% ||<:> 47.8% ||<:> 66.0% ||<:> 68.0% ||<:> 67.1% ||<:> 69.8% ||<:> 73.2% ||<:> 0.2% || Variant: logistic regression without batches, 10 iterations || ||Elias & Maxi ||<:> 86.4% ||<:> 84.6% ||<:> 82.7% ||<:> 63.8% ||<:> 63.9% ||<:> 83.7% ||<:> 71.4% ||<:> 72.1% ||<:> 26.9% || Variant: logistic regression (no batches), 30 iterations || ||ES ||<:> 68.0% ||<:> 74.0% ||<:> 64.0% ||<:> 64.0% ||<:> 69.0% ||<:> 45.3% ||<:> 71.1% ||<:> 73.1% ||<:> 21.0% || Variant: logistic regression (no batches), stop iteration if wrong predictions are less then 7% of documents, averaging || ||ID ||<:> 68.0% ||<:> 76.0% ||<:> 52.8% ||<:> 65.0% ||<:> 66.0% ||<:> 88.2% ||<:> 68.2% ||<:> 72.4% ||<:> 1.04% || Variant: logistic regression without batches, 10 iterations + averaging || ||Hui Hui ||<:> 74.0% ||<:> 78.0% ||<:> 69.5% ||<:> 66.0% ||<:> 67.0% ||<:> 81.8% ||<:> 69.8% ||<:> 71.3% ||<:> 15.9% || Variant: logistic regression || ||Perspective Daily ||<:> 74.0% ||<:> 76.0% ||<:> 43.5% ||<:> 66.0% ||<:> 68.0% ||<:> 38.1% ||<:> 69.8% ||<:> 72.8% ||<:> 2.7% || Variant: Averaging || ||Alex ||<:> 74.0% ||<:> 76.0% ||<:> 87.1% ||<:> 67.0% ||<:> 70.0% ||<:> 70.4% ||<:> 69.0% ||<:> 74.0% ||<:> 0.71% || Variant: logistic regression with averaging, 10 Iterations || ||David ||<:> 75.2% ||<:> 76.9% ||<:> 47.3% ||<:> 67.0% ||<:> 67.3% ||<:> 49.2% ||<:> 69.7% ||<:> 72.8% ||<:> 16.9% || Variant: Averaging, 10 Iterations || |
Results for Exercise Sheet 12 (statistical significance tests)
Please add your row to the table below, following the examples already there. Report test results for each of the three test datasets in increasing size (50 examples/200 examples/all examples). Specify all numbers in percent, rounded to the first decimal place. Briefly specify your variant and any refinements you might have implemented.
Name |
Baseline Precisions |
Variant Precisions |
p-values t-Test |
Additional Information |
Elmar |
74.0% / 66.0% / 69.8% |
80.0% / 68.0% / 73.2% |
47.8% / 67.1% / 0.2% |
Variant: logistic regression without batches, 10 iterations |
Elias & Maxi |
86.4% / 63.8% / 71.4% |
84.6% / 63.9% / 72.1% |
82.7% / 83.7% / 26.9% |
Variant: logistic regression (no batches), 30 iterations |
ES |
68.0% / 64.0% / 71.1% |
74.0% / 69.0% / 73.1% |
64.0% / 45.3% / 21.0% |
Variant: logistic regression (no batches), stop iteration if wrong predictions are less then 7% of documents, averaging |
ID |
68.0% / 65.0% / 68.2% |
76.0% / 66.0% / 72.4% |
52,8% / 88.2% / 1.04% |
Variant: logistic regression without batches, 10 iterations + averaging |
Hui Hui |
74.0% / 66.0% / 69.8% |
78.0% / 67.0% / 71.3% |
69.5% / 81.8% / 15.9% |
Variant: logistic regression |
Perspective Daily |
74.0% / 66.0% / 69.8% |
76.0% / 68.0% / 72.8% |
43.5% / 38.1% / 2.7% |
Variant: Averaging |
Alex |
74.0% / 67.0% / 69.0% |
76.0% / 70.0% / 74.0% |
87.1% / 70.4% / 0.71% |
Variant: logistic regression with averaging, 10 Iterations |
David |
75.2% / 67.0% / 69.7% |
76.9% / 67.3% / 72.8% |
47.3% / 49.2% / 16.9% |
Variant: Averaging, 10 Iterations |
Name |
50 Examples |
200 Examples |
3140 Examples |
Parameters |
||||||
Baseline |
Variant |
p-Value |
Baseline |
Variant |
p-Value |
Baseline |
Variant |
p-Value |
||
Elmar |
74.0% |
80.0% |
47.8% |
66.0% |
68.0% |
67.1% |
69.8% |
73.2% |
0.2% |
Variant: logistic regression without batches, 10 iterations |
Elias & Maxi |
86.4% |
84.6% |
82.7% |
63.8% |
63.9% |
83.7% |
71.4% |
72.1% |
26.9% |
Variant: logistic regression (no batches), 30 iterations |
ES |
68.0% |
74.0% |
64.0% |
64.0% |
69.0% |
45.3% |
71.1% |
73.1% |
21.0% |
Variant: logistic regression (no batches), stop iteration if wrong predictions are less then 7% of documents, averaging |
ID |
68.0% |
76.0% |
52.8% |
65.0% |
66.0% |
88.2% |
68.2% |
72.4% |
1.04% |
Variant: logistic regression without batches, 10 iterations + averaging |
Hui Hui |
74.0% |
78.0% |
69.5% |
66.0% |
67.0% |
81.8% |
69.8% |
71.3% |
15.9% |
Variant: logistic regression |
Perspective Daily |
74.0% |
76.0% |
43.5% |
66.0% |
68.0% |
38.1% |
69.8% |
72.8% |
2.7% |
Variant: Averaging |
Alex |
74.0% |
76.0% |
87.1% |
67.0% |
70.0% |
70.4% |
69.0% |
74.0% |
0.71% |
Variant: logistic regression with averaging, 10 Iterations |
David |
75.2% |
76.9% |
47.3% |
67.0% |
67.3% |
49.2% |
69.7% |
72.8% |
16.9% |
Variant: Averaging, 10 Iterations |