|
Size: 1986
Comment:
|
← Revision 26 as of 2016-12-16 00:25:33 ⇥
Size: 2662
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 3: | Line 3: |
| Add your row to the table below, following the examples already there. Please write down all values with '''exactly two digits of precision'''. In the first column, write your first name, or name1+name2 if you work in a group. | Add your row to the table below, following the examples already there. Please write down all values as percent with '''exactly one digit of precision'''. In the first column, write your first name, or name1+name2 if you work in a group. |
| Line 5: | Line 5: |
| ||'''Name''' ||'''P@3''' ||'''P@R'''||'''MAP'''||'''BM25 Parameters'''||'''Refinements'''|| ||Baseline || 0.57 ||0.38 ||0.37 ||k=1.75, b=0.0 ||None (baseline) || ---- /!\ '''Edit conflict - other version:''' ---- ||<tablewidth="100%" tableheight="auto" style="text-align:center" |2> '''Name''' |||||| '''BM25''' |||||| '''Only LSI''' |||||| '''BM25 + LSI''' ||<style="text-align:center" |2>'''Processor / RAM''' ||||<style="text-align:center" |2>'''Language''' || ||<:> '''P@3''' ||<style="text-align:center"> '''P@R''' ||<:> '''#PEDs Q''' ||<:> '''Time B''' ||<:> '''Time Q''' ||<:> '''#PEDs Q''' ||<:> '''Time B''' ||<:> '''Time Q''' ||<:> '''#PEDs Q''' || ||Elmar ||<:> 3,912ms ||<:> 1,218ms ||<:> 48,521 ||<:> 12,254ms ||<:> 107ms ||<:> 1,206 ||<:> 8,060ms ||<:> 3ms ||<:> 5 || Intel i5-2520M @ 2.50GHz / 8GB || Python || ---- /!\ '''Edit conflict - your version:''' ---- ||<tablewidth="100%" tableheight="auto" style="text-align:center" |2> '''Name''' |||||| '''BM25''' |||||| '''Only LSI''' |||||| '''BM25 + LSI''' ||<style="text-align:center" |2>'''Parameters''' |||| ||<:> '''P@3''' ||<style="text-align:center"> '''P@R''' ||<:> '''#PEDs Q''' ||<:> '''Time B''' ||<:> '''Time Q''' ||<:> '''#PEDs Q''' ||<:> '''Time B''' ||<:> '''Time Q''' ||<:> '''#PEDs Q''' || ||Elmar ||<:> 3,912ms ||<:> 1,218ms ||<:> 48,521 ||<:> 12,254ms ||<:> 107ms ||<:> 1,206 ||<:> 8,060ms ||<:> 3ms ||<:> 5 || Intel i5-2520M @ 2.50GHz / 8GB || Python || ---- /!\ '''End of edit conflict''' ---- |
||<tablewidth="100%" tableheight="auto" style="text-align:center" |2> '''Name''' |||||| '''BM25''' |||||| '''Only LSI''' |||||| '''BM25 + LSI''' ||<style="text-align:center" |2>'''Parameters''' || ||<:> '''P@3''' ||<style="text-align:center"> '''P@R''' ||<:> '''MAP''' ||<:> '''P@3''' ||<:> '''P@R''' ||<:> '''MAP''' ||<:> '''P@3''' ||<:> '''P@R''' ||<:> '''MAP''' || ||Elmar ||<:> 50.0 ||<:> 39.0 ||<:> 37.5 ||<:> 3.3 ||<:> 1.9 ||<:> 1.4 ||<:> 56.7 ||<:> 37.9 ||<:> 37.8 || bm25k=1.75, bm25b=0.75, lambda=0.67, k=10, m=20000 || ||Elias ||<:> 46.67 ||<:> 27.7 ||<:> 23.1 ||<:> 10 ||<:> 1.7 ||<:> 1.6 ||<:> 46.6 ||<:> 27.7 ||<:> 24.3 || bm25k=1.3, bm25b=0.1, lambda=0.67, k=50, m=20000 || ||Marco ||<:> 53.3 ||<:> 40.6 ||<:> 37.1 ||<:> 3.3 ||<:> 1.6 ||<:> 1.3 ||<:> 56.7 ||<:> 40.1 ||<:> 38.3 || bm25k=0.75, bm25b=0.25, lambda=0.6, k=5, m=5000 || ||David ||<:> 53.3 ||<:> 40.0 ||<:> 33.1 ||<:> 6.7 ||<:> 2.3 ||<:> 1.7 ||<:> 60.0 ||<:> 40.3 ||<:> 34.5 || bm25k=1.75, bm25b=0.2, lambda=0.8, k=15, m=15000 || ||ES ||<:> 30.0 ||<:> 13.6 ||<:> 14.4 ||<:> 3.3 ||<:> 1.5 ||<:> 1.2 ||<:> 30.0 ||<:> 14.1 ||<:> 14.5 || bm25k=1.75, bm25b=0.75, lambda=0.67, k=10, m=20000 ... something wrong|| ||Robin ||<:> 56.7 ||<:> 38.4 ||<:> 38.2 ||<:> 3.3 ||<:> 2.0 ||<:> 1.6 ||<:> 53.3 ||<:> 37.9 ||<:> 37.9 || bm25k=1.75, bm25b=0.0, lambda=0.8, k=10, m=10000 || ||Daniel ||<:> 60 ||<:> 43.9 ||<:> 39.3 ||<:> 3.3 ||<:> 2.2 ||<:> 2.0 ||<:> 63.3 ||<:> 42.6 ||<:> 40 || bm25k=1.75, bm25b=0.0, lambda=0.62, k=10, m=20000 || ||Evgeny+numair ||<:> 57.0 ||<:> 42.0 ||<:> 39.0 ||<:> 10.0 ||<:> 3.0 ||<:> 2.0 ||<:> 53.0 ||<:> 40.0 ||<:> 40.0 || bm25k=0.75, bm25b=0.0, lambda=0.6, k=50, m=50000 || |
Results for Exercise Sheet 8 (LSI)
Add your row to the table below, following the examples already there. Please write down all values as percent with exactly one digit of precision. In the first column, write your first name, or name1+name2 if you work in a group.
Name |
BM25 |
Only LSI |
BM25 + LSI |
Parameters |
||||||
P@3 |
P@R |
MAP |
P@3 |
P@R |
MAP |
P@3 |
P@R |
MAP |
||
Elmar |
50.0 |
39.0 |
37.5 |
3.3 |
1.9 |
1.4 |
56.7 |
37.9 |
37.8 |
bm25k=1.75, bm25b=0.75, lambda=0.67, k=10, m=20000 |
Elias |
46.67 |
27.7 |
23.1 |
10 |
1.7 |
1.6 |
46.6 |
27.7 |
24.3 |
bm25k=1.3, bm25b=0.1, lambda=0.67, k=50, m=20000 |
Marco |
53.3 |
40.6 |
37.1 |
3.3 |
1.6 |
1.3 |
56.7 |
40.1 |
38.3 |
bm25k=0.75, bm25b=0.25, lambda=0.6, k=5, m=5000 |
David |
53.3 |
40.0 |
33.1 |
6.7 |
2.3 |
1.7 |
60.0 |
40.3 |
34.5 |
bm25k=1.75, bm25b=0.2, lambda=0.8, k=15, m=15000 |
ES |
30.0 |
13.6 |
14.4 |
3.3 |
1.5 |
1.2 |
30.0 |
14.1 |
14.5 |
bm25k=1.75, bm25b=0.75, lambda=0.67, k=10, m=20000 ... something wrong |
Robin |
56.7 |
38.4 |
38.2 |
3.3 |
2.0 |
1.6 |
53.3 |
37.9 |
37.9 |
bm25k=1.75, bm25b=0.0, lambda=0.8, k=10, m=10000 |
Daniel |
60 |
43.9 |
39.3 |
3.3 |
2.2 |
2.0 |
63.3 |
42.6 |
40 |
bm25k=1.75, bm25b=0.0, lambda=0.62, k=10, m=20000 |
Evgeny+numair |
57.0 |
42.0 |
39.0 |
10.0 |
3.0 |
2.0 |
53.0 |
40.0 |
40.0 |
bm25k=0.75, bm25b=0.0, lambda=0.6, k=50, m=50000 |