|
Size: 1797
Comment:
|
Size: 1819
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 3: | Line 3: |
| These results should be based on the file movies.test-benchmark.tsv. Click "Edit (Text)" in the upper bar of this page and add your row to the table below, following the examples already there. Please write down all values with '''exactly two digits of precision'''. In the first column, write your account name, or name1+name2 if you work in a group. |
These results should be based on the file movies.test-benchmark.tsv. Click "Edit (Text)" in the upper bar of this page and add your row to the table below, following the examples already there. Please write down all values with '''exactly two digits of precision'''. In the first column, write your account name, or name1+name2 if you work in a group. |
| Line 7: | Line 6: |
| ||mi81-mk1357 ||0.83|| 0.77 || 0.75||b=0, k=0 || queries changed || | ||mi81-mk1357 ||0.83 ||0.77 ||0.75 ||b=0, k=0 ||queries changed || |
| Line 9: | Line 8: |
| ||ar479-ss1736 ||0.83 ||0.71 ||0.70||b=0.04, k=0.7||None (baseline) || ||ew98 ||0.77 ||0.71 ||0.70||b=0.1, k=0.2||Query changes || ||tl109 ||0.72 ||0.69 ||0.67 ||b=0.01, k=0.22||Random search for parameters, hardcoded some simple English grammar rules (actually hurt the performance) || ||bw63 ||0.77 ||0.70 ||0.70||b=0, k=0||Trying to interpret context (.01 diffrence :D) || ||ls720 ||0.83 ||0.71 ||0.69||b=0, k=0.71||None (baseline) || ||sr463 ||0.61 ||0.51 ||0.5||b=0, k=0||Remove most common words from query - reduced performance || ||oa49 || 0.77 ||0.70 ||0.69||b=0, k=0||None (baseline) || ||tb305 || 0.56 ||0.37 ||0.36||b=0, k=1.75||results with words together boosted || ||mb925 || 0.77 ||0.63 ||0.67||b=0.048, k=0.011||minor query change + nevergrad for b, k || ||kk486 ||0.79 ||0.72 ||0.7 ||b=0, k=1 ||Query change|| ||jm408-ms946||0.67||0.66||0.68||b=0.18, k=0.5|| None (baseline)|| ||ak482||0.77||0.7||0.69||b=1 k=0|| None (baseline)|| ||sw540||0.78||0.71||0.69||b=0.56, k=0||pso for optimizing b and k, remove stop words in keywords using a dictionary|| |
||ar479-ss1736 ||0.83 ||0.71 ||0.70 ||b=0.04, k=0.7 ||None (baseline) || ||ew98 ||0.77 ||0.71 ||0.70 ||b=0.1, k=0.2 ||Query changes || ||tl109 ||0.72 ||0.69 ||0.67 ||b=0.01, k=0.22 ||Random search for parameters, hardcoded some simple English grammar rules (actually hurt the performance) || ||bw63 ||0.77 ||0.70 ||0.70 ||b=0, k=0 ||Trying to interpret context (.01 diffrence :D) || ||ls720 ||0.83 ||0.71 ||0.69 ||b=0, k=0.71 ||None (baseline) || ||sr463 ||0.61 ||0.51 ||0.5 ||b=0, k=0 ||Remove most common words from query - reduced performance || ||oa49 ||0.77 ||0.70 ||0.69 ||b=0, k=0 ||None (baseline) || ||tb305 ||0.56 ||0.37 ||0.36 ||b=0, k=1.75 ||results with words together boosted || ||mb925 ||0.77 ||0.63 ||0.67 ||b=0.048, k=0.011 ||minor query change + nevergrad for b, k || ||kk486 ||0.79 ||0.72 ||0.7 ||b=0, k=1 ||Query change || ||jm408-ms946 ||0.67 ||0.66 ||0.68 ||b=0.18, k=0.5 ||None (baseline) || ||ak482 ||0.77 ||0.7 ||0.69 ||b=1 k=0 ||None (baseline) || ||sw540||0.78||0.71||0.69||b=0.56, k=0||pso for optimizing b and k, remove stop words in keywords using a dictionary|| |
Results for Exercise Sheet 2 (Ranking)
These results should be based on the file movies.test-benchmark.tsv. Click "Edit (Text)" in the upper bar of this page and add your row to the table below, following the examples already there. Please write down all values with exactly two digits of precision. In the first column, write your account name, or name1+name2 if you work in a group.
Name |
MP@3 |
MP@R |
MAP |
BM25 Parameters |
Refinements |
pb1042 |
0.67 |
0.67 |
0.68 |
b=0.2, k=0.8 |
None (baseline) |
mi81-mk1357 |
0.83 |
0.77 |
0.75 |
b=0, k=0 |
queries changed |
hc63 |
0.83 |
0.74 |
0.63 |
b=0, k=0 |
Query changes |
ar479-ss1736 |
0.83 |
0.71 |
0.70 |
b=0.04, k=0.7 |
None (baseline) |
ew98 |
0.77 |
0.71 |
0.70 |
b=0.1, k=0.2 |
Query changes |
tl109 |
0.72 |
0.69 |
0.67 |
b=0.01, k=0.22 |
Random search for parameters, hardcoded some simple English grammar rules (actually hurt the performance) |
bw63 |
0.77 |
0.70 |
0.70 |
b=0, k=0 |
Trying to interpret context (.01 diffrence :D) |
ls720 |
0.83 |
0.71 |
0.69 |
b=0, k=0.71 |
None (baseline) |
sr463 |
0.61 |
0.51 |
0.5 |
b=0, k=0 |
Remove most common words from query - reduced performance |
oa49 |
0.77 |
0.70 |
0.69 |
b=0, k=0 |
None (baseline) |
tb305 |
0.56 |
0.37 |
0.36 |
b=0, k=1.75 |
results with words together boosted |
mb925 |
0.77 |
0.63 |
0.67 |
b=0.048, k=0.011 |
minor query change + nevergrad for b, k |
kk486 |
0.79 |
0.72 |
0.7 |
b=0, k=1 |
Query change |
jm408-ms946 |
0.67 |
0.66 |
0.68 |
b=0.18, k=0.5 |
None (baseline) |
ak482 |
0.77 |
0.7 |
0.69 |
b=1 k=0 |
None (baseline) |
sw540 |
0.78 |
0.71 |
0.69 |
b=0.56, k=0 |
pso for optimizing b and k, remove stop words in keywords using a dictionary |