#acl All:read,write
= Results for Exercise Sheet 2 (Ranking) =
These results should be based on the file movies.test-benchmark.tsv.   Click "Edit (Text)" in the upper bar of this page and add your row to the table below, following the examples already there. Please write down all values with '''exactly two digits of precision'''. In the first column, write your account name, or name1+name2 if you work in a group.
||'''Name''' ||'''MP@3''' ||'''MP@R''' ||'''MAP''' ||'''BM25 Parameters''' ||'''Refinements''' ||
||pb1042 ||0.67 ||0.67 ||0.68 ||b=0.2, k=0.8 ||None (baseline) ||
||mi81-mk1357 ||0.83 ||0.77 ||0.75 ||b=0, k=0 ||queries changed ||
||hc63 ||0.83 ||0.74 ||0.63 ||b=0, k=0 ||Query changes ||
||ar479-ss1736 ||0.83 ||0.71 ||0.70 ||b=0.04, k=0.7 ||None (baseline) ||
||ew98 ||0.77 ||0.71 ||0.70 ||b=0.1, k=0.2 ||Query changes ||
||tl109 ||0.72 ||0.69 ||0.67 ||b=0.01, k=0.22 ||Random search for parameters, hardcoded some simple English grammar rules (actually hurt the performance) ||
||bw63 ||0.77 ||0.70 ||0.70 ||b=0, k=0 ||Trying to interpret context (.01 diffrence :D) ||
||ls720 ||0.83 ||0.71 ||0.69 ||b=0, k=0.71 ||None (baseline) ||
||sr463 ||0.61 ||0.51 ||0.5 ||b=0, k=0 ||Remove most common words from query - reduced performance ||
||oa49 ||0.77 ||0.70 ||0.69 ||b=0, k=0 ||None (baseline) ||
||tb305 ||0.56 ||0.37 ||0.36 ||b=0, k=1.75 ||results with words together boosted ||
||mb925 ||0.77 ||0.63 ||0.67 ||b=0.048, k=0.011 ||minor query change + nevergrad for b, k ||
||kk486 ||0.79 ||0.72 ||0.7 ||b=0, k=1 ||Query change ||
||jm408-ms946 ||0.67 ||0.66 ||0.68 ||b=0.18, k=0.5 ||None (baseline) ||
||ak482 ||0.77 ||0.7 ||0.69 ||b=1 k=0 ||None (baseline) ||
||pm187 ||0.77 ||0.70 ||0.69 ||b=0 k=0 ||Only optimized b,k on training set. Adding synonyms with nltk to query and/or removing common english words have decreased evaluation performance. ||
||sw540||0.78||0.71||0.69||b=0.56, k=0||pso for optimizing b and k, remove stop words in keywords using a dictionary||
||ie15||0.83||0.69||0.69||b=0.11, k=0.23||query changes and giving more popular movies a bonus factor||