|
Size: 2099
Comment:
|
Size: 2116
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 20: | Line 20: |
| ||pm187 ||0.77 ||0.70 ||0.69 ||b=0 k=0 ||Optimizing b,k on training set, adding synonyms with nltk to query and/or removing common english word have decreased performance || | ||pm187 ||0.77 ||0.70 ||0.69 ||b=0 k=0 ||Only optimized b,k on training set. Adding synonyms with nltk to query and/or removing common english words have decreased evaluation performance. || |
Results for Exercise Sheet 2 (Ranking)
These results should be based on the file movies.test-benchmark.tsv. Click "Edit (Text)" in the upper bar of this page and add your row to the table below, following the examples already there. Please write down all values with exactly two digits of precision. In the first column, write your account name, or name1+name2 if you work in a group.
Name |
MP@3 |
MP@R |
MAP |
BM25 Parameters |
Refinements |
pb1042 |
0.67 |
0.67 |
0.68 |
b=0.2, k=0.8 |
None (baseline) |
mi81-mk1357 |
0.83 |
0.77 |
0.75 |
b=0, k=0 |
queries changed |
hc63 |
0.83 |
0.74 |
0.63 |
b=0, k=0 |
Query changes |
ar479-ss1736 |
0.83 |
0.71 |
0.70 |
b=0.04, k=0.7 |
None (baseline) |
ew98 |
0.77 |
0.71 |
0.70 |
b=0.1, k=0.2 |
Query changes |
tl109 |
0.72 |
0.69 |
0.67 |
b=0.01, k=0.22 |
Random search for parameters, hardcoded some simple English grammar rules (actually hurt the performance) |
bw63 |
0.77 |
0.70 |
0.70 |
b=0, k=0 |
Trying to interpret context (.01 diffrence :D) |
ls720 |
0.83 |
0.71 |
0.69 |
b=0, k=0.71 |
None (baseline) |
sr463 |
0.61 |
0.51 |
0.5 |
b=0, k=0 |
Remove most common words from query - reduced performance |
oa49 |
0.77 |
0.70 |
0.69 |
b=0, k=0 |
None (baseline) |
tb305 |
0.56 |
0.37 |
0.36 |
b=0, k=1.75 |
results with words together boosted |
mb925 |
0.77 |
0.63 |
0.67 |
b=0.048, k=0.011 |
minor query change + nevergrad for b, k |
kk486 |
0.79 |
0.72 |
0.7 |
b=0, k=1 |
Query change |
jm408-ms946 |
0.67 |
0.66 |
0.68 |
b=0.18, k=0.5 |
None (baseline) |
ak482 |
0.77 |
0.7 |
0.69 |
b=1 k=0 |
None (baseline) |
pm187 |
0.77 |
0.70 |
0.69 |
b=0 k=0 |
Only optimized b,k on training set. Adding synonyms with nltk to query and/or removing common english words have decreased evaluation performance. |
sw540 |
0.78 |
0.71 |
0.69 |
b=0.56, k=0 |
pso for optimizing b and k, remove stop words in keywords using a dictionary |
ie15 |
0.83 |
0.69 |
0.69 |
b=0.11, k=0.23 |
query changes and giving more popular movies a bonus factor |