461
Comment:
|
3337
|
Deletions are marked like this. | Additions are marked like this. |
Line 6: | Line 6: |
||'''Name''' ||'''P@3''' ||'''P@R'''||'''MAP'''||'''BM25 Parameters'''||'''Refinements'''|| ||Baseline || 0.xx ||0.xx ||0.xx ||k=x.xx, b=x.x ||None (baseline) || |
||'''Name''' ||'''MP@3''' ||'''MP@R'''||'''MAP'''||'''BM25 Parameters'''||'''Refinements'''|| ||Baseline || 0.53 ||0.41 ||0.40 ||k=1.75, b=0.1 ||None (baseline) || ||fe66 || 0.23 ||0.23 ||0.26 ||k=2.00, b=0.1 ||Position in the list taken into account || ||ts341 || 0.50 ||0.33 ||0.34 ||k=1.20, b=0.5 ||Ignoring stop words. || ||km151 || 0.67 ||0.46 ||0.43 ||k=0.05 b=0.0001 ||Position in the list taken into account || ||lm310 || 0.47 ||0.31 ||0.30 ||k=2 b=0.5 ||No additional modification || ||ff115 || 0.57 ||0.42 ||0.41 ||k=1.25 b=0.25 || BM25 is boosted by factor 1.5 if both words are in same record at each merge || ||jk544 || 0.53 ||0.41 ||0.42 ||k=1.5, b=0.2 || no additional modification || ||tg75 || 0.40 || 0.29 || 0.26 ||k=5.0, b=0.4 ||None || ||ms801 || 0.60 || 0.39 || 0.38 ||k=2.25, b=0.5 ||BM25 is boosted by factor 1.42 if both words are in same record at each merge || ||dk295 || 0.53 || 0.42 || 0.38 ||k=1.75, b=0.0 ||None || ||re55 || 0.53 || 0.38 || 0.34 ||k=2.0, b=0.3 ||None || ||hm101 || 0.47 || 0.21 || 0.20 ||k=2.0, b=1 ||None || ||mf233 || 0.50 || 0.37 || 0.40 || k=1.23, b=0.42 || None || ||dt36 || 0.53 || 0.41 || 0.41 || k=1.75, b=0.1 || None || ---- /!\ '''End of edit conflict''' ---- ||an145-jc142 || 0.53 || 0.41 || 0.43 || k=1.5, b=0.01 || None || ||ab766 || 0.53 || 0.40 || 0.23 || k=1.75, b=0.25 || None || ||gs121 || 0.50 || 0.28 || 0.32 || k=1, b=0.5 || None || ||aw281 || 0.37 || 0.29 || 0.26 || k=1.75, b=0.65 || None || ||co41+jr76 || 0.60 || 0.17 || 0.41 || k=0.8, b=0.01 || Position in the list taken into account + BM25 is boosted if both words are in same record at each merge || ||cl145 || 0.36 || 0.24 || 0.23 || k=1.75, b=0.10 || None || ||or17 || 0.53 || 0.41 || 0.40 || k=1.60, b=0.10 || None || ||pb138 || 0.53 || 0.41 || 0.41 || k=1.61, b=0.1 || None || ||am501 || 0.43 || 0.16 || 0.14 || k=1.75, b=0.1 || None || ||ss515 || 0.50 || 0.36 || 0.37 || k=1, b=0.5 || None || ||ak346 || 0.13 || 0.15 || 0.14 || k=1.75, b=0.1 || None || ||dw118 || 0.53 || 0.40 || 0.40 || k=1.75, b=0.05 || None || ||eb162 || 0.53 || 0.21 || 0.20 || k=1.75, b=0.1 || None || ||Christina || 0.43 || 0.35 || 0.44 || k=0.0025, b=0.0001 || popularity + boosting exact matches + no stop words || ||jw355|| 0.16 || 0.24 || 0.15 || k=1.75, b=0.1 || None || ||jl387 || 0.46 || 0.41 || 0.10 || k=1.75, b=0.1 || None || ||as962-sp244|| 0.60 || 0.42 || 0.39 || k= 0.85, b=0.0005 || None || || ep90+je177 || 0.60 || 0.47 || 0.48 || k=0.5, b=0.45 || Position of the words in the documents is taken into account || ||sh477 || 0.53 || 0.39 || 0.37 || k=1.5, b=0.3 || None || || la109+os90 || 0.63 || 0.44 || 0.35 || k=0.85, b=0.05 || Ignoring words with length<3 || ||yr13 || 0.53 || 0.41 || 0.39 || k=1.75, b=0.1 || None || ||cz4 || 0.48 || 0.43 || 0.44 || k=1.5, b=0.25 || None || ||as747+pw120 || 0.26 || 0.23|| 0.xx || k=1.75, b=0.15 || Still in progress|| ||jk59 || 0.53 || 0.39 || 0.38 || k=2.5, b=0.1 || None|| ||si52|| 0.5 || 0.5 || 0.107 || k=1.7, b=0.5 || None || |
Results for Exercise Sheet 2 (Ranking)
Add your row to the table below, following the examples already there. Please write down all values with exactly two digits of precision. In the first column, write your first name, or name1+name2 if you work in a group.
Name |
MP@3 |
MP@R |
MAP |
BM25 Parameters |
Refinements |
Baseline |
0.53 |
0.41 |
0.40 |
k=1.75, b=0.1 |
None (baseline) |
fe66 |
0.23 |
0.23 |
0.26 |
k=2.00, b=0.1 |
Position in the list taken into account |
ts341 |
0.50 |
0.33 |
0.34 |
k=1.20, b=0.5 |
Ignoring stop words. |
km151 |
0.67 |
0.46 |
0.43 |
k=0.05 b=0.0001 |
Position in the list taken into account |
lm310 |
0.47 |
0.31 |
0.30 |
k=2 b=0.5 |
No additional modification |
ff115 |
0.57 |
0.42 |
0.41 |
k=1.25 b=0.25 |
BM25 is boosted by factor 1.5 if both words are in same record at each merge |
jk544 |
0.53 |
0.41 |
0.42 |
k=1.5, b=0.2 |
no additional modification |
tg75 |
0.40 |
0.29 |
0.26 |
k=5.0, b=0.4 |
None |
ms801 |
0.60 |
0.39 |
0.38 |
k=2.25, b=0.5 |
BM25 is boosted by factor 1.42 if both words are in same record at each merge |
dk295 |
0.53 |
0.42 |
0.38 |
k=1.75, b=0.0 |
None |
re55 |
0.53 |
0.38 |
0.34 |
k=2.0, b=0.3 |
None |
hm101 |
0.47 |
0.21 |
0.20 |
k=2.0, b=1 |
None |
mf233 |
0.50 |
0.37 |
0.40 |
k=1.23, b=0.42 |
None |
dt36 |
0.53 |
0.41 |
0.41 |
k=1.75, b=0.1 |
None |
End of edit conflict
an145-jc142 |
0.53 |
0.41 |
0.43 |
k=1.5, b=0.01 |
None |
ab766 |
0.53 |
0.40 |
0.23 |
k=1.75, b=0.25 |
None |
gs121 |
0.50 |
0.28 |
0.32 |
k=1, b=0.5 |
None |
aw281 |
0.37 |
0.29 |
0.26 |
k=1.75, b=0.65 |
None |
co41+jr76 |
0.60 |
0.17 |
0.41 |
k=0.8, b=0.01 |
Position in the list taken into account + BM25 is boosted if both words are in same record at each merge |
cl145 |
0.36 |
0.24 |
0.23 |
k=1.75, b=0.10 |
None |
or17 |
0.53 |
0.41 |
0.40 |
k=1.60, b=0.10 |
None |
pb138 |
0.53 |
0.41 |
0.41 |
k=1.61, b=0.1 |
None |
am501 |
0.43 |
0.16 |
0.14 |
k=1.75, b=0.1 |
None |
ss515 |
0.50 |
0.36 |
0.37 |
k=1, b=0.5 |
None |
ak346 |
0.13 |
0.15 |
0.14 |
k=1.75, b=0.1 |
None |
dw118 |
0.53 |
0.40 |
0.40 |
k=1.75, b=0.05 |
None |
eb162 |
0.53 |
0.21 |
0.20 |
k=1.75, b=0.1 |
None |
Christina |
0.43 |
0.35 |
0.44 |
k=0.0025, b=0.0001 |
popularity + boosting exact matches + no stop words |
jw355 |
0.16 |
0.24 |
0.15 |
k=1.75, b=0.1 |
None |
jl387 |
0.46 |
0.41 |
0.10 |
k=1.75, b=0.1 |
None |
as962-sp244 |
0.60 |
0.42 |
0.39 |
k= 0.85, b=0.0005 |
None |
ep90+je177 |
0.60 |
0.47 |
0.48 |
k=0.5, b=0.45 |
Position of the words in the documents is taken into account |
sh477 |
0.53 |
0.39 |
0.37 |
k=1.5, b=0.3 |
None |
la109+os90 |
0.63 |
0.44 |
0.35 |
k=0.85, b=0.05 |
Ignoring words with length<3 |
yr13 |
0.53 |
0.41 |
0.39 |
k=1.75, b=0.1 |
None |
cz4 |
0.48 |
0.43 |
0.44 |
k=1.5, b=0.25 |
None |
as747+pw120 |
0.26 |
0.23 |
0.xx |
k=1.75, b=0.15 |
Still in progress |
jk59 |
0.53 |
0.39 |
0.38 |
k=2.5, b=0.1 |
None |
si52 |
0.5 |
0.5 |
0.107 |
k=1.7, b=0.5 |
None |