1958
Comment:
|
4248
|
Deletions are marked like this. | Additions are marked like this. |
Line 21: | Line 21: |
||an145-jc142 || 0.53 || 0.41 || 0.43 || k=1.5, b=0.01 || None || | |
Line 27: | Line 28: |
||pb138 || 0.53 || 0.41 || 0.41 || k=1.61, b=0.1 || None || ||am501 || 0.43 || 0.16 || 0.14 || k=1.75, b=0.1 || None || ||ss515 || 0.50 || 0.36 || 0.37 || k=1, b=0.5 || None || ||ak346 || 0.13 || 0.15 || 0.14 || k=1.75, b=0.1 || None || ||dw118 || 0.53 || 0.40 || 0.40 || k=1.75, b=0.05 || None || ||eb162 || 0.53 || 0.21 || 0.20 || k=1.75, b=0.1 || None || ||Christina || 0.43 || 0.35 || 0.44 || k=0.0025, b=0.0001 || popularity + boosting exact matches + no stop words || ||jw355|| 0.16 || 0.24 || 0.15 || k=1.75, b=0.1 || None || ||jl387 || 0.46 || 0.41 || 0.10 || k=1.75, b=0.1 || None || ||as962-sp244|| 0.60 || 0.42 || 0.39 || k= 0.85, b=0.0005 || None || || ep90+je177 || 0.60 || 0.47 || 0.48 || k=0.5, b=0.45 || Position of the words in the documents is taken into account || ||sh477 || 0.53 || 0.39 || 0.37 || k=1.5, b=0.3 || None || || la109+os90 || 0.63 || 0.44 || 0.35 || k=0.85, b=0.05 || Ignoring words with length<3 || ||yr13 || 0.53 || 0.41 || 0.39 || k=1.75, b=0.1 || None || ||cz4 || 0.48 || 0.43 || 0.44 || k=1.5, b=0.25 || None || ||as747+pw120 || 0.26 || 0.23|| 0.22 || k=1.75, b=0.15 || None|| ||jk59 || 0.53 || 0.39 || 0.38 || k=2.5, b=0.1 || None|| ||si52|| 0.5 || 0.5 || 0.107 || k=1.7, b=0.5 || None || || nz21 || 0.53 || 0.42 || 0.41 || k=1.75, b=0.25 || With popularity (N^(-0.1)) and scores boosted by factor 1.5 if both words are in same record at each merge || || nz21 || 0.60 || 0.43 || 0.43 || k=1.75, b=0.25 || Only with scores boosted by factor 1.5 if both words are in same record at each merge || ||lm283 ||0.50 ||0.34 ||0.32 ||k=1.75, b=0.50 ||None|| ||cc98 ||0.53 ||0.41 ||0.40 ||k=1.75, b=0.1 ||None|| ||ma277 ||0.53 ||0.15 ||0.39 ||k=2.3, b=0.1 ||None|| ||pj23 || 0.53 ||0.41 ||0.30 ||k=1.9, b=0.2 ||None|| ||ss874 || 0.53 || 0.41 || 0.42 || k=1.6, b=0.2 || None || ||kb285|| 0.57 || 0.43 ||0.43 || k= 0.75, b = 0.01 || position is taken into account || ||st174|| 0.37 || 0.24 || 0.33 || k=1, b=0.1 || None || ||hr55-pg74|| 0.0 || 0.0 || 0.156 || k=0.5, b=0.1 || None || || ia42 ||0.53|| 0.41 || 0.41 || k=1.75, b=0.1|| None|| || dr189 ||0.53|| 0.41 || 0.41 || k=1.5, b=0.1|| None|| ||as885-tm165|| 0.6 || 0.41 || 0.43 || k=0.7, b=0.03 || None || |
Results for Exercise Sheet 2 (Ranking)
Add your row to the table below, following the examples already there. Please write down all values with exactly two digits of precision. In the first column, write your first name, or name1+name2 if you work in a group.
Name |
MP@3 |
MP@R |
MAP |
BM25 Parameters |
Refinements |
Baseline |
0.53 |
0.41 |
0.40 |
k=1.75, b=0.1 |
None (baseline) |
fe66 |
0.23 |
0.23 |
0.26 |
k=2.00, b=0.1 |
Position in the list taken into account |
ts341 |
0.50 |
0.33 |
0.34 |
k=1.20, b=0.5 |
Ignoring stop words. |
km151 |
0.67 |
0.46 |
0.43 |
k=0.05 b=0.0001 |
Position in the list taken into account |
lm310 |
0.47 |
0.31 |
0.30 |
k=2 b=0.5 |
No additional modification |
ff115 |
0.57 |
0.42 |
0.41 |
k=1.25 b=0.25 |
BM25 is boosted by factor 1.5 if both words are in same record at each merge |
jk544 |
0.53 |
0.41 |
0.42 |
k=1.5, b=0.2 |
no additional modification |
tg75 |
0.40 |
0.29 |
0.26 |
k=5.0, b=0.4 |
None |
ms801 |
0.60 |
0.39 |
0.38 |
k=2.25, b=0.5 |
BM25 is boosted by factor 1.42 if both words are in same record at each merge |
dk295 |
0.53 |
0.42 |
0.38 |
k=1.75, b=0.0 |
None |
re55 |
0.53 |
0.38 |
0.34 |
k=2.0, b=0.3 |
None |
hm101 |
0.47 |
0.21 |
0.20 |
k=2.0, b=1 |
None |
mf233 |
0.50 |
0.37 |
0.40 |
k=1.23, b=0.42 |
None |
dt36 |
0.53 |
0.41 |
0.41 |
k=1.75, b=0.1 |
None |
an145-jc142 |
0.53 |
0.41 |
0.43 |
k=1.5, b=0.01 |
None |
ab766 |
0.53 |
0.40 |
0.23 |
k=1.75, b=0.25 |
None |
gs121 |
0.50 |
0.28 |
0.32 |
k=1, b=0.5 |
None |
aw281 |
0.37 |
0.29 |
0.26 |
k=1.75, b=0.65 |
None |
co41+jr76 |
0.60 |
0.17 |
0.41 |
k=0.8, b=0.01 |
Position in the list taken into account + BM25 is boosted if both words are in same record at each merge |
cl145 |
0.36 |
0.24 |
0.23 |
k=1.75, b=0.10 |
None |
or17 |
0.53 |
0.41 |
0.40 |
k=1.60, b=0.10 |
None |
pb138 |
0.53 |
0.41 |
0.41 |
k=1.61, b=0.1 |
None |
am501 |
0.43 |
0.16 |
0.14 |
k=1.75, b=0.1 |
None |
ss515 |
0.50 |
0.36 |
0.37 |
k=1, b=0.5 |
None |
ak346 |
0.13 |
0.15 |
0.14 |
k=1.75, b=0.1 |
None |
dw118 |
0.53 |
0.40 |
0.40 |
k=1.75, b=0.05 |
None |
eb162 |
0.53 |
0.21 |
0.20 |
k=1.75, b=0.1 |
None |
Christina |
0.43 |
0.35 |
0.44 |
k=0.0025, b=0.0001 |
popularity + boosting exact matches + no stop words |
jw355 |
0.16 |
0.24 |
0.15 |
k=1.75, b=0.1 |
None |
jl387 |
0.46 |
0.41 |
0.10 |
k=1.75, b=0.1 |
None |
as962-sp244 |
0.60 |
0.42 |
0.39 |
k= 0.85, b=0.0005 |
None |
ep90+je177 |
0.60 |
0.47 |
0.48 |
k=0.5, b=0.45 |
Position of the words in the documents is taken into account |
sh477 |
0.53 |
0.39 |
0.37 |
k=1.5, b=0.3 |
None |
la109+os90 |
0.63 |
0.44 |
0.35 |
k=0.85, b=0.05 |
Ignoring words with length<3 |
yr13 |
0.53 |
0.41 |
0.39 |
k=1.75, b=0.1 |
None |
cz4 |
0.48 |
0.43 |
0.44 |
k=1.5, b=0.25 |
None |
as747+pw120 |
0.26 |
0.23 |
0.22 |
k=1.75, b=0.15 |
None |
jk59 |
0.53 |
0.39 |
0.38 |
k=2.5, b=0.1 |
None |
si52 |
0.5 |
0.5 |
0.107 |
k=1.7, b=0.5 |
None |
nz21 |
0.53 |
0.42 |
0.41 |
k=1.75, b=0.25 |
With popularity (N^(-0.1)) and scores boosted by factor 1.5 if both words are in same record at each merge |
nz21 |
0.60 |
0.43 |
0.43 |
k=1.75, b=0.25 |
Only with scores boosted by factor 1.5 if both words are in same record at each merge |
lm283 |
0.50 |
0.34 |
0.32 |
k=1.75, b=0.50 |
None |
cc98 |
0.53 |
0.41 |
0.40 |
k=1.75, b=0.1 |
None |
ma277 |
0.53 |
0.15 |
0.39 |
k=2.3, b=0.1 |
None |
pj23 |
0.53 |
0.41 |
0.30 |
k=1.9, b=0.2 |
None |
ss874 |
0.53 |
0.41 |
0.42 |
k=1.6, b=0.2 |
None |
kb285 |
0.57 |
0.43 |
0.43 |
k= 0.75, b = 0.01 |
position is taken into account |
st174 |
0.37 |
0.24 |
0.33 |
k=1, b=0.1 |
None |
hr55-pg74 |
0.0 |
0.0 |
0.156 |
k=0.5, b=0.1 |
None |
ia42 |
0.53 |
0.41 |
0.41 |
k=1.75, b=0.1 |
None |
dr189 |
0.53 |
0.41 |
0.41 |
k=1.5, b=0.1 |
None |
as885-tm165 |
0.6 |
0.41 |
0.43 |
k=0.7, b=0.03 |
None |