|
Size: 1424
Comment:
|
Size: 3861
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 6: | Line 6: |
| ||'''Name''' ||'''P@3''' ||'''P@R'''||'''MAP'''||'''BM25 Parameters'''||'''Refinements'''|| | ||'''Name''' ||'''MP@3''' ||'''MP@R'''||'''MAP'''||'''BM25 Parameters'''||'''Refinements'''|| |
| Line 12: | Line 12: |
| ||ff115 || 0.57 ||0.42 ||0.33 ||k=1.25 b=0.25 || BM25 is boosted by factor 1.5 if both words are in same record at each merge || | ||ff115 || 0.57 ||0.42 ||0.41 ||k=1.25 b=0.25 || BM25 is boosted by factor 1.5 if both words are in same record at each merge || |
| Line 18: | Line 18: |
| ||hm101 || 0.47 || 0.21 || 0.2 ||k=2.0, b=1 ||None || ||mf233 || 0.50 || 0.37 || 0.40 || k=1.23, b=042 || None || |
||hm101 || 0.47 || 0.21 || 0.20 ||k=2.0, b=1 ||None || ||mf233 || 0.50 || 0.37 || 0.40 || k=1.23, b=0.42 || None || ||dt36 || 0.53 || 0.41 || 0.41 || k=1.75, b=0.1 || None || ||an145-jc142 || 0.53 || 0.41 || 0.43 || k=1.5, b=0.01 || None || ||ab766 || 0.53 || 0.40 || 0.23 || k=1.75, b=0.25 || None || ||gs121 || 0.50 || 0.28 || 0.32 || k=1, b=0.5 || None || ||aw281 || 0.37 || 0.29 || 0.26 || k=1.75, b=0.65 || None || ||co41+jr76 || 0.60 || 0.17 || 0.41 || k=0.8, b=0.01 || Position in the list taken into account + BM25 is boosted if both words are in same record at each merge || ||cl145 || 0.36 || 0.24 || 0.23 || k=1.75, b=0.10 || None || ||or17 || 0.53 || 0.41 || 0.40 || k=1.60, b=0.10 || None || ||pb138 || 0.53 || 0.41 || 0.41 || k=1.61, b=0.1 || None || ||am501 || 0.43 || 0.16 || 0.14 || k=1.75, b=0.1 || None || ||ss515 || 0.50 || 0.36 || 0.37 || k=1, b=0.5 || None || ||ak346 || 0.13 || 0.15 || 0.14 || k=1.75, b=0.1 || None || ||dw118 || 0.53 || 0.40 || 0.40 || k=1.75, b=0.05 || None || ||eb162 || 0.53 || 0.21 || 0.20 || k=1.75, b=0.1 || None || ||Christina || 0.43 || 0.35 || 0.44 || k=0.0025, b=0.0001 || popularity + boosting exact matches + no stop words || ||jw355|| 0.16 || 0.24 || 0.15 || k=1.75, b=0.1 || None || ||jl387 || 0.46 || 0.41 || 0.10 || k=1.75, b=0.1 || None || ||as962-sp244|| 0.60 || 0.42 || 0.39 || k= 0.85, b=0.0005 || None || || ep90+je177 || 0.60 || 0.47 || 0.48 || k=0.5, b=0.45 || Position of the words in the documents is taken into account || ||sh477 || 0.53 || 0.39 || 0.37 || k=1.5, b=0.3 || None || || la109+os90 || 0.63 || 0.44 || 0.35 || k=0.85, b=0.05 || Ignoring words with length<3 || ||yr13 || 0.53 || 0.41 || 0.39 || k=1.75, b=0.1 || None || ||cz4 || 0.48 || 0.43 || 0.44 || k=1.5, b=0.25 || None || ||as747+pw120 || 0.26 || 0.23|| 0.22 || k=1.75, b=0.15 || None|| ||jk59 || 0.53 || 0.39 || 0.38 || k=2.5, b=0.1 || None|| ||si52|| 0.5 || 0.5 || 0.107 || k=1.7, b=0.5 || None || || nz21 || 0.53 || 0.42 || 0.41 || k=1.75, b=0.25 || With popularity (N^(-0.1)) and scores boosted by factor 1.5 if both words are in same record at each merge || || nz21 || 0.60 || 0.43 || 0.43 || k=1.75, b=0.25 || Only with scores boosted by factor 1.5 if both words are in same record at each merge || ||lm283 ||0.50 ||0.34 ||0.32 ||k=1.75, b=0.50 ||None|| ||cc98 ||0.53 ||0.41 ||0.40 ||k=1.75, b=0.1 ||None|| ||ma277 ||0.67 ||0.26 ||0.45 ||k=2.3, b=0.1 ||None|| ||pj23 || 0.53 ||0.41 ||0.30 ||k=1.9, b=0.2 ||None|| ||ss874 || 0.53 || 0.41 || 0.42 || k=1.6, b=0.2 || None || |
Results for Exercise Sheet 2 (Ranking)
Add your row to the table below, following the examples already there. Please write down all values with exactly two digits of precision. In the first column, write your first name, or name1+name2 if you work in a group.
Name |
MP@3 |
MP@R |
MAP |
BM25 Parameters |
Refinements |
Baseline |
0.53 |
0.41 |
0.40 |
k=1.75, b=0.1 |
None (baseline) |
fe66 |
0.23 |
0.23 |
0.26 |
k=2.00, b=0.1 |
Position in the list taken into account |
ts341 |
0.50 |
0.33 |
0.34 |
k=1.20, b=0.5 |
Ignoring stop words. |
km151 |
0.67 |
0.46 |
0.43 |
k=0.05 b=0.0001 |
Position in the list taken into account |
lm310 |
0.47 |
0.31 |
0.30 |
k=2 b=0.5 |
No additional modification |
ff115 |
0.57 |
0.42 |
0.41 |
k=1.25 b=0.25 |
BM25 is boosted by factor 1.5 if both words are in same record at each merge |
jk544 |
0.53 |
0.41 |
0.42 |
k=1.5, b=0.2 |
no additional modification |
tg75 |
0.40 |
0.29 |
0.26 |
k=5.0, b=0.4 |
None |
ms801 |
0.60 |
0.39 |
0.38 |
k=2.25, b=0.5 |
BM25 is boosted by factor 1.42 if both words are in same record at each merge |
dk295 |
0.53 |
0.42 |
0.38 |
k=1.75, b=0.0 |
None |
re55 |
0.53 |
0.38 |
0.34 |
k=2.0, b=0.3 |
None |
hm101 |
0.47 |
0.21 |
0.20 |
k=2.0, b=1 |
None |
mf233 |
0.50 |
0.37 |
0.40 |
k=1.23, b=0.42 |
None |
dt36 |
0.53 |
0.41 |
0.41 |
k=1.75, b=0.1 |
None |
an145-jc142 |
0.53 |
0.41 |
0.43 |
k=1.5, b=0.01 |
None |
ab766 |
0.53 |
0.40 |
0.23 |
k=1.75, b=0.25 |
None |
gs121 |
0.50 |
0.28 |
0.32 |
k=1, b=0.5 |
None |
aw281 |
0.37 |
0.29 |
0.26 |
k=1.75, b=0.65 |
None |
co41+jr76 |
0.60 |
0.17 |
0.41 |
k=0.8, b=0.01 |
Position in the list taken into account + BM25 is boosted if both words are in same record at each merge |
cl145 |
0.36 |
0.24 |
0.23 |
k=1.75, b=0.10 |
None |
or17 |
0.53 |
0.41 |
0.40 |
k=1.60, b=0.10 |
None |
pb138 |
0.53 |
0.41 |
0.41 |
k=1.61, b=0.1 |
None |
am501 |
0.43 |
0.16 |
0.14 |
k=1.75, b=0.1 |
None |
ss515 |
0.50 |
0.36 |
0.37 |
k=1, b=0.5 |
None |
ak346 |
0.13 |
0.15 |
0.14 |
k=1.75, b=0.1 |
None |
dw118 |
0.53 |
0.40 |
0.40 |
k=1.75, b=0.05 |
None |
eb162 |
0.53 |
0.21 |
0.20 |
k=1.75, b=0.1 |
None |
Christina |
0.43 |
0.35 |
0.44 |
k=0.0025, b=0.0001 |
popularity + boosting exact matches + no stop words |
jw355 |
0.16 |
0.24 |
0.15 |
k=1.75, b=0.1 |
None |
jl387 |
0.46 |
0.41 |
0.10 |
k=1.75, b=0.1 |
None |
as962-sp244 |
0.60 |
0.42 |
0.39 |
k= 0.85, b=0.0005 |
None |
ep90+je177 |
0.60 |
0.47 |
0.48 |
k=0.5, b=0.45 |
Position of the words in the documents is taken into account |
sh477 |
0.53 |
0.39 |
0.37 |
k=1.5, b=0.3 |
None |
la109+os90 |
0.63 |
0.44 |
0.35 |
k=0.85, b=0.05 |
Ignoring words with length<3 |
yr13 |
0.53 |
0.41 |
0.39 |
k=1.75, b=0.1 |
None |
cz4 |
0.48 |
0.43 |
0.44 |
k=1.5, b=0.25 |
None |
as747+pw120 |
0.26 |
0.23 |
0.22 |
k=1.75, b=0.15 |
None |
jk59 |
0.53 |
0.39 |
0.38 |
k=2.5, b=0.1 |
None |
si52 |
0.5 |
0.5 |
0.107 |
k=1.7, b=0.5 |
None |
nz21 |
0.53 |
0.42 |
0.41 |
k=1.75, b=0.25 |
With popularity (N^(-0.1)) and scores boosted by factor 1.5 if both words are in same record at each merge |
nz21 |
0.60 |
0.43 |
0.43 |
k=1.75, b=0.25 |
Only with scores boosted by factor 1.5 if both words are in same record at each merge |
lm283 |
0.50 |
0.34 |
0.32 |
k=1.75, b=0.50 |
None |
cc98 |
0.53 |
0.41 |
0.40 |
k=1.75, b=0.1 |
None |
ma277 |
0.67 |
0.26 |
0.45 |
k=2.3, b=0.1 |
None |
pj23 |
0.53 |
0.41 |
0.30 |
k=1.9, b=0.2 |
None |
ss874 |
0.53 |
0.41 |
0.42 |
k=1.6, b=0.2 |
None |