AD Teaching Wiki:

Results for Exercise Sheet 8 (Vector Space Model)

Click "Edit (Text)" in the upper bar of this page and add your row to the table below, following the examples already there.

In the first column, write your account name, or name1+name2 if you work in a group.
In the columns 2-4, write down the values of MP@3, MP@R and MAP returned by your process_query() method from ES2.
In the columns 5-7, write down the values of your best result returned by your process_query_vsm() method from ES8.
In the 8th column, give a concise description of the score type and the normalization you have used to achieve the best result in process_query_vsm().
Please write down all values with exactly two digits of precision.

Name

process_query() from ES2

process_query_vsm() from ES8

Used combination in process_query_vsm()

MP@3

MP@R

MAP

MP@3

MP@R

MAP

pb1042

0.67

0.67

0.68

0.67

0.67

0.68

BM25 (b=0.2, k=0.8) + no normalization

aw221

0.83

0.71

0.69

0.83

0.71

0.69

BM25 (b=0.0, k=0.5) + no normalization

ja223

0.78

0.54

0.54

0.78

0.54

0.54

BM25 (b=0.0, k=0.0) + no normalization

ak482

0.56

0.45

0.48

0.61

0.39

0.39

BM25 (b=0.75, k=1.75) + L2 normalization

sw540

0.83

0.71

0.69

0.83

0.71

0.69

BM25 (b=0.0, k=0.5) + no normalization

pr218

0.67

0.83

0.69

0.67

0.83

0.69

BM25 (b=0.75, k=1.75) + L2 normalization

ew98

0.78

0.71

0.70

0.78

0.71

0.70

BM25 (b=0.0, k=0.0) + no normalization

ek247

0.67

0.71

0.69

0.67

0.71

0.69

BM25 (b=0.1, k=0.85) + no normalization

am802+jb978

0.78

0.66

0.67

0.78

0.66

0.67

BM25 (b=0.1, k=0.1) + no normalization

jd289 + ls887

0.39

0.30

0.36

0.50

0.31

0.28

BM25 (b=0.75, k=1.75) + l2 normalization

jm408-ms946

0.78

0.71

0.69

0.78

0.71

0.69

BM25 (b=0, k=0) + no normalization

rt53

0.67

0.66

0.68

0.61

0.38

0.38

BM25 (b=1.18, k= 1.70) + L2 normalization

sr463

0.61

0.51

0.50

0.61

0.51

0.50

BM25 (b=0.75, k= 1.75) + no normalization

ll190

0.78

0.70

0.68

0.83

0.71

0.70

BM25 (b=0.05, k= 0.2) + L2 normalization on rows

rk268-ss1731

0.5

0.57

0.64

0.83

0.70

0.70

BM25 (b=0.02, k= 0.7) + no normalization

ak904

0.61

0.39

0.38

0.61

0.39

0.38

BM25 (b=0.69, k=1.54) + L2 normalization

aa382

0.75

0.70

0.68

0.75

0.70

0.68

BM25 (b=0.75, k=1.75) + L2 normalization

bw63

0.77

0.70

0.70

0.77

0.70

0.70

BM25 (b=o, k=0), no normalisazion

in35+rr186

0.78

0.70

0.68

0.78

0.70

0.68

BM25 (b=0, k=0.01), no normalization

hd103+sa285

0.78

0.70

0.69

0.78

0.72

0.71

BM25 (b=0.1, k=0.5), L2 normalization on rows

tb305

0.78

0.71

0.69

0.78

0.71

0.69

BM25 (b=0, k=0) no normalization

ha86+kb368

0.56

0.45

0.48

0.5

0.46

0.48

BM25(b = 0.75, k=1.75) l2 row normalization

oa49

0.77

0.70

0.69

0.5

0.19

0.19

BM25 (b=0, k=0) no normalization

ar479+ss1736

0.56

0.45

0.48

0.56

0.45

0.48

BM25 (b=0.75, k=1.75) no normalization

dl121

0.61

0.66

0.66

0.61

0.66

0.66

BM25 (b=0.3, k=1.1) no normalization

mn228

0.83

0.73

0.72

0.83

0.73

0.72

BM25 (b=0, k=1) no normalization


/!\ Edit conflict - other version:


nh228+as1586

0.71

0.70

0.68

0.75

0.70

0.71

(b=0.75, k=1.75) + no normalization

mr427

0.78

0.71

0.77

0.83

0.72

0.72

BM25 (b=0.02, k= 0.1) + L1 normalization on rows


/!\ Edit conflict - other version:



/!\ Edit conflict - other version:


kk486

0.556

0.448

0.479

0.556

0.448

0.478

BM25 (b=0.75, k=1.75) L2 normalization


/!\ Edit conflict - your version:


kk486

0.556

0.448

0.479

0.556

0.448

0.478

BM25 (b=0.75, k=1.75) L2 normalization


/!\ End of edit conflict



/!\ Edit conflict - your version:


kk486

0.556

0.448

0.479

0.556

0.448

0.478

BM25 (b=0.75, k=1.75) no normalization

de90

0.778

0.597

0.621

0.778

0.597

0.621

BM25 (b=0, k=0.5) no normalization


/!\ End of edit conflict



/!\ Edit conflict - your version:


mr427

0.78

0.71

0.77

0.83

0.72

0.72

BM25 (b=0.02, k= 0.1) + L1 normalization on rows

kk486

0.556

0.448

0.479

0.556

0.448

0.478

BM25 (b=0.75, k=1.75) no normalization

kk486

0.556

0.448

0.479

0.556

0.448

0.478

BM25 (b=0.75, k=1.75) no normalization

de90

0.778

0.597

0.621

0.778

0.597

0.621

BM25 (b=0, k=0.5) no normalization


/!\ End of edit conflict


mk1361

0.778

0.712

0.692

0.778

0.712

0.693

BM25 (b=0, k=1.2) no normalization

mi81-mk1357

0.83

0.77

0.75

0.83

0.77

0.75

BM25 (b=0, k=0) no normalization

sb655

0.67

0.71

0.69

0.67

0.71

0.69

BM25 (b=0.1, k=0.8) no normalization

al453

0.88

0.52

0.49

0.83

0.71

0.71

BM25 (b=0.06, k= 0.8) + No normalization

jo120-tb350

0.83

0.63

0.61

0.89

0.65

0.61

BM25 (b=0, k=1.3) no normalization

lg188+ts331

0.833

0.708

0.696

0.8

0.69

0.673

BM25 (b=0.05, k=0.69) no normalization

AD Teaching Wiki: InformationRetrievalWS1920/ResultsES8 (last edited 2019-12-17 14:47:03 by fp-10-126-129-26)