AD Teaching Wiki:

Results for Exercise Sheet 8 (Vector Space Model)

Click "Edit (Text)" in the upper bar of this page and add your row to the table below, following the examples already there.

In the first column, write your account name, or name1+name2 if you work in a group.
In the columns 2-4, write down the values of MP@3, MP@R and MAP returned by your process_query() method from ES2.
In the columns 5-7, write down the values of your best result returned by your process_query_vsm() method from ES8.
In the 8th column, give a concise description of the score type and the normalization you have used to achieve the best result in process_query_vsm().
Please write down all values with exactly two digits of precision.

Name

process_query() from ES2

process_query_vsm() from ES8

Used combination in process_query_vsm()

MP@3

MP@R

MAP

MP@3

MP@R

MAP

pb1042

0.67

0.67

0.68

0.67

0.67

0.68

BM25 (b=0.2, k=0.8) + no normalization

ad414

0.78

0.71

0.69

0.83

0.71

0.7

BM25 (b=0, k=0.2) + l2 normalization (row)

ae185

0.78

0.70

0.68

0.83

0.70

0.69

BM25 (b=0, k=0.1) + l2 normalization (row)

mk1243

0.78

0.70

0.69

0.83

0.72

0.71

BM25 (b=0.1, k=0.2) + l1 normalization (row)

ls943

0.78

0.73

0.72

0.89

0.74

0.72

BM25 (b=0, k=0.5) + no normalization

tk334

0.77

0.53

0.57

0.83

0.71

0.69

BM25 (b=0, k=0.6) + no normalization

ul18

0.78

0.7

0.68

0.83

0.72

0.7

BM25 (b=0, k=0.4) + l2 normalization (row)

sp352

0.78

0.70

0.69

0.83

0.71

0.70

BM25 (b=0.1, k=0.2) + l2 normalization (row)

pf81

0.7

0.66

0.68

0.83

0.72

0.7

BM25 (b=0, k=0.4) + l2 normalization (row)

cg278

0.83

0.71

0.69

0.83

0.71

0.69

BM25 (b=0, k=0.7) + no normalization

ba102

0.83

0.68

0.69

0.89

0.68

0.70

BM25 (b=0.1, k=0.1) + L2 (row) normalization

ss1857

0.78

0.70

0.68

0.80

0.72

0.72

BM25 (b=0, k=0.8) + L2 normalization

ps541

0.56

0.48

0.49

0.61

0.52

0.49

BM25 (b=0, k=0.2) norm=l2, axis=row(term)

mr716

0.67

0.67

0.68

0.67

0.67

0.68

BM25 (b=0.2, k=0.8) + no normalization

rw159

0.83

0.71

0.69

0.83

0.72

0.71

BM25 (b=0, k=0.1) norm=L1(row)

hg132

0.67

0.67

0.68

0.67

0.67

0.68

BM25 (b=0.2, k=0.8) + no normalization

ma441

0.78

0.60

0.65

0.83

0.71

0.69

BM25 (b=0.0, k=0.7) + no normalization

as1586

0.78

0.70

0.69

500

0.188

0.192

BM25 (b=0, k=0) + L2

hk250

0.78

0.69

0.68

0.83

0.71

0.70

BM25 (b=0.0, k=0.2) + L2 (rows)

ek198

0.83

0.71

0.69

0.78

0.72

0.70

BM25 (b=0.0, k=0.7) + L2-norm (rows)

tz73

0.56

0.48

0.52

0.61

0.69

0.67

tf, l2 row

nn94

0.56

0.48

0.52

0.61

0.69

0.67

tf, l2 row

AD Teaching Wiki: InformationRetrievalWS2122/ResultsES8 (last edited 2022-01-16 23:29:56 by Hannah Bast)