Differences between revisions 2 and 91 (spanning 89 versions)

Welcome to the Wiki of the course "Information Retrieval" in the winter term 2019/2020

The course is given by Prof. Dr. Hannah Bast and assisted by Patrick Brosi. It takes place every Tuesday from 14:15 - 15:45 h in SR 101-00-010/14. The first lecture is on Tuesday 22.10.2019 and the last lecture is on Tuesday 04.02.2020. There will be no lectures on the Tuesdays 24.12.2019 and 31.12.2019 (christmas break) and on Tuesday 11.02.2019 (we finish a week early). This is 14 lectures altogether.

The tutors for this course are Daniel Bindemann, Claudius Korzen, Julian Tischner and Andreas Woitzik. The administrator of the supporting systems (Daphne, SVN, Forum, Jenkins) is Axel Lehmann.

Important Links

Our course management system Daphne (login with your RZ user name and password).
The forum for announcements and questions.
The manual for how to ask questions on the forum.
Our CodingStandards for C++, Java and Python 3.
Code style formatter profiles for Eclipse: Java, C++.
Information about Subversion (SVN) can be found here (in german) and here (in english); about some editors (including Vim) here (in german); and about the installation of gtest (for C++ only) here (in english).
The courses from previous semesters: Information Retrieval WS 18/19, Information Retrieval WS 17/18, Information Retrieval WS 16/17, Information Retrieval WS 15/16, Information Retrieval WS 13/14, Information Retrieval WS 12/13.
The exams from previous semesters: WS 18/19, WS 17/18, WS 16/17, WS 15/16, WS 13/14, WS 12/13.
Here you can download our Linux Image (for Virtualbox or VMWare).
A cheat sheet for NumPy and SciPy can be found here.

Lecture Slides, Video Recordings, Exercise Sheets, and Code

Lecture 01, Tuesday, October 22, 2019 (Introduction, Inverted Index, Zipf's Law): Video Recording (MP4 Download), Slides, Exercise Sheet 1, Code from the lecture + unit tests for Exercise Sheet 1, Dataset for ES1 (189,897 movies with title + description), Solution.
Lecture 2, Tuesday, October 29, 2019 (Ranking and Evaluation): Video Recording (MP4 Download), Slides, Exercise Sheet 2, Code from the lecture + unit tests for Exercise Sheet 2, NEW Movies Dataset (107,769 movies with title + longer description, Movies Training Benchmark, Movies Testing Benchmark, Table for your ranking results, Solution.
Lecture 3, Tuesday, November 5th, 2019 (Efficient List Intersection, Lagrange Multipliers): Video Recording (MP4 Download), Slides, Exercise Sheet 3, Solution.
Lecture 4, Tuesday, November 12th, 2019 (Compression, Codes, Entropy): Video Recording (MP4 Download), Slides, Exercise Sheet 4, Solution.
Lecture 5, Tuesday, November 19th, 2019 (Fuzzy Search, Edit Distance, q-Gram Index): Video Recording (MP4 Download), Slides, Exercise Sheet 5, Code from the lecture + unit tests for Exercise Sheet 5, Wikidata Entities (2,920,180 entities, name + popularity + description + additional information), Wikidata Entities SMALL (100,000 entities), Table for your results, Solution.
Lecture 6, Tuesday, November 26th, 2019 (Web applications, Part 1): Video Recording (MP4 Download), Slides, Exercise Sheet 6, Code skeleton + test queries for Exercise Sheet 6, Wikidata Entities (same as for ES 5), Solution.
Lecture 7, Tuesday, December 3rd, 2019 (Web applications, Part 2): Video Recording (MP4 Download), Slides, Exercise Sheet 7, Code skeleton + test queries for Exercise Sheet 7, Wikidata Entities (same as for ES 5 + 6), Solution.
Lecture 8, Tuesday, December 12th, 2019 (Vector Space Model): Video Recording (edited version from WS 17/18) (MP4 Download), Slides, Code from the lecture, Code skeleton for ES 8, Exercise Sheet 8, Movies Dataset (same one as for ES2), Movies testing benchmark (same one as for ES2), Table for your ranking results, Solution.
Lecture 9, Tuesday, December 17th, 2019 (Latent Semantic Indexing): Video Recording (MP4 Download), Slides, Code from the lecture, Exercise Sheet 9, Solution.
Lecture 10, Tuesday, January 7th, 2020 (Classification, Naive Bayes): Video Recording (MP4 Download), Slides, Code Template for ES 10, Table for your F-measures, Datasets for ES10: Film Genres (train, Variant 1), Film Genres (test, Variant 1), Film Genres (train, Variant 2), Film Genres (test, Variant 2), Film Ratings (train, Variant 1), Film Ratings (test, Variant 1), Film Ratings (train, Variant 2), Film Ratings (test, Variant 2) Exercise Sheet 10, Solution.
Lecture 11, Tuesday, January 14th, 2020 (Linear Classifiers, Perceptrons, Logistic Regression): Video Recording (MP4 Download), Slides, Code Template for ES 11, Table for your results, Datasets for ES11 (same as for ES 10): Film Genres (train, Variant 1), Film Genres (test, Variant 1), Film Genres (train, Variant 2), Film Genres (test, Variant 2), Film Ratings (train, Variant 1), Film Ratings (test, Variant 1), Film Ratings (train, Variant 2), Film Ratings (test, Variant 2) Exercise Sheet 11
Lecture 12, Tuesday, January 21, 2020 (Knowledge Bases, SPARQL, Translation to SQL): Livestream, Slides, Exercise Sheet 12, Code Template for ES12, Datasets for ES12: wikidata.zip (31M triples from Wikidata), wikidata.5M.zip (Subset of wikidata.tsv with only 5M triples), Table for your results.

-  ⇤ ← Revision 2 as of 2019-09-06 11:46:55 → 
  Size: 2814
  Editor: Patrick Brosi
  Comment:
+   ← Revision 91 as of 2020-01-21 12:43:27 → ⇥
  Size: 16711
  Editor: Patrick Brosi
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 5:
+{{{
#!html
<!--
<p style="color:darkred"><b>No live lecture on December 10, 2019 because Prof. Bast is sick. </b>Instead, there will be an edited version from the recording from WS 17/18, see below. There will be an exercise sheet as usual, albeit simpler than usual. See you again in person next week.</p>
--->
}}}


{{{
#!html
<!--
<p style="color:darkred"><b>Before</b> you start working on the exercise sheets, please <b>carefully and completely</b> read <a href="InformationRetrievalWS1920/Rules" style="color: darkred; text-decoration: underline;">these rules</a>. They are valid for all exercise sheets of this course.</p>
-->
}}}
-Line 6:
+Line 21:
+It takes place every Tuesday from 14:15 - 15:45 h in SR 101-00-010/14. The first lecture is on Tuesday 22.10.2019 and the last lecture is on Tuesday 04.02.2020. There will be no lectures on the Tuesdays 24.12.2019 and 31.12.2019 (christmas break) and on Tuesday 11.02.2019 (we finish a week early). This is 14 lectures altogether.
-Line 7:
+Line 23:
-The tutors for this course are Daniel Bindemann, [[https://ad.informatik.uni-freiburg.de/staff/korzen|Claudius Korzen]], Julian Tischer, [...].
+The tutors for this course are Daniel Bindemann, [[https://ad.informatik.uni-freiburg.de/staff/korzen|Claudius Korzen]], Julian Tischner and Andreas Woitzik.
-Line 13:
+Line 29:
- * The [[https://daphne.informatik.uni-freiburg.de/forum/|forum]] for announcements and questions.
+ * The [[https://daphne.informatik.uni-freiburg.de/forum/viewforum.php?f=957|forum]] for announcements and questions.
-Line 20:
+Line 36:
- * Here you can download our [[InformationRetrievalWS1819/LinuxImage|Linux Image]] (for Virtualbox or VMWare).
+ * Here you can download our [[InformationRetrievalWS1920/LinuxImage|Linux Image]] (for Virtualbox or VMWare).
-Line 31:
+Line 47:
+ * Lecture 01, Tuesday, October 22, 2019 (Introduction, Inverted Index, Zipf's Law): [[https://www.youtube.com/watch?v=BoUzLoHuVCI|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-01.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-01.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-01.pdf|Exercise Sheet 1]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-01/|Code from the lecture + unit tests for Exercise Sheet 1]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/movies.txt|Dataset for ES1 (189,897 movies with title + description)]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-01/|Solution]].
 * Lecture 2, Tuesday, October 29, 2019 (Ranking and Evaluation): [[https://www.youtube.com/watch?v=ZNeIqKv09YM|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-02.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-02/|Code from the lecture + unit tests for Exercise Sheet 2]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies2.txt|NEW Movies Dataset (107,769 movies with title + longer description]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies.training-benchmark.tsv|Movies Training Benchmark]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies.test-benchmark.tsv|Movies Testing Benchmark]], [[InformationRetrievalWS1920/ResultsES2|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-02/|Solution]].
 * Lecture 3, Tuesday, November 5th, 2019 (Efficient List Intersection, Lagrange Multipliers): [[https://www.youtube.com/watch?v=qh-7q6QhHPA|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-03.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-03/sheet-03.pdf|Solution]].
 * Lecture 4, Tuesday, November 12th, 2019 (Compression, Codes, Entropy): [[https://www.youtube.com/watch?v=ZHVq7iCCA6I|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-04.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-04.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-04.pdf|Exercise Sheet 4]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-04/sheet-04.pdf|Solution]].
 * Lecture 5, Tuesday, November 19th, 2019 (Fuzzy Search, Edit Distance, q-Gram Index): [[https://www.youtube.com/watch?v=NaX4aCWYuLc|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-05.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-05.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-05.pdf|Exercise Sheet 5]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-05/|Code from the lecture + unit tests for Exercise Sheet 5]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.tsv|Wikidata Entities (2,920,180 entities, name + popularity + description + additional information)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.100k.tsv|Wikidata Entities SMALL (100,000 entities)]], [[InformationRetrievalWS1920/ResultsES5|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-05/|Solution]].
 * Lecture 6, Tuesday, November 26th, 2019 (Web applications, Part 1): [[https://www.youtube.com/watch?v=FLLNgBoWX7w|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-06.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-06.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-06.pdf|Exercise Sheet 6]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-06/|Code skeleton + test queries for Exercise Sheet 6]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.tsv|Wikidata Entities (same as for ES 5)]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-06/|Solution]].
 * Lecture 7, Tuesday, December 3rd, 2019 (Web applications, Part 2): [[https://www.youtube.com/watch?v=FA18UYgMFbQ|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-07.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-07.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-07.pdf|Exercise Sheet 7]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-07/|Code skeleton + test queries for Exercise Sheet 7]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.tsv|Wikidata Entities (same as for ES 5 + 6)]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-07/|Solution]].
 * Lecture 8, Tuesday, December 12th, 2019 (Vector Space Model): [[https://www.youtube.com/watch?v=kFKR3CSFVCs|Video Recording (edited version from WS 17/18)]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-08.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-08.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-08/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-08/skeleton/|Code skeleton for ES 8]],
 [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-08.pdf|Exercise Sheet 8]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies2.txt|Movies Dataset (same one as for ES2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies.test-benchmark.tsv|Movies testing benchmark (same one as for ES2)]], [[InformationRetrievalWS1920/ResultsES8|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-08/|Solution]].
 * Lecture 9, Tuesday, December 17th, 2019 (Latent Semantic Indexing): [[https://www.youtube.com/watch?v=ulEkva9JrTg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-09.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-09.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-09/|Code from the lecture]],
 [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-09.pdf|Exercise Sheet 9]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-09/sheet-09.pdf|Solution]].
 * Lecture 10, Tuesday, January 7th, 2020 (Classification, Naive Bayes): [[https://www.youtube.com/watch?v=ga5f-ot7v5U|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-10.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-10.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-10/|Code Template for ES 10]], [[InformationRetrievalWS1920/ResultsES10|Table for your F-measures]], Datasets for ES10: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]]
 [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-10.pdf|Exercise Sheet 10]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/solutions/sheet-10/|Solution]].
 * Lecture 11, Tuesday, January 14th, 2020 (Linear Classifiers, Perceptrons, Logistic Regression): [[https://www.youtube.com/watch?v=_X2LS0ZVBz4|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-11.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-11/|Code Template for ES 11]], [[InformationRetrievalWS1920/ResultsES11|Table for your results]], Datasets for ES11 (same as for ES 10): [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]]
 [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]]
 * Lecture 12, Tuesday, January 21, 2020 (Knowledge Bases, SPARQL, Translation to SQL): [[https://youtu.be/9hxcY-rP8Yo|Livestream]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-12.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-12.pdf|Exercise Sheet 12]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-12/|Code Template for ES12]], Datasets for ES12: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata.zip|wikidata.zip (31M triples from Wikidata)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata.5M.zip|wikidata.5M.zip (Subset of wikidata.tsv with only 5M triples)]], [[InformationRetrievalWS1920/ResultsES12|Table for your results]].