Differences between revisions 56 and 135 (spanning 79 versions)

Welcome to the Wiki of the course "Information Retrieval" in the winter term 2017/2018

The course is given by Prof. Dr. Hannah Bast and assisted by Claudius Korzen. It takes place every Tuesday from 2:15pm until 3:45pm in seminar room 00-010/14 in building 101. The first lecture is on Tuesday, 17 October 2017 and the last lecture is on Tuesday, 6 February 2018. There will be no lecture on Tuesday, 31 October 2017 (Reformationstag), and on Tuesday, 26 December 2017 and on Tuesday, 2 January 2018 (christmas break). This is 14 lectures altogether.

The tutors for this course are Patrick Brosi, Johannes Kalmbach, Natalie Prange, Simon Selg, Danny Stoll and Daniel Tischner. The administrator of the supporting systems (Daphne, SVN, Forum, Jenkins) is Axel Lehmann.

Important Links

Our course management system Daphne (login with your RZ user name and password).
The Forum for announcements and questions (you are automatically a member when you have logged into Daphne).
Our CodingStandards for C++, Java and Python3.
Code style formatter profiles for Eclipse: Java, C++.
Our Points scheme for the exercises.
Information about Subversion (SVN) can be found here (in german) and here (in english); about some editors (including Vim) here (in german); and about the installation of gtest (for C++ only) here (in english).
The topics of this course will be similar (but not identical) to those of the courses Information Retrieval WS 12/13, Information Retrieval WS 13/14, Information Retrieval WS 15/16 and Information Retrieval WS 16/17.
The exams from the previous years: WS 12/13, WS 13/14, WS 15/16, WS 16/17.
Here you can download our Linux Image (for Virtualbox or VMWare).
Livestream of the lectures (available shortly before each lecture).
A cheat sheet for NumPy and SciPy can be found here.

Lecture Slides, Video Recordings, Exercise Sheets, and Code

Lecture 1, Tuesday, October 17, 2017 (Introduction, Inverted Index, Zipf's Law): YouTube (Download, Recording Livestream), Slides, Code from the lecture (+ equivalent code in Java and C++), Exercise Sheet 1, TIP file, Dataset for ES1 (189,897 movies, title + description), Solution.
Lecture 2, Tuesday, October 24, 2017 (Ranking and Evaluation): YouTube (Download, Recording Livestream), Slides, Exercise Sheet 2, TIP file, Movies Dataset (same one as for ES1), Movies Benchmark, Table for your ranking results, Solution.
Lecture 3, Tuesday, November 7, 2017 (Efficient List Intersection): YouTube (Download), Slides, Exercise Sheet 3, Postings Lists (Update: 8 November, 10:30pm), basic code to get you started in Java and C++, Table for your intersection results, Solution.
Lecture 4, Tuesday, November 14, 2017 (Compression, Codes, Entropy): YouTube (Download, Recording Livestream), Slides, Exercise Sheet 4, Solution.
Lecture 5, Tuesday, November 21, 2017 (Fuzzy Search, Edit Distance, q-Gram Index): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 5, Wikidata Entities (2,920,180 entities, name + popularity + description + additional information), TIP file, code from the lecture in Java and the analogous code in C++, Table for your results, Solution.
Lecture 6, Tuesday, November 28, 2017 (Web applications, part 1): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 6, Wikidata Entities (same as for ES5, with image urls), TIP file, (part of) the code from the lecture in Java and the analogous code in C++, Solution.
Lecture 7, Tuesday, December 5, 2017 (Web applications, part 2: Javascript, Vulnerabilities, Cookies, Unicode): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 7, Wikidata Entities (with surprises), TIP file, Solution.
Lecture 8, Tuesday, December 12, 2017 (Vector space model): Video Recording (Download, Recording Livestream), Slides, Code from the lecture, Exercise Sheet 8, TIP file, Movies Dataset (same one as for ES2), Movies Benchmark (same one as for ES2), Table for your ranking results, Solution.
Lecture 9, Tuesday, December 19, 2017 (Clustering, k-means): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 9, Solution.
Lecture 10, Tuesday, January 9, 2018 (Latent Semantic Indexing): Video Recording (Download, Recording Livestream), Slides, Code from the lecture, Exercise Sheet 10, Solution.
Lecture 11, Tuesday, January 16, 2018 (Classification, Naive Bayes): Slides, Exercise Sheet 11, Code for ES 11, Table for your F1-scores, Datasets for ES11: Film Genres (train, Variant 1), Film Genres (test, Variant 1), Film Genres (train, Variant 2), Film Genres (test, Variant 2), Film Ratings (train, Variant 1), Film Ratings (test, Variant 1), Film Ratings (train, Variant 2), Film Ratings (test, Variant 2).

-  ⇤ ← Revision 56 as of 2017-11-07 11:28:24 → 
  Size: 6452
  Editor: Claudius Korzen
  Comment:
+   ← Revision 135 as of 2018-01-16 14:57:00 → ⇥
  Size: 16499
  Editor: adpult
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 1:
-#acl Patrick Brosi:read,write Björn Buchhold:read,write Claudius Korzen:read,write Axel Lehmann:read,write All:read
+#acl Patrick Brosi:read,write Claudius Korzen:read,write All:read
 Line 5:
-{{{
#!html 
<span style="color:red; font-weight: bold">Lecture today (Tuesday, November 7) is ONLINE only, see the <a href="https://daphne.informatik.uni-freiburg.de/forum/viewtopic.php?f=742&t=4157">announcement in the forum</a>.</span>
}}}
-Line 29:
+Line 23:
+ * A cheat sheet for !NumPy and !SciPy can be found [[NumpyCheatSheet|here]].
-Line 33:
+Line 28:
- * Lecture 2, Tuesday, October 24, 2017 (Ranking and Evaluation): [[https://www.youtube.com/watch?v=bCVPnnWqY8s|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-02/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Movies Dataset (same one as for ES1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies-benchmark.txt|Movies Benchmark]], [[InformationRetrievalWS1718/ResultsES2|Table for your ranking results]].
+ * Lecture 2, Tuesday, October 24, 2017 (Ranking and Evaluation): [[https://www.youtube.com/watch?v=bCVPnnWqY8s|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-02/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Movies Dataset (same one as for ES1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies-benchmark.txt|Movies Benchmark]], [[InformationRetrievalWS1718/ResultsES2|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-02/|Solution]].
 * Lecture 3, Tuesday, November 7, 2017 (Efficient List Intersection): [[https://www.youtube.com/watch?v=hFYbmLa3usg|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-03.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/postinglists/|Postings Lists]] (Update: 8 November, 10:30pm), basic code to get you started in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/java/|Java]] and [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/cpp/|C++]], [[InformationRetrievalWS1718/ResultsES3|Table for your intersection results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-03/|Solution]].
 * Lecture 4, Tuesday, November 14, 2017 (Compression, Codes, Entropy): [[https://www.youtube.com/watch?v=A_F94FV21Ek|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-04.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-04.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-04.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-04.pdf|Exercise Sheet 4]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-04/sheet-04.pdf|Solution]].
 * Lecture 5, Tuesday, November 21, 2017 (Fuzzy Search, Edit Distance, q-Gram Index): [[https://www.youtube.com/watch?v=I39Rhegg8Xg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-05.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-05.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-05.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-05.pdf|Exercise Sheet 5]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities.tsv|Wikidata Entities (2,920,180 entities, name + popularity + description + additional information)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/TIP/|TIP file]], code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/cpp/|C++]], [[InformationRetrievalWS1718/ResultsES5|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-05/|Solution]].
 * Lecture 6, Tuesday, November 28, 2017 (Web applications, part 1): [[https://www.youtube.com/watch?v=2x4YFzrlV8I|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-06.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-06.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-06.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-06.pdf|Exercise Sheet 6]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities-with-image-urls.tsv|Wikidata Entities (same as for ES5, with image urls)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/TIP/|TIP file]], (part of) the code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/cpp/|C++]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-06/|Solution]].
 * Lecture 7, Tuesday, December 5, 2017 (Web applications, part 2: Javascript, Vulnerabilities, Cookies, Unicode): [[https://www.youtube.com/watch?v=aycjGY6v6pg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-07.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-07.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-07.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-07.pdf|Exercise Sheet 7]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities-with-surprises.tsv|Wikidata Entities (with surprises)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-07/TIP/sheet-07.TIP|TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-07/|Solution]].
 * Lecture 8, Tuesday, December 12, 2017 (Vector space model): [[https://youtu.be/WShDiIId8Bg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-08.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-08.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-08.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-08/lecture/|Code from the lecture]],
 [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-08.pdf|Exercise Sheet 8]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-08/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Movies Dataset (same one as for ES2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies-benchmark.txt|Movies Benchmark (same one as for ES2)]], [[InformationRetrievalWS1718/ResultsES8|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-08/|Solution]].
 * Lecture 9, Tuesday, December 19, 2017 (Clustering, k-means): [[https://www.youtube.com/watch?v=yid_lqC0SDo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-09.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-09.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-09.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-09.pdf|Exercise Sheet 9]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-09/sheet-09.pdf|Solution]].
 * Lecture 10, Tuesday, January 9, 2018 (Latent Semantic Indexing): [[https://www.youtube.com/watch?v=CwBn0voJDaw|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-10.mp4|Download]],
 [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-10.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-10.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-10/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-10.pdf|Exercise Sheet 10]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-10/sheet-10.pdf|Solution]].
 * Lecture 11, Tuesday, January 16, 2018 (Classification, Naive Bayes): [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-11/|Code for ES 11]], [[InformationRetrievalWS1718/ResultsES11|Table for your F1-scores]], Datasets for ES11: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]].
-Line 38:
+Line 46:
- * Lecture 3, Tuesday, November 7, 2017 (Efficient List Intersection): [[https://www.youtube.com/watch?v=bCVPnnWqY8s|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-03.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/postinglists/|Postings Lists]], basic code to get you started in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/java/|Java]] and [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/cpp/|C++]], [[InformationRetrievalWS1718/ResultsES3|Table for your intersection results]].
+ * Lecture 11, Tuesday, January 16, 2018 (Classification, Naive Bayes): [[https://youtube.com/embed/M4stb0NzDLY|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1617/lecture-11.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-11/|Code for ES 11]], Datasets for ES11: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movie_genres_train.txt|movie genres (train)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movie_genres_test.txt|movie genres (test)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movie_ratings_train.txt|movie ratings (train)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movie_ratings_test.txt|movie ratings (test)]], [[InformationRetrievalWS1718/ResultsES11|Table for your average F1-scores]].