Welcome to the Wiki of the course "Information Retrieval" in the winter term 2017/2018

Here are the results for the official evaluation of this course

The course is given by Prof. Dr. Hannah Bast and assisted by Claudius Korzen. It takes place every Tuesday from 2:15pm until 3:45pm in seminar room 00-010/14 in building 101. The first lecture is on Tuesday, 17 October 2017 and the last lecture is on Tuesday, 6 February 2018. There will be no lecture on Tuesday, 31 October 2017 (Reformationstag), and on Tuesday, 26 December 2017 and on Tuesday, 2 January 2018 (christmas break). This is 14 lectures altogether.

The tutors for this course are Patrick Brosi, Johannes Kalmbach, Natalie Prange, Simon Selg, Danny Stoll and Daniel Tischner. The administrator of the supporting systems (Daphne, SVN, Forum, Jenkins) is Axel Lehmann.

Important Links

• Our course management system Daphne (login with your RZ user name and password).

• The Forum for announcements and questions (you are automatically a member when you have logged into Daphne).

• Our CodingStandards for C++, Java and Python3.

• Code style formatter profiles for Eclipse: Java, C++.

• Our Points scheme for the exercises.

• Information about Subversion (SVN) can be found here (in german) and here (in english); about some editors (including Vim) here (in german); and about the installation of gtest (for C++ only) here (in english).

• The topics of this course will be similar (but not identical) to those of the courses Information Retrieval WS 12/13, Information Retrieval WS 13/14, Information Retrieval WS 15/16 and Information Retrieval WS 16/17.

• The exams from the previous years: WS 12/13, WS 13/14, WS 15/16, WS 16/17.

• Here you can download our Linux Image (for Virtualbox or VMWare).

• Livestream of the lectures (available shortly before each lecture).

• A cheat sheet for NumPy and SciPy can be found here.

Lecture Slides, Video Recordings, Exercise Sheets, and Code

• Lecture 1, Tuesday, October 17, 2017 (Introduction, Inverted Index, Zipf's Law): YouTube (Download, Recording Livestream), Slides, Code from the lecture (+ equivalent code in Java and C++), Exercise Sheet 1, TIP file, Dataset for ES1 (189,897 movies, title + description), Solution.

• Lecture 2, Tuesday, October 24, 2017 (Ranking and Evaluation): YouTube (Download, Recording Livestream), Slides, Exercise Sheet 2, TIP file, Movies Dataset (same one as for ES1), Movies Benchmark, Table for your ranking results, Solution.

• Lecture 3, Tuesday, November 7, 2017 (Efficient List Intersection): YouTube (Download), Slides, Exercise Sheet 3, Postings Lists (Update: 8 November, 10:30pm), basic code to get you started in Java and C++, Table for your intersection results, Solution.

• Lecture 4, Tuesday, November 14, 2017 (Compression, Codes, Entropy): YouTube (Download, Recording Livestream), Slides, Exercise Sheet 4, Solution.

• Lecture 5, Tuesday, November 21, 2017 (Fuzzy Search, Edit Distance, q-Gram Index): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 5, Wikidata Entities (2,920,180 entities, name + popularity + description + additional information), TIP file, code from the lecture in Java and the analogous code in C++, Table for your results, Solution.

• Lecture 6, Tuesday, November 28, 2017 (Web applications, part 1): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 6, Wikidata Entities (same as for ES5, with image urls), TIP file, (part of) the code from the lecture in Java and the analogous code in C++, Solution.

• Lecture 7, Tuesday, December 5, 2017 (Web applications, part 2: Javascript, Vulnerabilities, Cookies, Unicode): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 7, Wikidata Entities (with surprises), TIP file, Solution.

• Lecture 8, Tuesday, December 12, 2017 (Vector space model): Video Recording (Download, Recording Livestream), Slides, Code from the lecture, Exercise Sheet 8, TIP file, Movies Dataset (same one as for ES2), Movies Benchmark (same one as for ES2), Table for your ranking results, Solution.

• Lecture 9, Tuesday, December 19, 2017 (Clustering, k-means): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 9, Solution.

• Lecture 10, Tuesday, January 9, 2018 (Latent Semantic Indexing): Video Recording (Download, Recording Livestream), Slides, Code from the lecture, Exercise Sheet 10, Solution.

• Lecture 11, Tuesday, January 16, 2018 (Classification, Naive Bayes): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 11, Code for ES 11, Table for your F-measures, Datasets for ES11: Film Genres (train, Variant 1), Film Genres (test, Variant 1), Film Genres (train, Variant 2), Film Genres (test, Variant 2), Film Ratings (train, Variant 1), Film Ratings (test, Variant 1), Film Ratings (train, Variant 2), Film Ratings (test, Variant 2), Solution.

• Lecture 12, Tuesday, January 23, 2018 (Knowledge Bases, SPARQL, Translation to SQL): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 12, Example files from the lecture + TIP file, Code Template for ES12, Datasets for ES12: wikidata.tsv (48M triples from Wikidata), wikidata.5M.tsv (Subset of wikidata.tsv with only 5M triples), Table for your results, Solution.

• Lecture 13, Tuesday, January 30, 2018 (POS-Tagging, Entity Recognition, Viterbi Algorithm): Video Recording (Download, Recording Livestream), Slides, Exercise Sheet 13, transition-probabilities.tsv, word-distribution.tsv, TIP file, Solution.

• Lecture 14, Tuesday, February 6, 2018 (Course Evaluation, Exam, Work at our Chair): YouTube Livestream, Slides.