#acl Patrick Brosi:read,write Claudius Korzen:read,write All:read
= Welcome to the Wiki of the course "Information Retrieval" in the winter term 2017/2018 =
{{{
#!html
Information about the exam
}}}
{{{
#!html
Results of the official evaluation of this course
}}}
The course is given by [[http://ad.informatik.uni-freiburg.de/staff/bast|Prof. Dr. Hannah Bast]] and assisted by [[https://ad.informatik.uni-freiburg.de/staff/korzen|Claudius Korzen]]. It takes place every Tuesday from 2:15pm until 3:45pm in seminar room 00-010/14 in building 101. The first lecture is on Tuesday, 17 October 2017 and the last lecture is on Tuesday, 6 February 2018. There will be no lecture on Tuesday, 31 October 2017 (Reformationstag), and on Tuesday, 26 December 2017 and on Tuesday, 2 January 2018 (christmas break). This is 14 lectures altogether.
The tutors for this course are Patrick Brosi, Johannes Kalmbach, Natalie Prange, Simon Selg, Danny Stoll and Daniel Tischner.
The administrator of the supporting systems (Daphne, SVN, Forum, Jenkins) is [[http://ad.informatik.uni-freiburg.de/staff/lehmann|Axel Lehmann]].
== Important Links ==
* Our course management system [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/|Daphne]] (login with your RZ user name and password).
* The [[https://daphne.informatik.uni-freiburg.de/forum/viewforum.php?f=740|Forum]] for announcements and questions (you are automatically a member when you have logged into Daphne).
* Our [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn|CodingStandards]] for C++, Java and Python3.
* Code style formatter profiles for Eclipse: [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn/java/lib/eclipse-java-codestyle-formatter-profile.xml|Java]], [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn/cpp/eclipse-cpp-codestyle-formatter-profile.xml|C++]].
* Our [[InformationRetrievalWS1718/PointsScheme|Points scheme]] for the exercises.
* Information about Subversion (SVN) can be found [[SVN|here (in german)]] and [[SVNEnglish|here (in english)]]; about some editors (including Vim) [[Editoren|here (in german)]]; and about the installation of gtest (for C++ only) [[ProgrammierenCplusplusSS2016/Gtest|here (in english)]].
* The topics of this course will be similar (but not identical) to those of the courses [[InformationRetrievalWS1213|Information Retrieval WS 12/13]], [[InformationRetrievalWS1314|Information Retrieval WS 13/14]], [[InformationRetrievalWS1516|Information Retrieval WS 15/16]] and [[InformationRetrievalWS1617|Information Retrieval WS 16/17]].
* The exams from the previous years: [[InformationRetrievalWS1213/Exam|WS 12/13]], [[InformationRetrievalWS1314/Exam|WS 13/14]], [[InformationRetrievalWS1516/Exam|WS 15/16]], [[InformationRetrievalWS1617/Exam|WS 16/17]].
* Here you can download our [[InformationRetrievalWS1718/LinuxImage|Linux Image]] (for Virtualbox or VMWare).
* [[https://goo.gl/bC5t7f|Livestream]] of the lectures (available shortly before each lecture).
* A cheat sheet for !NumPy and !SciPy can be found [[NumpyCheatSheet|here]].
== Lecture Slides, Video Recordings, Exercise Sheets, and Code ==
'''For visitors from outside the University of Freiburg: You can freely access all the course materials below, except the solutions, by replacing /svn/ by /svn-public/ in the URL.'''
* Lecture 1, Tuesday, October 17, 2017 (Introduction, Inverted Index, Zipf's Law): [[http://www.youtube.com/watch?v=QjA7ujQsL0M|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-01.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-01.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-01.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-01/|Code from the lecture (+ equivalent code in Java and C++)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-01.pdf|Exercise Sheet 1]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-01/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Dataset for ES1 (189,897 movies, title + description)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-01/|Solution]].
* Lecture 2, Tuesday, October 24, 2017 (Ranking and Evaluation): [[https://www.youtube.com/watch?v=bCVPnnWqY8s|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-02/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Movies Dataset (same one as for ES1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies-benchmark.txt|Movies Benchmark]], [[InformationRetrievalWS1718/ResultsES2|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-02/|Solution]].
* Lecture 3, Tuesday, November 7, 2017 (Efficient List Intersection): [[https://www.youtube.com/watch?v=hFYbmLa3usg|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-03.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/postinglists/|Postings Lists]] (Update: 8 November, 10:30pm), basic code to get you started in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/java/|Java]] and [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/cpp/|C++]], [[InformationRetrievalWS1718/ResultsES3|Table for your intersection results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-03/|Solution]].
* Lecture 4, Tuesday, November 14, 2017 (Compression, Codes, Entropy): [[https://www.youtube.com/watch?v=A_F94FV21Ek|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-04.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-04.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-04.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-04.pdf|Exercise Sheet 4]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-04/sheet-04.pdf|Solution]].
* Lecture 5, Tuesday, November 21, 2017 (Fuzzy Search, Edit Distance, q-Gram Index): [[https://www.youtube.com/watch?v=I39Rhegg8Xg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-05.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-05.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-05.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-05.pdf|Exercise Sheet 5]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities.tsv|Wikidata Entities (2,920,180 entities, name + popularity + description + additional information)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/TIP/|TIP file]], code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/cpp/|C++]], [[InformationRetrievalWS1718/ResultsES5|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-05/|Solution]].
* Lecture 6, Tuesday, November 28, 2017 (Web applications, part 1): [[https://www.youtube.com/watch?v=2x4YFzrlV8I|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-06.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-06.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-06.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-06.pdf|Exercise Sheet 6]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities-with-image-urls.tsv|Wikidata Entities (same as for ES5, with image urls)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/TIP/|TIP file]], (part of) the code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/cpp/|C++]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-06/|Solution]].
* Lecture 7, Tuesday, December 5, 2017 (Web applications, part 2: Javascript, Vulnerabilities, Cookies, Unicode): [[https://www.youtube.com/watch?v=aycjGY6v6pg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-07.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-07.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-07.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-07.pdf|Exercise Sheet 7]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities-with-surprises.tsv|Wikidata Entities (with surprises)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-07/TIP/sheet-07.TIP|TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-07/|Solution]].
* Lecture 8, Tuesday, December 12, 2017 (Vector space model): [[https://youtu.be/WShDiIId8Bg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-08.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-08.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-08.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-08/lecture/|Code from the lecture]],
[[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-08.pdf|Exercise Sheet 8]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-08/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Movies Dataset (same one as for ES2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies-benchmark.txt|Movies Benchmark (same one as for ES2)]], [[InformationRetrievalWS1718/ResultsES8|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-08/|Solution]].
* Lecture 9, Tuesday, December 19, 2017 (Clustering, k-means): [[https://www.youtube.com/watch?v=yid_lqC0SDo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-09.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-09.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-09.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-09.pdf|Exercise Sheet 9]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-09/sheet-09.pdf|Solution]].
* Lecture 10, Tuesday, January 9, 2018 (Latent Semantic Indexing): [[https://www.youtube.com/watch?v=CwBn0voJDaw|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-10.mp4|Download]],
[[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-10.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-10.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-10/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-10.pdf|Exercise Sheet 10]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-10/sheet-10.pdf|Solution]].
* Lecture 11, Tuesday, January 16, 2018 (Classification, Naive Bayes): [[https://www.youtube.com/watch?v=jzvjsOPOrw4|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-11.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-11.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-11/|Code for ES 11]], [[InformationRetrievalWS1718/ResultsES11|Table for your F-measures]], Datasets for ES11: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-11/|Solution]].
* Lecture 12, Tuesday, January 23, 2018 (Knowledge Bases, SPARQL, Translation to SQL): [[https://www.youtube.com/watch?v=g_RcMciuLSo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-12.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-12.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-12.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-12.pdf|Exercise Sheet 12]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-12/|Example files from the lecture + TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-12/TIP/sparql_to_sql.py|Code Template for ES12]], Datasets for ES12: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata.zip|wikidata.tsv (48M triples from Wikidata)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata.5M.zip|wikidata.5M.tsv (Subset of wikidata.tsv with only 5M triples)]], [[InformationRetrievalWS1718/ResultsES12|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-12/|Solution]].
* Lecture 13, Tuesday, January 30, 2018 (POS-Tagging, Entity Recognition, Viterbi Algorithm): [[https://www.youtube.com/watch?v=eMVeAzKpv8c|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-13.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-13.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-13.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-13.pdf|Exercise Sheet 13]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/ontonotes-transition-probabilities.tsv|transition-probabilities.tsv]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/ontonotes-word-distribution.tsv|word-distribution.tsv]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-13/TIP/|TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-13/|Solution]].
* Lecture 14, Tuesday, February 6, 2018 (Course Evaluation, Exam, Work at our Chair): [[https://www.youtube.com/watch?v=G00RMfQvV3s|Recording Livestream (YouTube)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-14.epiphan.mp4|Recording Livestream (local)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-14.pdf|Slides]].
{{{
#!html