#acl Claudius Korzen:read,write Patrick Brosi:read,write Niklas Schnelle:read,write All:read

= Welcome to the Wiki of the course "Information Retrieval" in the winter term 2018/2019 =

{{{
#!html
<!--
<a style="color:darkred; font-weight: bold" href="http://ad-wiki.informatik.uni-freiburg.de/teaching/InformationRetrievalWS1819/Exam">Information about the exam</a>
-->
}}}

{{{
#!html
<!--
<a style="color:darkred; font-weight: bold" href="http://ad-wiki.informatik.uni-freiburg.de/teaching/InformationRetrievalWS1819/Evaluation">Results of the official evaluation of this course</a>
-->
}}}


{{{
#!html
<!--
The course is given by [[http://ad.informatik.uni-freiburg.de/staff/bast|Prof. Dr. Hannah Bast]] and assisted by [[https://ad.informatik.uni-freiburg.de/staff/korzen|Claudius Korzen]]. It takes place every Tuesday from 2:15pm until 3:45pm in seminar room 00-010/14 in building 101. The first lecture is on Tuesday, 17 October 2017 and the last lecture is on Tuesday, 6 February 2018. There will be no lecture on Tuesday, 31 October 2017 (Reformationstag), and on Tuesday, 26 December 2017 and on Tuesday, 2 January 2018 (christmas break). This is 14 lectures altogether.
-->
}}}

The tutors for this course are Daniel Bindemann, Patrick Brosi, Niklas Schnelle, N/A and N/A.
The administrator of the supporting systems (Daphne, SVN, Forum, Jenkins) is [[http://ad.informatik.uni-freiburg.de/staff/lehmann|Axel Lehmann]].

== Important Links ==

 * Our course management system [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/|Daphne]] (login with your RZ user name and password).
 * The [[https://daphne.informatik.uni-freiburg.de/forum/viewforum.php?f=848|Forum]] for announcements and questions (you are automatically a member when you have logged into Daphne).
 * Our [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn|CodingStandards]] for C++, Java and Python 3.
 * Code style formatter profiles for Eclipse: [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn/java/lib/eclipse-java-codestyle-formatter-profile.xml|Java]], [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn/cpp/eclipse-cpp-codestyle-formatter-profile.xml|C++]].
 * Our [[InformationRetrievalWS1819/PointsScheme|Points scheme]] for the exercises.
 * Information about Subversion (SVN) can be found [[SVN|here (in german)]] and [[SVNEnglish|here (in english)]]; about some editors (including Vim) [[Editoren|here (in german)]]; and about the installation of gtest (for C++ only) [[ProgrammierenCplusplusSS2016/Gtest|here (in english)]]. 
 * The courses from previous semesters: [[InformationRetrievalWS1718|Information Retrieval WS 17/18]], [[InformationRetrievalWS1617|Information Retrieval WS 16/17]], [[InformationRetrievalWS1516|Information Retrieval WS 15/16]], [[InformationRetrievalWS1314|Information Retrieval WS 13/14]], [[InformationRetrievalWS1213|Information Retrieval WS 12/13]].
 * The exams from previous semesters: [[InformationRetrievalWS1213/Exam|WS 12/13]], [[InformationRetrievalWS1314/Exam|WS 13/14]], [[InformationRetrievalWS1516/Exam|WS 15/16]], [[InformationRetrievalWS1617/Exam|WS 16/17]], [[InformationRetrievalWS1718/Exam|WS 17/18]].
 * Here you can download our [[InformationRetrievalWS1819/LinuxImage|Linux Image]] (for Virtualbox or VMWare).
 * [[https://goo.gl/bC5t7f|Livestream]] of the lectures (available shortly before each lecture).

{{{
#!html
<!--
 * A cheat sheet for !NumPy and !SciPy can be found [[NumpyCheatSheet|here]].
-->
}}}

== Lecture Slides, Video Recordings, Exercise Sheets, and Code ==

'''For visitors from outside the University of Freiburg: You can freely access all the course materials below, except the solutions, by replacing /snv/ by /svn-public/ in the URL.'''

 * Lecture 1, Tuesday, October 17, 2017 (Introduction, Inverted Index, Zipf's Law): [[http://www.youtube.com/watch?v=QjA7ujQsL0M|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-01.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-01.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-01.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-01/|Code from the lecture (+ equivalent code in Java and C++)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-01.pdf|Exercise Sheet 1]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-01/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Dataset for ES1 (189,897 movies, title + description)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-01/|Solution]].
 * Lecture 2, Tuesday, October 24, 2017 (Ranking and Evaluation): [[https://www.youtube.com/watch?v=bCVPnnWqY8s|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-02.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-02/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Movies Dataset (same one as for ES1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies-benchmark.txt|Movies Benchmark]], [[InformationRetrievalWS1718/ResultsES2|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-02/|Solution]].
 * Lecture 3, Tuesday, November 7, 2017 (Efficient List Intersection): [[https://www.youtube.com/watch?v=hFYbmLa3usg|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-03.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/postinglists/|Postings Lists]] (Update: 8 November, 10:30pm), basic code to get you started in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/java/|Java]] and [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-03/cpp/|C++]], [[InformationRetrievalWS1718/ResultsES3|Table for your intersection results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-03/|Solution]].
 * Lecture 4, Tuesday, November 14, 2017 (Compression, Codes, Entropy): [[https://www.youtube.com/watch?v=A_F94FV21Ek|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-04.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-04.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-04.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-04.pdf|Exercise Sheet 4]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-04/sheet-04.pdf|Solution]].
 * Lecture 5, Tuesday, November 21, 2017 (Fuzzy Search, Edit Distance, q-Gram Index): [[https://www.youtube.com/watch?v=I39Rhegg8Xg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-05.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-05.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-05.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-05.pdf|Exercise Sheet 5]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities.tsv|Wikidata Entities (2,920,180 entities, name + popularity + description + additional information)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/TIP/|TIP file]], code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-05/cpp/|C++]], [[InformationRetrievalWS1718/ResultsES5|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-05/|Solution]].
 * Lecture 6, Tuesday, November 28, 2017 (Web applications, part 1): [[https://www.youtube.com/watch?v=2x4YFzrlV8I|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-06.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-06.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-06.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-06.pdf|Exercise Sheet 6]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities-with-image-urls.tsv|Wikidata Entities (same as for ES5, with image urls)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/TIP/|TIP file]], (part of) the code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-06/cpp/|C++]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-06/|Solution]].
 * Lecture 7, Tuesday, December 5, 2017 (Web applications, part 2: Javascript, Vulnerabilities, Cookies, Unicode): [[https://www.youtube.com/watch?v=aycjGY6v6pg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-07.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-07.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-07.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-07.pdf|Exercise Sheet 7]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata-entities-with-surprises.tsv|Wikidata Entities (with surprises)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-07/TIP/sheet-07.TIP|TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-07/|Solution]].
 * Lecture 8, Tuesday, December 12, 2017 (Vector space model): [[https://youtu.be/WShDiIId8Bg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-08.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-08.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-08.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-08/lecture/|Code from the lecture]],
 [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-08.pdf|Exercise Sheet 8]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-08/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies.txt|Movies Dataset (same one as for ES2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/movies-benchmark.txt|Movies Benchmark (same one as for ES2)]], [[InformationRetrievalWS1718/ResultsES8|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-08/|Solution]].
 * Lecture 9, Tuesday, December 19, 2017 (Clustering, k-means): [[https://www.youtube.com/watch?v=yid_lqC0SDo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-09.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-09.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-09.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-09.pdf|Exercise Sheet 9]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-09/sheet-09.pdf|Solution]].
 * Lecture 10, Tuesday, January 9, 2018 (Latent Semantic Indexing): [[https://www.youtube.com/watch?v=CwBn0voJDaw|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-10.mp4|Download]],
 [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-10.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-10.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-10/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-10.pdf|Exercise Sheet 10]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-10/sheet-10.pdf|Solution]].
 * Lecture 11, Tuesday, January 16, 2018 (Classification, Naive Bayes): [[https://www.youtube.com/watch?v=jzvjsOPOrw4|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-11.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-11.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-11/|Code for ES 11]], [[InformationRetrievalWS1718/ResultsES11|Table for your F-measures]], Datasets for ES11: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-11/|Solution]].
 * Lecture 12, Tuesday, January 23, 2018 (Knowledge Bases, SPARQL, Translation to SQL): [[https://www.youtube.com/watch?v=g_RcMciuLSo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-12.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-12.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-12.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-12.pdf|Exercise Sheet 12]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-12/|Example files from the lecture + TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-12/TIP/sparql_to_sql.py|Code Template for ES12]], Datasets for ES12: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata.zip|wikidata.tsv (48M triples from Wikidata)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/wikidata.5M.zip|wikidata.5M.tsv (Subset of wikidata.tsv with only 5M triples)]], [[InformationRetrievalWS1718/ResultsES12|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-12/|Solution]].
 * Lecture 13, Tuesday, January 30, 2018 (POS-Tagging, Entity Recognition, Viterbi Algorithm): [[https://www.youtube.com/watch?v=eMVeAzKpv8c|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-13.mp4|Download]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-13.epiphan.mp4|Recording Livestream]]), [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-13.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/exercises/sheet-13.pdf|Exercise Sheet 13]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/ontonotes-transition-probabilities.tsv|transition-probabilities.tsv]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/ontonotes-word-distribution.tsv|word-distribution.tsv]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/code/lecture-13/TIP/|TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/solutions/sheet-13/|Solution]].
 * Lecture 14, Tuesday, February 6, 2018 (Course Evaluation, Exam, Work at our Chair): [[https://www.youtube.com/watch?v=G00RMfQvV3s|Recording Livestream (YouTube)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-14.epiphan.mp4|Recording Livestream (local)]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-14.pdf|Slides]].

{{{
#!html
<!-- 
 * Lecture 14, Tuesday, February 6, 2018 (Course Evaluation, Exam, Work at our Chair): [[https://www.youtube.com/watch?v=G00RMfQvV3s|YouTube Livestream]], [[https://daphne.informatik.uni-freiburg.de/ws1718/InformationRetrieval/svn/public/slides/lecture-14.pdf|Slides]].
}}}