#acl Claudius Korzen:read,write Patrick Brosi:read,write Niklas Schnelle:read,write All:read = Welcome to the Wiki of the course "Information Retrieval" in the winter term 2018/2019 = {{{ #!html Information about the exam }}} {{{ #!html Results of the official evaluation of this course }}} The course is given by [[http://ad.informatik.uni-freiburg.de/staff/bast|Prof. Dr. Hannah Bast]] and assisted by [[https://ad.informatik.uni-freiburg.de/staff/korzen|Claudius Korzen]]. The course will be based on the video recordings from the course [[InformationRetrievalWS1718|Information Retrieval WS17/18]]. There will be an introductory in-class lecture on Tuesday, 16th October 2018 from 2:15pm until 3:45pm in seminar room 00-010/14 in building 101. There will be 14 lectures and 13 exercise sheets altogether. The tutors for this course are Daniel Bindemann, [[https://ad.informatik.uni-freiburg.de/staff/brosi|Patrick Brosi]], [[https://ad.informatik.uni-freiburg.de/staff/schnelle|Niklas Schnelle]]. The administrator of the supporting systems (Daphne, SVN, Forum, Jenkins) is [[http://ad.informatik.uni-freiburg.de/staff/lehmann|Axel Lehmann]]. == Important Links == * Our course management system [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/|Daphne]] (login with your RZ user name and password). * The [[https://daphne.informatik.uni-freiburg.de/forum/viewforum.php?f=848|forum]] for announcements and questions. * The [[Manuals/AskingOnAForum|manual]] for how to ask questions on the forum. * Our [[InformationRetrievalWS1819/PointsScheme|Points scheme]] for the exercises. * Our [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn|CodingStandards]] for C++, Java and Python 3. * Code style formatter profiles for Eclipse: [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn/java/lib/eclipse-java-codestyle-formatter-profile.xml|Java]], [[https://daphne.informatik.uni-freiburg.de/CodingStandards/svn/cpp/eclipse-cpp-codestyle-formatter-profile.xml|C++]]. * Information about Subversion (SVN) can be found [[SVN|here (in german)]] and [[SVNEnglish|here (in english)]]; about some editors (including Vim) [[Editoren|here (in german)]]; and about the installation of gtest (for C++ only) [[ProgrammierenCplusplusSS2016/Gtest|here (in english)]]. * The courses from previous semesters: [[InformationRetrievalWS1718|Information Retrieval WS 17/18]], [[InformationRetrievalWS1617|Information Retrieval WS 16/17]], [[InformationRetrievalWS1516|Information Retrieval WS 15/16]], [[InformationRetrievalWS1314|Information Retrieval WS 13/14]], [[InformationRetrievalWS1213|Information Retrieval WS 12/13]]. * The exams from previous semesters: [[InformationRetrievalWS1718/Exam|WS 17/18]], [[InformationRetrievalWS1617/Exam|WS 16/17]], [[InformationRetrievalWS1516/Exam|WS 15/16]], [[InformationRetrievalWS1314/Exam|WS 13/14]], [[InformationRetrievalWS1213/Exam|WS 12/13]]. * Here you can download our [[InformationRetrievalWS1819/LinuxImage|Linux Image]] (for Virtualbox or VMWare). * A cheat sheet for !NumPy and !SciPy can be found [[NumpyCheatSheet|here]]. {{{ #!html }}} == Lecture Slides, Video Recordings, Exercise Sheets, and Code == * Lecture 1, Tuesday, October 16, 2018 (Introduction, Inverted Index, Zipf's Law): [[https://www.youtube.com/watch?v=LXvwU8cCHe0|YouTube Part 1]] [[https://www.youtube.com/watch?v=A3-2QRkv9nE|YouTube Part 2]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-01a.mp4|Download Part 1]] [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-01b.mp4|Download Part 2]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn-public/public/slides/lecture-01.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-01/|Code from the lecture (+ equivalent code in Java and C++)]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-01.pdf|Exercise Sheet 1]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-01/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/movies.txt|Dataset for ES1 (189,897 movies with title + description)]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-01/|Solution]]. * Lecture 2, Tuesday, October 23, 2018 (Ranking and Evaluation): [[https://www.youtube.com/watch?v=bCVPnnWqY8s|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-02.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-02/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/movies.txt|Movies Dataset (same one as for ES1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/movies-benchmark.txt|Movies Benchmark]], [[InformationRetrievalWS1819/ResultsES2|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-02/|Solution]]. * Lecture 3, Tuesday, November 6, 2018 (Efficient List Intersection): [[https://www.youtube.com/watch?v=hFYbmLa3usg|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-03.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-03/postinglists/|Postings Lists]], basic code to get you started in [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-03/java/|Java]] and [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-03/cpp/|C++]], [[InformationRetrievalWS1819/ResultsES3|Table for your intersection results]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-03/|Solution]]. * Lecture 4, Tuesday, November 13, 2018 (Compression, Codes, Entropy): [[https://www.youtube.com/watch?v=A_F94FV21Ek|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-04.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-04.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-04.pdf|Exercise Sheet 4]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-04/sheet-04.pdf|Solution]]. * Lecture 5, Tuesday, November 20, 2018 (Fuzzy Search, Edit Distance, q-Gram Index): [[https://www.youtube.com/watch?v=I39Rhegg8Xg|YouTube]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-05.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-05.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-05.pdf|Exercise Sheet 5]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/wikidata-entities.tsv|Wikidata Entities (2,920,180 entities, name + popularity + description + additional information)]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-05/TIP/|TIP file]], code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-05/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-05/cpp/|C++]], [[InformationRetrievalWS1819/ResultsES5|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-05/|Solution]]. * Lecture 6, Tuesday, November 27, 2018 (Web applications, part 1): [[https://www.youtube.com/watch?v=2x4YFzrlV8I|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-06.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-06.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-06.pdf|Exercise Sheet 6]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/wikidata-entities.tsv|Wikidata Entities (same as for ES5)]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-06/TIP/sheet-06.TIP|TIP file]], (part of) the code from the lecture in [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-06/java/|Java]] and the analogous code in [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-06/cpp/|C++]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-06/|Solution]]. * Lecture 7, Tuesday, December 4, 2018 (Web applications, part 2: Javascript, Vulnerabilities, Cookies, Unicode): [[https://www.youtube.com/watch?v=aycjGY6v6pg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-07.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-07.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-07.pdf|Exercise Sheet 7]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/wikidata-entities.tsv|Wikidata Entities (same as for ES5+ES6)]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-07/TIP/sheet-07.TIP|TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-07/|Solution]]. * Lecture 8, Tuesday, December 11, 2018 (Vector space model): [[https://youtu.be/WShDiIId8Bg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-08.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-08.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-08/python/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-08.pdf|Exercise Sheet 8]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-08/TIP/|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/movies.txt|Movies Dataset (same one as for ES2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/movies-benchmark.txt|Movies Benchmark (same one as for ES2)]], [[InformationRetrievalWS1819/ResultsES8|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-08/|Solution]]. * Lecture 9, Tuesday, December 18, 2018 (Clustering, k-means): [[https://www.youtube.com/watch?v=yid_lqC0SDo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-09.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-09.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-09.pdf|Exercise Sheet 9]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-09/sheet-09.pdf|Solution]]. * Lecture 10, Tuesday, January 8, 2019 (Latent Semantic Indexing): [[https://www.youtube.com/watch?v=CwBn0voJDaw|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-10.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-10.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-10/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-10.pdf|Exercise Sheet 10]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-10/sheet-10.pdf|Solution]]. * Lecture 11, Tuesday, January 15, 2019 (Classification, Naive Bayes): [[https://www.youtube.com/watch?v=jzvjsOPOrw4|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1718/lecture-11.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-11/|Code for ES 11]], [[InformationRetrievalWS1819/ResultsES11|Table for your F-measures]], Datasets for ES11: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-11/|Solution]]. * Lecture 12, Tuesday, January 22, 2019 (Knowledge Bases, SPARQL, Translation to SQL): [[https://www.youtube.com/watch?v=g_RcMciuLSo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-12.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-12.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-12.pdf|Exercise Sheet 12]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-12/|Example files from the lecture + TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-12/TIP/sparql_to_sql.py|Code Template for ES12]], Datasets for ES12: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/wikidata.zip|wikidata.zip (48M triples from Wikidata)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/wikidata.5M.zip|wikidata.5M.zip (Subset of wikidata.tsv with only 5M triples)]], [[InformationRetrievalWS1819/ResultsES12|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-12/|Solution]]. * Lecture 13, Tuesday, January 29, 2019 (POS-Tagging, Entity Recognition, Viterbi Algorithm): [[https://www.youtube.com/watch?v=eMVeAzKpv8c|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-13.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-13.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/exercises/sheet-13.pdf|Exercise Sheet 13]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/ontonotes-transition-probabilities.tsv|transition-probabilities.tsv]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/ontonotes-word-distribution.tsv|word-distribution.tsv]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/code/lecture-13/TIP/|TIP file]], [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/solutions/sheet-13/|Solution]]. * Lecture 14, Tuesday, February 5, 2019 (Course Evaluation, Exam, Work at our Chair): [[https://www.youtube.com/watch?v=-EnSKweaIVc|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/lecture-14.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1819/InformationRetrieval/svn/public/slides/lecture-14.pdf|Slides]].