#acl All:read = Welcome to the Wiki of the course "Information Retrieval" in the winter term 2021/2022 = {{{ #!html Information about the exam on Friday, March 4 from 14:00 - 16:15 in HS 026 }}} {{{ #!html Results of the official evaluation of this course }}} {{{ #!html }}} The mode of presentation for this course was changed on short notice because [[http://ad.informatik.uni-freiburg.de/staff/bast|Prof. Dr. Hannah Bast]] was elected as member of the directorate of the faculty last Thursday. This job is a lot of work and comes with a reduction of the teaching load. Prof. Bast therefore cannot conduct the course as originally planned. There was a ZOOM meeting on Tuesday, 19.10.2021, where we discussed possible alternatives. 29 students attended. Here is the current status quo: 0. If you want to take the course this semester under the following conditions, you should register on Daphne: https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval . 1. The complete materials (recordings, slides, exercises, code) from the WS 19/20 will be used, with the possible exception of Lecture 13 (this is not yet decided). 2. There will be a Q&A session every Tuesday at 14:15 with Prof. Dr. Hannah Bast via ZOOM. The link to the meeting is: https://uni-freiburg.zoom.us/j/63418599436 . The password is ir-ws2122 . These sessions will not be recorded. The sessions will take as long as you have questions, but no longer than until 15:45 . 3. Before the Q&A session, you should have studied the respective material (slides and recording) and started working on the exercise sheet. In the Q&A session on 26.10.2021, we will talk about Lecture 1 and Exercise Sheet 1. At the very latest, start on the weekend. 4. The deadline for the exercise sheets is Friday at 12:00. The deadline for the first exercise sheet is 29.10.2021. You should submit your solution in a subfolder ''sheet-dd'', where 'dd' is the number of the sheet (01 for the first sheet). After the deadline, you can't submit to that folder anymore. Until that deadline, you can submit as often as you want. 5. Familiarize yourself with the SVN as soon as possible, ideally right NOW. You find the link to your SVN repository once you registered for the course on Daphne. Here are some basic instruction for how SVN works: https://ad-wiki.informatik.uni-freiburg.de/teaching/SVNEnglish. Note that for the purposes of this course, SVN is just as good as Git. 6. We have set up a forum for announcements and questions: https://daphne.informatik.uni-freiburg.de/forum/viewforum.php?f=1177 . Please ask all your questions there and not by sending email (unless it is something very confidential). 7. There will be tutors for the exercise sheets and the sheets will be graded, as usual and as explained on the [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-01.pdf|slides of Lecture 1]]. The tutors this year are solely Ph.D. students from our chair: Patrick Brosi, Natalie Prange, Matthias Hertel, Johannes Kalmbach. You will be assigned your tutor after the deadline for the first exercise sheet on Friday 29.10.2021. Please take the exercises seriously. They are the most important part of the course. You learn the material from the course only by applying and thinking about it yourself. 8. If you don't want to take the course this semester, but you want to work with us anyway: We offer many exciting projects and theses. There are no particular deadlines, you can start anytime. The procedure is described here: https://ad-wiki.informatik.uni-freiburg.de/teaching/BachelorAndMasterProjectsAndTheses . The list of topics is not up to date. There are always topics available. == Lecture Slides, Video Recordings, Exercise Sheets, and Code == * Lecture 1, Tuesday, October 22, 2019 (Introduction, Inverted Index, Zipf's Law): [[https://www.youtube.com/watch?v=BoUzLoHuVCI|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-01.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-01.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-01.pdf|Exercise Sheet 1]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-01/|Code from the lecture + unit tests for Exercise Sheet 1]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1819/movies.txt|Dataset for ES1 (189,897 movies with title + description)]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-01/|Solution]]. * Lecture 2, Tuesday, October 29, 2019 (Ranking and Evaluation): [[https://www.youtube.com/watch?v=ZNeIqKv09YM|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-02.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-02/|Code from the lecture + unit tests for Exercise Sheet 2]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies2.txt|NEW Movies Dataset (107,769 movies with title + longer description]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies.training-benchmark.tsv|Movies Training Benchmark]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/movies.test-benchmark.tsv|Movies Testing Benchmark]], [[InformationRetrievalWS1920/ResultsES2|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-02/|Solution]]. * Lecture 3, Tuesday, November 5th, 2019 (Efficient List Intersection, Lagrange Multipliers): [[https://www.youtube.com/watch?v=qh-7q6QhHPA|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-03.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-03/sheet-03.pdf|Solution]]. * Lecture 4, Tuesday, November 12th, 2019 (Compression, Codes, Entropy): [[https://www.youtube.com/watch?v=ZHVq7iCCA6I|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-04.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-04.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-04.pdf|Exercise Sheet 4]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-04/sheet-04.pdf|Solution]]. * Lecture 5, Tuesday, November 19th, 2019 (Fuzzy Search, Edit Distance, q-Gram Index): [[https://www.youtube.com/watch?v=NaX4aCWYuLc|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-05.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-05.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-05.pdf|Exercise Sheet 5]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-05/|Code from the lecture + unit tests for Exercise Sheet 5]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.tsv|Wikidata Entities (2,920,180 entities, name + popularity + description + additional information)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.100k.tsv|Wikidata Entities SMALL (100,000 entities)]], [[InformationRetrievalWS2122/ResultsES5|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-05/|Solution]]. * Lecture 6, Tuesday, November 26th, 2019 (Web applications, Part 1): [[https://www.youtube.com/watch?v=FLLNgBoWX7w|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-06.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-06.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-06.pdf|Exercise Sheet 6]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-06/|Code skeleton + test queries for Exercise Sheet 6]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.tsv|Wikidata Entities (same as for ES 5)]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-06/|Solution]]. * Lecture 7, Tuesday, December 3rd, 2019 (Web applications, Part 2): [[https://www.youtube.com/watch?v=FA18UYgMFbQ|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-07.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-07.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-07.pdf|Exercise Sheet 7]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-07/|Code skeleton + test queries for Exercise Sheet 7]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata-entities.tsv|Wikidata Entities (same as for ES 5 + 6)]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-07/|Solution]]. * Lecture 8, Tuesday, December 12th, 2019 (Vector Space Model): [[https://www.youtube.com/watch?v=kFKR3CSFVCs|Video Recording (edited version from WS 17/18)]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-08.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-08.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-08.pdf|Exercise Sheet 8]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-08/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-08/skeleton/|Code skeleton for ES 8]], [[InformationRetrievalWS2122/ResultsES8|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-08/|Solution]]. * Lecture 9, Tuesday, December 17th, 2019 (Latent Semantic Indexing): [[https://www.youtube.com/watch?v=ulEkva9JrTg|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-09.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-09.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-09/|Code from the lecture]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-09.pdf|Exercise Sheet 9]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-09/|Solution]]. * Lecture 10, Tuesday, January 7th, 2020 (Classification, Naive Bayes): [[https://www.youtube.com/watch?v=ga5f-ot7v5U|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-10.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-10.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-10.pdf|Exercise Sheet 10]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-10/|Code Template for ES 10]], [[InformationRetrievalWS2122/ResultsES10|Table for your F-measures]], Datasets for ES10: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-10/|Solution]]. * Lecture 11, Tuesday, January 14th, 2020 (Linear Classifiers, Perceptrons, Logistic Regression): [[https://www.youtube.com/watch?v=_X2LS0ZVBz4|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-11.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-11/|Code Template for ES 11]], [[InformationRetrievalWS2122/ResultsES11|Table for your results]], Datasets for ES11 (same as for ES 10): [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.tsv|Film Genres (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.tsv|Film Genres (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-train.1000.tsv|Film Genres (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-genres-test.1000.tsv|Film Genres (test, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.tsv|Film Ratings (train, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.tsv|Film Ratings (test, Variant 1)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-train.3000.tsv|Film Ratings (train, Variant 2)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/film-ratings-test.3000.tsv|Film Ratings (test, Variant 2)]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-11/|Solution]]. * Lecture 12, Tuesday, January 21, 2020 (Knowledge Bases, SPARQL, Translation to SQL): [[https://www.youtube.com/watch?v=6VbfV98dlNc|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/lecture-12.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/slides/lecture-12.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/exercises/sheet-12.pdf|Exercise Sheet 12]], [[https://daphne.informatik.uni-freiburg.de/ws1920/InformationRetrieval/svn/public/code/lecture-12/|Code Template for ES12]], Datasets for ES12: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata.zip|wikidata.zip (31M triples from Wikidata)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1920/wikidata.5M.zip|wikidata.5M.zip (Subset of wikidata.tsv with only 5M triples)]], [[InformationRetrievalWS2122/ResultsES12|Table for your results]], [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/solutions/sheet-12/|Solution]]. * Lecture 13, Tuesday, February 1, 2022 (Course Evaluation, Exam, Work at our Chair): [[https://youtu.be/NyWbSDOohq0|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS2122/lecture-13.mp4|MP4 Download]]), [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/public/slides/lecture-13.pdf|Slides]], [[http://ad-wiki.informatik.uni-freiburg.de/teaching/InformationRetrievalWS2122/Evaluation|Results of the official course evaluation]]. Here are [[https://daphne.informatik.uni-freiburg.de/ws2122/InformationRetrieval/svn/public/slides/qa-sessions-additional-slides.pdf|the extra slides from all the Q&A sessions]] (L4, L5, L7, L9, L10, L11, L12).