|
Size: 3620
Comment:
|
Size: 14473
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 5: | Line 5: |
| The course is given by [[http://ad.informatik.uni-freiburg.de/staff/bast|Prof. Dr. Hannah Bast]] and assisted by [[http://ad.informatik.uni-freiburg.de/staff/haussmann|Elmar Haußmann]] and [[http://ad.informatik.uni-freiburg.de/staff/buchhold|Björn Buchhold (stand-in for the first few weeks)]]. It takes place every Tuesday from 4:15pm until 5:45pm in the seminar room SR 01-009/013 in building 101. The first lecture is on Tuesday, October 20, 2015 and the last lecture is on Tuesday, February 9, 2016. There will be no lecture on Tuesday, December 29, 2015 and Tuesday, January 5, 2016 (christmas break) and on [TODO: some other day which is yet to be selected]. That is 14 lectures altogether. | The course is given by [[http://ad.informatik.uni-freiburg.de/staff/bast|Prof. Dr. Hannah Bast]] and assisted by [[http://ad.informatik.uni-freiburg.de/staff/haussmann|Elmar Haußmann]] (stand-in for the first three weeks: [[http://ad.informatik.uni-freiburg.de/staff/buchhold|Björn Buchhold]]). It takes place every Tuesday from 4:15pm until 5:45pm in the seminar room SR 01-009/013 in building 101. The first lecture is on Tuesday, October 20, 2015 and the last lecture is on Tuesday, February 9, 2016. There will be no lecture on Tuesday, December 29, 2015 and Tuesday, January 5, 2016 (christmas break) and on [TODO: some other day which is yet to be selected]. That is 14 lectures altogether. |
| Line 20: | Line 20: |
| * Lecture 1, Tuesday, October 20, 2015 (Introduction, Inverted Index, Zipf's Law): [[https://youtu.be/RgZaNmvlC9s|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-01.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-01.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-01.pdf|Exercise Sheet 1]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-01/|Code from the lecture + TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies.txt|Dataset for ES1 (189,898 movies, title + description)]]. * Lecture 2, Tuesday, October 27, 2015 (TBD): [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies2.txt|Dataset for ES2 (movies.txt without annoying ^M or \r characters)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies-benchmark.txt|Benchmark for ES2 (queryId <tab> query <tab> ground-truth as line numbers in movies2.txt)]], [[InformationRetrievalWS1516/ResultsRanking|Table for your ranking results]]. |
* Lecture 1, Tuesday, October 20, 2015 (Introduction, Inverted Index, Zipf's Law): [[https://youtu.be/RgZaNmvlC9s|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-01.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-01.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-01.pdf|Exercise Sheet 1]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-01/|Code from the lecture + TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies.txt|Dataset for ES1 (189,898 movies, title + description)]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-01/|Solutions for Sheet 1]]. * Lecture 2, Tuesday, October 27, 2015 (Ranking, Evaluation): [[https://youtu.be/WFgXnGedZMI|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-02.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-02.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-02.pdf|Exercise Sheet 2]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-02/sheet-02.TIP|TIP file]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies2.txt|Dataset for ES2]] (movies2.txt ... like movies.txt, but without annoying ^M or \r characters), [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies-benchmark.txt|Benchmark for ES2]] (query <tab> ground-truth as line numbers in movies2.txt), [[InformationRetrievalWS1516/ResultsRanking|Table for your ranking results]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-02/|Solutions for Sheet 2]]. * Lecture 3, Tuesday, November 3, 2015 (Efficient List Intersection): [[https://youtu.be/1wIaV5TP3YM|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-03.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-03.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-03.pdf|Exercise Sheet 3]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-03/|Code from the lecture + posting lists]], [[InformationRetrievalWS1516/ResultsIntersect|Table for performance results]]. * Lecture 4, Tuesday, November 10, 2015 (Compression, Codes, Entropy): [[https://youtu.be/wPaMft9Wrsc|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-04.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-04.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-04.pdf|Exercise Sheet 4]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-04/sheet-04-solution.pdf|Solutions for Sheet 4]]. * Lecture 5, Tuesday, November 17, 2015 (Fuzzy Search, Edit Distance, q-Gram Index): [[https://youtu.be/JgbNss8eOP8|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-05.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-05.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-05.pdf|Exercise Sheet 5]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-05/|Code from the lecture, including TIPs for Exercises 1 - 3]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie-titles-ascii.txt|Dataset for ES5]], [[InformationRetrievalWS1516/ResultsQgram|Table for your q-gram results]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-05/|Solutions for Sheet 5]]. * Lecture 6, Tuesday, November 24, 2015 (How to build a web application): [[https://youtu.be/boKGaH8rZjY|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-06.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-06.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-06.pdf|Exercise Sheet 6]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-06/|Code snippets from lecture]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie-titles-extended.txt|Dataset for ES6]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie-titles-extended_description.txt|description of columns]]), [[InformationRetrievalWS1516/ResultsWebApps|Table with your web apps]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-06/|Solutions for Sheet 6]]. * Lecture 7, Tuesday, December 1, 2015 (Web App Vulnerabilities, Cookies, Unicode): [[https://youtu.be/ayqWI_P2iMI|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-07.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-07.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-07.pdf|Exercise Sheet 7]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-07/|Code snippets from lecture]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/cities-eu.corrupted.txt|Dataset for ES7]], [[InformationRetrievalWS1516/ResultsWebAppsES7|Table with your web apps]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-07/|Solutions for Sheet 7]]. * Lecture 8, Tuesday, December 8, 2015 (Synonyms, Latent Semantic Indexing): [[https://youtu.be/ZLEzVm1DKgo|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-08.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-08.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-08.pdf|Exercise Sheet 8]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies2.txt|Dataset for ES8]] (same as for ES2), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-08/|Code from the lecture and TIP file]], [[InformationRetrievalWS1516/ResultsES8|Table with your results]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-08/|Solutions for Sheet 8]]. * Lecture 9, Tuesday, December 15, 2015 (Clustering, K-Means): [[https://youtu.be/DwDimra6v4o|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-09.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-09.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-09.pdf|Exercise Sheet 9]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movies2.txt|Dataset for ES9]] (same as for ES2), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-09/sheet-09.TIP|TIP file]], [[InformationRetrievalWS1516/ResultsES9|Table with your results]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-09/|Solutions for Sheet 9]]. * Lecture 10, Tuesday, January 12, 2016 (Classification, Naive Bayes): [[https://youtu.be/WJS6MOVBO6w|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-10.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-10.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-10.pdf|Exercise Sheet 10]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-10/naive_bayes.py|Code for ES10]], Datsets for ES10: [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_genres_train.txt|movie genres (train)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_genres_test.txt|movie genres (test)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_train.txt|movie ratings (train)]], [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_test.txt|movie ratings (test)]] , [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-10/|Solutions for Sheet 10]]. * Lecture 11, Tuesday, January 19, 2016 (Linear Classifiers, Perceptrons, SVMs): [[https://youtu.be/64klKkzaCzI|Video Recording]] ([[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-11.mp4|Download]]), [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-11.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-11.pdf|Exercise Sheet 11]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/code/lecture-11/perceptron.py|Code for ES11]], Datsets for ES11: Genres (Comedy vs. Thriller) [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_genres_train_2class.txt|train]] [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_genres_test_2class.txt|test]], Ratings (R vs. not R) [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_train_2class.txt|train]] [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_test_2class.txt|test]], [[InformationRetrievalWS1516/ResultsES11|Table with your results]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/solutions/sheet-11/|Solutions for Sheet 11]]. * Lecture 12, Tuesday, January 26, 2016 (Hypothesis Testing, Statistical Significance): [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/lecture-12.avi|Video Recording (raw version, final cut later tonight)]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/slides/lecture-12.pdf|Slides]], [[https://daphne.informatik.uni-freiburg.de/ws1516/InformationRetrieval/svn/public/exercises/sheet-12.pdf|Exercise Sheet 12]], Datsets for ES12: Ratings (R vs. not R) [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_train_2class.txt|train]] [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_test_2class_50.txt|test (50)]] [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_test_2class_200.txt|test (200)]] [[http://ad-teaching.informatik.uni-freiburg.de/InformationRetrievalWS1516/movie_ratings_test_2class.txt|test (full)]], [[InformationRetrievalWS1516/ResultsES12|Table with your results]]. {{{ #!html <!-- <p style="color:darkred">The audio of the latest video is out of sync again. Workaround until we fixed it: download the MP4, play with VLC, and use keys K and J to set the audio delay to -700ms. Sorry for the inconvenience. --> }}} {{{ #!html <!-- <p style="color:darkred">Update 28-10-2015 14:00: the audio sync problem in the recording for Lecture 2 has been fixed. --> }}} |
Welcome to the Wiki of the course '''Information Retrieval''' in the winter term 2015/2016
The course is given by Prof. Dr. Hannah Bast and assisted by Elmar Haußmann (stand-in for the first three weeks: Björn Buchhold). It takes place every Tuesday from 4:15pm until 5:45pm in the seminar room SR 01-009/013 in building 101. The first lecture is on Tuesday, October 20, 2015 and the last lecture is on Tuesday, February 9, 2016. There will be no lecture on Tuesday, December 29, 2015 and Tuesday, January 5, 2016 (christmas break) and on [TODO: some other day which is yet to be selected]. That is 14 lectures altogether.
The tutors for this course are Simon Weidner (weidnersimon@gmx.de), T2, ..., Tk, where the Ti with i > 1 and the k are still to be determined. The administrator of the supporting systems (Daphne, SVN, Forum, Jenkins) is Axel Lehmann.
Important Links
Here is the link to Daphne (our course management system, login with your RZ user name and password).
Here is the link to the Forum (for announcements and questions, you are automatically a member when you have logged into Daphne).
Short introductions to SVN and Vim and the installation of gtest (for C++ only) can be found here (in German).
The topics of this course will be similar (but not identical) to those of the courses Information Retrieval WS 2012/2013 and Information Retrieval WS 2013/2014.
Here is information about the exams from previous years: WS 12/13, WS 13/14.
Lecture Slides, Video Recordings, Exercise Sheets, and Code
Lecture 1, Tuesday, October 20, 2015 (Introduction, Inverted Index, Zipf's Law): Video Recording (Download), Slides, Exercise Sheet 1, Code from the lecture + TIP file, Dataset for ES1 (189,898 movies, title + description), Solutions for Sheet 1.
Lecture 2, Tuesday, October 27, 2015 (Ranking, Evaluation): Video Recording (Download), Slides, Exercise Sheet 2, TIP file, Dataset for ES2 (movies2.txt ... like movies.txt, but without annoying ^M or \r characters), Benchmark for ES2 (query <tab> ground-truth as line numbers in movies2.txt), Table for your ranking results, Solutions for Sheet 2.
Lecture 3, Tuesday, November 3, 2015 (Efficient List Intersection): Video Recording (Download), Slides, Exercise Sheet 3, Code from the lecture + posting lists, Table for performance results.
Lecture 4, Tuesday, November 10, 2015 (Compression, Codes, Entropy): Video Recording (Download), Slides, Exercise Sheet 4, Solutions for Sheet 4.
Lecture 5, Tuesday, November 17, 2015 (Fuzzy Search, Edit Distance, q-Gram Index): Video Recording (Download), Slides, Exercise Sheet 5, Code from the lecture, including TIPs for Exercises 1 - 3, Dataset for ES5, Table for your q-gram results, Solutions for Sheet 5.
Lecture 6, Tuesday, November 24, 2015 (How to build a web application): Video Recording (Download), Slides, Exercise Sheet 6, Code snippets from lecture, Dataset for ES6 (description of columns), Table with your web apps, Solutions for Sheet 6.
Lecture 7, Tuesday, December 1, 2015 (Web App Vulnerabilities, Cookies, Unicode): Video Recording (Download), Slides, Exercise Sheet 7, Code snippets from lecture, Dataset for ES7, Table with your web apps, Solutions for Sheet 7.
Lecture 8, Tuesday, December 8, 2015 (Synonyms, Latent Semantic Indexing): Video Recording (Download), Slides, Exercise Sheet 8, Dataset for ES8 (same as for ES2), Code from the lecture and TIP file, Table with your results, Solutions for Sheet 8.
Lecture 9, Tuesday, December 15, 2015 (Clustering, K-Means): Video Recording (Download), Slides, Exercise Sheet 9, Dataset for ES9 (same as for ES2), TIP file, Table with your results, Solutions for Sheet 9.
Lecture 10, Tuesday, January 12, 2016 (Classification, Naive Bayes): Video Recording (Download), Slides, Exercise Sheet 10, Code for ES10, Datsets for ES10: movie genres (train), movie genres (test), movie ratings (train), movie ratings (test) , Solutions for Sheet 10.
Lecture 11, Tuesday, January 19, 2016 (Linear Classifiers, Perceptrons, SVMs): Video Recording (Download), Slides, Exercise Sheet 11, Code for ES11, Datsets for ES11: Genres (Comedy vs. Thriller) train test, Ratings (R vs. not R) train test, Table with your results, Solutions for Sheet 11.
Lecture 12, Tuesday, January 26, 2016 (Hypothesis Testing, Statistical Significance): Video Recording (raw version, final cut later tonight), Slides, Exercise Sheet 12, Datsets for ES12: Ratings (R vs. not R) train test (50) test (200) test (full), Table with your results.