Forschungskolloquium des IWS: Validating Simulations of User Query Variants
Vortrag, 07. Juni 2022
Der (zu gründende) Forschungsschwerpunkt Knowledge Discovery am Institut für Informationswissenschaft freut sich, das durch die Corona-Pandemie ausgesetzte Forschungskolloquium des IWS wieder anbieten zu können. Es findet als hybride Veranstaltung sowohl vor Ort als auch in Zoom statt.
Auf einen Blick
Timo Breuer: Validating Simulations of User Query Variants
VortragWann?
- 07. Juni 2022
- 15.15 Uhr bis 17.30 Uhr
-
in meinen Kalender übertragen
BEGIN:VCALENDAR VERSION:2.0 PRODID:-//hacksw/handcal//NONSGML v1.0//EN CALSCALE:GREGORIAN BEGIN:VTIMEZONE TZID:EUROPE/BERLIN BEGIN:DAYLIGHT TZOFFSETFROM:+0100 TZOFFSETTO:+0200 TZNAME:CEST DTSTART:19700329T020000 RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=-1SU END:DAYLIGHT BEGIN:STANDARD TZOFFSETFROM:+0200 TZOFFSETTO:+0100 TZNAME:CET DTSTART:19701025T030000 RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=-1SU END:STANDARD END:VTIMEZONE BEGIN:VEVENT LOCATION:Campus Südstadt\, Claudiusstr. 1\, Raum 158 oder per Zoom: Meeting ID: 83506753468\, Kennwort 167256 DESCRIPTION: SUMMARY:Timo Breuer: Validating Simulations of User Query Variants DTSTART;TZID=EUROPE/BERLIN:20220607T151500 DTEND;TZID=EUROPE/BERLIN:20220607T173000 DTSTAMP:20241204T155644 UID:67506dac7176a END:VEVENT END:VCALENDAR
Wo?
Campus Südstadt, Claudiusstr. 1, Raum 158
oder per Zoom: Meeting ID: 83506753468, Kennwort 167256
https://th-koeln.zoom.us/j/83506753468
Veranstaltungsreihe
Forschungskolloquium Informationswissenschaft
ReferentIn
Timo Breuer Kontakt
Anmeldung
keine Anmeldung notwendig
Weitere Informationen
System-oriented IR evaluations are limited to rather abstract understandings of real user behavior. As a solution, simulating user interactions provides a cost-efficient way to support system-oriented experiments with more realistic directives when no interaction logs are available. While there are several user models for simulated clicks or result list interactions, very few attempts have been made towards query simulations, and it has not been investigated if these can reproduce properties of real queries. In this work, we validate simulated user query variants with the help of TREC test collections in reference to real user queries that were made for the corresponding topics. Besides, we introduce a simple yet effective method that gives better reproductions of real queries than the established methods. Our evaluation framework validates the simulations regarding the retrieval performance, reproducibility of topic score distributions, shared task utility, effort and effect, and query term similarity when compared with real user query variants. While the retrieval effectiveness and statistical properties of the topic score distributions as well as economic aspects are close to that of real queries, it is still challenging to simulate exact term matches and later query reformulations.
Vortragssprache
deutsch