Workshop on Modeling User Behavior for Information Retrieval Evaluation (MUBE 2013)

There is growing interest in ways to incorporate models of human
behavior into Cranfield-style evaluation of information retrieval
systems. While there are many approaches to this problem, two prominent
approaches have been either to start from a user interface and then
simulate user interaction with this interface, or to take traditionally
styled evaluation measures and make them more realistic in terms of
known human behavior.

The SIGIR 2013 Workshop on Modeling User Behavior for Information
Retrieval Evaluation (MUBE 2013) aims to bring together people to
discuss existing and new approaches, ways to collaborate, and other
ideas and issues involved in improving information retrieval evaluation
through the modeling of user behavior.

Areas of interest for the workshop include but are not limited to:

– Studies of user behavior applicable to evaluation
– Models of users
– Data collection
– Test collection support for evaluation using user models
– Calibration and validation of effectiveness measures derived from
user models
– Connections to related research in automated usability
– Information foraging theory
– Economic models applied to IR evaluation
– Simulation of interaction
– Evaluation of sessions
– Models of query reformulation
– Studies of relevance judging
– Click models
– Incorporation of user variance into evaluation

We are soliciting submission of 2 page poster papers to encourage
sharing of ideas and encourage discussion. We would like to see a wide
range of paper styles: reports of original research, preliminary
research results, proposals for new work, and position papers. All
papers will be peer reviewed by the program committee and judged by
their relevance to the workshop and their likelihood to generate
discussion. Accepted papers will be presented both at a one-hour
boaster session and during the workshop’s poster session.

Papers should be in the ACM SIG proceedings format ( ) and
submitted via EasyChair:

In addition to the boaster/poster sessions, the workshop will include
several invited talks and afternoon breakouts groups devoted to specific
topics chosen by the workshop attendees.

Important Dates:

– Papers due: June 9, 2013 (firm deadline due to shortened review
– Acceptance notification: June 26, 2013
– Camera ready copy due: July 3, 2013
– Workshop in Dublin: August 1, 2013


– Charles Clarke (University of Waterloo)
– Luanne Freund (University of British Columbia)
– Mark Smucker (University of Waterloo)
– Emine Yilmaz (University College London)

Workshop Website:

This entry was posted in News and tagged , , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s