Information Needs

These information needs were used for the relevance judgments of the default scoring mechanism (see: Evaluation of Results) and for the relevance judgments of both the BM25 scoring mechanism and language modeling scoring (see: Changing the Ranking).

Query
artikel AND "de telegraaf"

I'm looking for all letters that have been written based on an article in De Telegraaf.

Guidelines

 * An article in De Telegraaf has to be the reason why the person decided to write the letter.
 * If the letter contains the word "Telegraaf", but it was not written based on an article in that paper, it's non-relevant.
 * If the letter is specifically about De Telegraaf, it's non-relevant.

Query
primair onderwijs + kosten

I'm looking for all letters that are about the costs of primary education.

Guidelines

 * The letter has to be about the costs of primary education, not about the costs of something else.
 * The letter has to be about primary education; all other forms of education are considered non-relevant.
 * If the letter is about multiple forms of education, but it's explicitly stated that primary education is one of these forms, the letter is considered relevant.

Query
islam* onderwijs Amsterdam

I'm looking for all letters that are about Islamic education in Amsterdam.

Guidelines

 * The letter has to be about Islamic education in general, and not just about one specific Islamic school.
 * The letter has to be about Islamic education in general, and not about a specific part of education (e.g. teachers or facilities).

Query
(illegale OR gedwongen) AND prostitutie

I'm looking for all letters that are about forced prostitution.

Guidelines

 * The prostitution has to be forced by nature. When they're talking about voluntary prostitutes that are forced to work long hours (for example), the letter is not relevant.
 * The majority of the letter has to be about prostitution. For example, if the letter is about human trafficking, and prostitution is only shortly mentioned, the letter is not relevant.

Query
crimin* AND (bestrijding OR aanpak OR maatregelen)

I want to know the actions the municipality of Amsterdam is taking to reduce crime rates.

Guidelines

 * If the letter is not specifically about the actions the municipality is taking (i.e. just about criminality in general), it's not relevant.
 * The letter can be about any form of crime, as long as it's really a crime. Use the list of crimes on Wikipedia.
 * If the letter is just about criminals, but not about their criminal activities, the letter is not relevant.
 * The theme of the letter should be criminality (and the fight against crime). If these are just mentioned in one or two sentences, the letter is not relevant.