Crowdsourcing for Search Evaluation
An interesting workshop held in connection with the 33rd Annual ACM SIGIR Conference.
Think of this in terms of crowdsourcing subject identification instead of search evaluation and its relevance to topic maps becomes clearer.
Comments to follow on some of the specific papers.