From the post:
TREC Legal Track — part of the U.S. government’s Text Retrieval Conference — announced last week that the 2012 edition of its annual document review project for testing new systems is canceled, while prominent e-discovery software company Recommind confirmed that it’s been asked to leave the project for prematurely sharing results.
These difficulties highlight the need for:
- open data sets and
- protocols for reporting of results as they occur.
That requires a data set with relevance judgments and other work.
Have you thought about the: Open Relevance Project at the Apache Foundation?
Email archives from Apache projects, the backbone of the web as we know it, are ripe for your contributions.
Let me be the first to ask Recommind to join in building a public data set for everyone.