For each topic, include up to 1,000 retrieved documents. Upon submission, please let us know which of your runs are manual. A manual run is anything that is not an automatic run. An automatic run must not "manipulate" the topic titles via manual intervention. We will try to quickly review your TIRA or email submissions and provide feedback. Even though the preferred way of run submission is TIRA, in case of problems you may also submit runs via email. Please also have a look at our TIRA quickstart-in case of problems we will be able to assist you. We encourage participants to use TIRA for their submissions to allow for a better reproducibility. You can use the corresponding evaluation script to evaluate your run using the relevance judgments. The quality judgment: 0 (low, or no arguments) to 3 (high).
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |