In this web application, we present an experimental multimodal search engine, which allows multimedia and multi-language queries, and makes use of the total available information in a multimodal collection. All modalities are indexed and searched separately, and results can be fused with different methods depending on the noise and completeness characteristics of the modalities in a collection whether the user is in a need of high initial precision or high recall.
Beyond fusion, we also provide 2-stage retrieval by first thresholding the results obtained by secondary modalities targeting recall, and then re-ranking them based on the primary modality. The engine demonstrates the feasibility of the proposed architecture and methods on the ImageCLEF 2010 Wikipedia collection. Its primary modality is image, consisting of 237434 items, associated with noisy and incomplete user-supplied annotations and the Wikipedia articles containing the images. Associated modalities are written in any combination of English, German, French, or any other undetermined language.
§ The TREC_Files Evaluator
The TRECFiles Evaluator (ver 0.1 BETA) calculates the efficiency of the MAP, ANMRR, P10, P20 and the MNRO in TREC Files (Trec Format), giving also to the user the ability to execute significance tests (ST). STs tell us whether an observed effect, such as a difference between two means or a correlation between two variables, could reasonably occur just by chance in selecting a random sample. This application uses a bootstrap test, one-tailed, at significance levels 0.05, 0.01, and 0.001, against a baseline run.
For the latest version, visit: http://thetrecfiles.nonrelevant.net