Khresmoi aims to develop a multi-lingual multi-modal search and access system for biomedical information and documents.

This will be achieved by:
  • Effective automated information extraction from biomedical documents, including improvements using crowd sourcing and active learning, and automated estimation of the level of trust and target user expertise
  • Automated analysis and indexing for medical images in 2D (X-Rays), 3D (MRI, CT), and 4D (MRI with a time component)
  • Linking information extracted from unstructured or semi-structured biomedical texts and images to structured information in knowledge bases
  • Support of cross-language search, including multi-lingual queries, and returning machine-translated pertinent excerpts
  • Adaptive user interfaces to assist in formulating queries and display search results via ergonomic and interactive visualisations

The research will flow into several open source components, which will be integrated into an innovative open architecture for robust and scalable biomedical information search.


Project members

  • HES-SO Valais-Wallis, Switzerland
  • Vienna University of technology, Austria
  • Atos Origin, Spain
  • ELDA, France
  • Ontotext, Belgium
  • Dublin City University, Ireland
  • University of Duisburg-Essen, Germany
  • Charles University in Prague, Czechia
  • The University of Sheffield, United Kingdom
  • Health on the Net, Switzerland
  • Medical University of Vienna, Austria
  • Society of Physicians in Vienna, Austria

Team members

Network of Excellence co-funded by the 7th Framework Programme of the European Commission, grant agreement no.257528.

Publications

  1. Garcia Seco De Herrera, A., (2015). Use Case Oriented Medical Visual Information Retrieval & System Evaluation. PhD Thesis
  2. Garcia Seco De Herrera, A., Schaer, R., Markonis, D. and Müller, H., (2015). Comparing Fusion Techniques for the ImageCLEF 2013 Medical Case Retrieval Task. Computerized Medical Imaging and Graphics. 39, 46-54
  3. Foncubierta-Rodríguez, A., Garcia Seco De Herrera, A. and Müller, H., (2015). Meaningful bags of words for medical image classification and retrieval. In: Comprehensive Health Monitoring and Personalized Feedback Using Multimedia Data. Editors: Briassouli, A., Benois-Pineau, J. and Hauptmann, A., . Springer. 73- 93. 978-3-319-17962-9
  4. Garcia Seco De Herrera, A. and Müller, H., (2014). Fusion Techniques in Biomedical Information Retrieval. In: Fusion in Computer Vision: Understanding Complex Visual Content. Editors: Ionescu, B., Benois-Pineau, J., Piatrik, T. and Quénot, G., . Springer. 209- 228. 978-3-319-05695-1
  5. Garcia Seco De Herrera, Alba and Markonis, Dimitrios and Joyseeree, Ranveer and Schaer, Roger and Foncubierta-Rodríguez, Antonio and Müller, Henning (2015) Semi–Supervised Learning for Image Modality Classification. In: Multimodal Retrieval in the Medical Domain First International Workshop, MRMD 2015, 2015-03-29 - ?, Vienna, Austria.
  6. Garcia Seco De Herrera, Alba and Foncubierta-Rodríguez, Antonio and Müller, Henning (2015) Medical case-based retrieval: integrating query MeSH terms for query-adaptive multi-modal fusion. In: SPIE Medical Imaging, 2015-02-21 - 2015-02-26, Orlando, Florida, United States.
  7. García Seco de Herrera, A., Foncubierta-Rodríguez, A., Markonis, D., Schaer, R. and Müller, H., (2014). Crowdsourcing for Medical Image Classification In: Third International MICCAI Workshop, MCV 2013, 2013-09-26 - ?, Nagoya, Japan.
  8. Garcia Seco De Herrera, A., Kalpathy-Cramer, J., Demner-Fushman, D., Antani, S. and Müller, H., (2014). Overview of the ImageCLEF 2013 medical tasks In: CLEF 2013 Conference, 2013-09-23 - 2013-09-26, Valencia, Spain.
  9. Garcia Seco De Herrera, A., Markonis, D., Schaer, R., Eggel, I. and Müller, H., (2014). The medGIFT Group in ImageCLEFmed 2013 In: CLEF 2013 Conference, 2013-09-23 - 2013-09-26, Valencia, Spain.
  10. Aswani, N., Beckers, T., Birngruber, E., Boyer, C., Burner, A., Bystroň, J., Choukri, K., Cruchet, S., Cunningham, H., Dědek, J., Dolamic, L., Donner, R., Dungs, S., Eggel, I., Foncubierta-Rodríguez, A., Fuhr, N., Funk, A., Garcia Seco De Herrera, A., Gaudinat, A., Georgiev, G., Gobeill, J., Goeuriot, L., Gómez, P., Greenwood, M., Gschwandtner, M., Hanbury, A., Hajič, J., Hlaváčová, J., Holzer, M., Jones, G., Jordan, B., Jordan, M., Kaderk, K., Kainberger, F., Kelly, L., Kriewel, S., Kritz, M., Langs, G., Lawson, N., Markonis, D., Martinez, I., Momtchev, V., Masselot, A., Mazo, H., Müller, H., Palotti, JA., Pecina, P., Pentchev, K., Peychev, D., Pletneva, N., Pottecherc, D., Roberts, A., Ruch, P., Sachs, A., Samwald, M., Schneller, P., Stefanov, V., Tinte, MA., Ure v sová, Z., Vargas, A. and Vishnyakova, D., (2013). Khresmoi – multilingual semantic search of medical text and images In: MedInfo 2013 14th world congress on medical and health informatics, 2013-08 - ?, Copenhagen, Denmark.
  11. Aswani, N., Beckers, T., Birngruber, E., Boyer, C., Burner, A., Bystroň, J., Choukri, K., Cruchet, S., Cunningham, H., Dědek, J., Dolamic, L., Donner, R., Dungs, S., Eggel, I., Foncubierta-Rodríguez, A., Fuhr, N., Funk, A., Garcia Seco De Herrera, A., Gaudinat, A., Georgiev, G., Gobeill, J., Goeuriot, L., Gomez, P., Greenwood, M., Gschwandtner, M., Hanbury, A., Hajič, J., Hlaváčová, J., Holzer, M., Jones, G., Jordan, B., Jordan, M., Kaderk, K., Kainberger, F., Kelly, L., Kriewel, S., Kritz, M., Langs, G., Lawson, N., Markonis, D., Martinez, I., Momtchev, V., Masselot, A., Mazo, H., Müller, H., Palotti, JA., Pecina, P., Pentchev, K., Peychev, D., Pletneva, N., Pottecherc, D., Roberts, A., Ruch, P., Sachs, A., Samwald, M., Schneller, P., Stefanov, V., Tinte, MA., Ure v sová, Z., Vargas, A. and Vishnyakova, D., (2013). Khresmoi Professional: Multilingual Semantic Search for Medical Professionals In: SIGIR 2013 Health Search and Discovery HSD workshop, 2013-08-01 - 2013-08-01, Dublin, Ireland.
  12. Foncubierta-Rodríguez, A., Garcia Seco De Herrera, A. and Müller, H., (2013). Medical Image Retrieval using Bag of Meaningful Visual Words: Unsupervised visual vocabulary pruning with PLSA. In: 1st ACM international workshop on Multimedia indexing and information retrieval for healthcare MIIRH '13, 2013-10 - 2013-10-22, Barcelona Spain.
  13. Garcia Seco De Herrera, A., Markonis, D. and Müller, H., (2013). Bag-of-Colors for Biomedical Document Image Classification. In: Third MICCAI International Workshop, MCBR-CDS 2012, 2012-10-01 - ?, Nice, France.
  14. García Seco de Herrera, A., Markonis, D., Eggel, I. and Müller, H., (2012). The medGIFT Group in ImageCLEFmed 2012
  15. Markonis, D., García Seco de Herrera, A., Eggel, I. and Müller, H., (2012). Multi-scale visual words for hierarchical medical image categorization
  16. Müller, H., García Seco de Herrera, A., Kalpathy-Cramer, J., Demner-Fushman, D., Antani, S. and Eggel, I., (2012). Overview of the ImageCLEF 2012 medical image retrieval and classification tasks
  17. Aswani, N., Beckers, T., Birngruber, E., Boyer, C., Burner, A., Bystroň, J., Choukri, K., Cruchet, S., Cunningham, H., Dědek, J., Dolamic, L., Donner, R., Dungs, S., Eggel, I., Foncubierta-Rodríguez, A., Fuhr, N., Funk, A., García Seco de Herrera, A., Gaudinat, A., Georgiev, G., Gobeill, J., Goeuriot, L., Gómez, P., Greenwood, M., Gschwandtner, M., Hanbury, A., Hajič, J., Hlaváčová, J., Holzer, M., Jones, G., Jordan, B., Jordan, M., Kaderk, K., Kainberger, F., Kelly, L., Mriewel, S., Kritz, M., Langs, G., Lawson, N., Markonis, D., Martinez, I., Momtchev, V., Masselot, A., Mazo, H., Müller, H., Pecina, P., Pentchev, K., Peychev, D., Pletneva, N., Pottecherc, D., Roberts, A., Ruch, P., Samwald, M., Schneller, P., Stefanov, V., Tinte, MA., Ure v sová, Z., Vargas, A. and Vishnyakova, D., (2012). Khresmoi: Multimodal Multilingual Medical Information SearchIn: 24th International Conference of the European Federation for Medical Informatics, 2012-08-26 - 2012-08-29, Pisa, Italy.
  18. Markonis, D., García Seco de Herrera, A., Eggel, I. and Müller, H., (2011). The MedGIFT group at ImageCLEFmed 2011
  19. Kalpathy-Cramer, J., Müller, H., Bedrick, S., Eggel, I., García Seco de Herrera, A. and Tsikrika, T., (2011). Overview of the CLEF 2011 medical image classification and retrieval tasks
  20. Tsikrika, T., García Seco de Herrera, A. and Müller, H., (2011). Assessing the Scholarly Impact of ImageCLEF