The increasing use of structure-from-motion photogrammetry for modelling large-scale environments from action cameras attached to drones has driven the next-generation of visualisation techniques that can be used in augmented and virtual reality headsets. It has also created a need to have such models labelled, with objects such as people, buildings, vehicles, terrain, etc. all essential for machine learning techniques to automatically identify as areas of interest and to label them appropriately. However, the complexity of the images makes impossible for human annotators to assess the contents of images on a large scale.
Advances in automatically annotating images for complexity and benthic composition have been promising, and we are interested in automatically identify areas of interest and to label them appropriately for monitoring coral reefs. Coral reefs are in danger of being lost within the next 30 years, and with them the ecosystems they support. This catastrophe will not only see the extinction of many marine species, but also create a humanitarian crisis on a global scale for the billions of humans who rely on reef services. By monitoring the changes and composition of coral reefs we can help prioritise conservation efforts.

ImageCLEFcoral is a task of the ImageCLEF evaluation campaign. ImageCLEF is part of the Cross Language Evaluation Forum (CLEF). Since 2019, this coral task was added. The goal is to create databases to monitor the composition of coral reefs . The organisers of the ImageCLEFcoral challenge distribute the “collection” consisting of images and annotations for coral reef image annotation and localisation. Participants then apply their tools and techniques which are then evaluated in a blind collection.


Project members

Acknowledgements


The images used in this task were able to be gathered thanks to funding from the University of Essex and the ESRC Impact Acceleration Account, as well as logistical support from Operation Wallacea. We would also like to thank the MSc Tropical Marine Biology students who participated in the annotation of the test set.










Publications

  1. Chamberlain, J., Seco de Herrera, AG., Campello, and A., Clark, A. (2022). ImageCLEFcoral task: Coral reef image annotationand localisation. . In: CLEF 2022- Conference and Labs of the Evaluation Forum.
  2. Garcia Seco De Herrera, A., Ionescu, B., Müller, H., Péteri, R., Ben Abacha, A., Friedrich, CM., Rückert, J., Bloch, L., Brüngel, R., Idrissi-Yaghir, A., Schäfer, H., Kozlovski, S., Dicente Cid, Y., Kovalev, V., Chamberlain, J., Clark, A., Campello, A., Schindler, H., Deshayes, J., Popescu, A., S¸tefan, L-D., Constantin, MG. and Dogariu, M., (2022). ImageCLEF 2022: Multimedia Retrieval in Medical, Nature, Fusion, and Internet Applications
  3. Wright, J., Palosanu, IL., Clift, L., de Herrera, AGS. and Chamberlain, J., (2021). Pixelwise annotation of coral reef substrates. In: CLEF 2021 - Conference and Labs of the Evaluation Forum.
  4. Ionescu, B., Müller, H., Péteri, R., Abacha, AB., Sarrouti, M., Demner-Fushman, D., Hasan, SA., Kozlovski, S., Liauchuk, V., Cid, YD., Kovalev, V., Pelka, O., de Herrera, AGS., Jacutprakart, J., Friedrich, CM., Berari, R., Tauteanu, A., Fichou, D., Brie, P., Dogariu, M., Ştefan, LD., Constantin, MG., Chamberlain, J., Campello, A., Clark, A., Oliver, TA., Moustahfid, H., Popescu, A. and Deshayes-Chossart, J., (2021). Overview of the ImageCLEF 2021: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications
  5. Chamberlain, J., Seco de Herrera, AG., Campello, A., Clark, A., Oliver, TA. and Moustahfid, H., (2021). Overview of ImageCLEFcoral 2021: Coral reef image annotation of a 3D environment. In: CLEF 2021 - Conference and Labs of the Evaluation Forum.
  6. Ionescu, B., Müller, H., Péteri, R., Ben Abacha, A., Demner-Fushman, D., Hasan, SA., Sarrouti, M., Pelka, O., Friedrich, C., Garcia Seco De Herrera, A., Jacutprakart, J., Kovalev, V., Kozlovski, S., Liauchuk, V., Dicente Cid, Y., Chamberlain, J., Clark, A., Campello, A., Moustahfid, H., Oliver, T., Schulz, A., Brie, P., Berari, R., Fichou, D., Tautenau, A., Dogariu, M., Stefan, LD., Constantin, MG., Deshayes, J. and Popescu, A., (2021). The 2021 ImageCLEF Benchmark: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications
  7. Chamberlain, J., Campello, A., Wright, JP., Clift, LG., Clark, A. and García Seco de Herrera, A., (2020). Overview of the ImageCLEFcoral 2020 Task: Automated Coral Reef Image Annotation. In: CLEF 2020 - Conference and Labs of the Evaluation Forum.
  8. Ionescu, B., Müller, H., Péteri, R., Abacha, AB., Datla, V., Hasan, SA., Demner-Fushman, D., Kozlovski, S., Liauchuk, V., Cid, YD., Kovalev, V., Pelka, O., Friedrich, CM., Garcia Seco De Herrera, A., Ninh, V-T., Le, T-K., Zhou, L., Piras, L., Riegler, M., Halvorsen, PL., Tran, M-T., Lux, M., Gurrin, C., Dang-Nguyen, D-T., Chamberlain, J., Clark, A., Campello, A., Fichou, D., Berari, R., Brie, P., Dogariu, M., Stefan, LD. and Constantin, MG., (2020). ImageCLEF 2020: Multimedia Retrieval in Lifelogging, Medical, Nature, and Internet Applications
  9. Ionescu, B., Müller, H., Péteri, R., Abacha, AB., Datla, V., Hasan, SA., Demner-Fushman, D., Kozlovski, S., Liauchuk, V., Cid, YD., Kovalev, V., Pelka, O., Friedrich, CM., García Seco de Herrera, A., Ninh, V-T., Le, T-K., Zhou, L., Piras, L., Riegler, M., Halvorsen, P., Tran, M-T., Lux, M., Gurrin, C., Dang-Nguyen, D-T., Chamberlain, J., Clark, A., Campello, A., Fichou, D., Berari, R., Brie, P., Dogariu, M., Ştefan, LD. and Constantin, MG., (2020). Overview of the ImageCLEF 2020: Multimedia Retrieval in Medical, Lifelogging, Nature, and Internet Applications
  10. Chamberlain, J., Campello, A., Wright, J., Clift, L., Clark, A. and Seco De Herrera, AG., (2019). Overview of ImageCLEFcoral 2019 task. In: CLEF 2019 - Conference and Labs of the Evaluation Forum
  11. Ionescu, B., Müller, H., Péteri, R., Cid, YD., Liauchuk, V., Kovalev, V., Klimuk, D., Tarasau, A., Abacha, AB., Hasan, SA., Datla, V., Liu, J., Demner-Fushman, D., Dang-Nguyen, D-T., Piras, L., Riegler, M., Tran, M-T., Lux, M., Gurrin, C., Pelka, O., Friedrich, CM., Garcia Seco De Herrera, A., Garcia, N., Kavallieratou, E., del Blanco, CR., Cuevas, C., Vasillopoulos, N., Karampidis, K., Chamberlain, J., Clark, A. and Campello, A., (2019). ImageCLEF 2019: Multimedia Retrieval in Medicine, Lifelogging, Security and Nature
  12. Ionescu, B., Müller, H., Péteri, R., Dang-Nguyen, D-T., Piras, L., Riegler, M., Tran, M-T., Lux, M., Gurrin, C., Cid, YD., Liauchuk, V., Kovalev, V., Ben Abacha, A., Hasan, SA., Datla, V., Liu, J., Demner-Fushman, D., Pelka, O., Friedrich, CM., Chamberlain, J., Clark, A., Garcia Seco De Herrera, A., Garcia, N., Kavallieratou, E., del Blanco, CR., Rodríguez, CC., Vasillopoulos, N. and Karampidis, K., (2019). ImageCLEF 2019: Multimedia Retrieval in Lifelogging, Medical, Nature, and Security Applications