Context-Based Image Semantic Similarity for Prosthetic Knowledge

Sheung Wai Chan, Valentina Franzoni, Paolo Mengoni, Alfredo Milani

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

5 Citations (Scopus)

Abstract

Textual information is concept-based information which is used for image representation, like captions, tags or comments. It can convey more concept-related meaning than low-level features. In this work, we will analyze the text connected to images (metadata, comments, tags, etc.) to extract a set of concepts, which can characterize the semantic context of the given image. We propose a context-based image similarity scheme for prosthetic knowledge by evaluating image similarity using the associated groups of concepts. The evaluation can be used in combination with different measures such as WordNet, Wikipedia, and other basic distance metrics to build the group distance comparison. Among semantic measures, web-based proximity measures (e.g. MC, Jaccard, Dice), which exploit statistical data provided by search engines, are particularly effective for similarity evaluation between concepts. Experiments are conducted on tagged images from Flickr repository. The results show that the proposed approach is adequate to measure the image concept similarity and the relationships among images with respect to human evaluation. The proposed methodology is able to reflect the collective notion of semantic similarity.

Original languageEnglish
Title of host publicationProceedings - 2018 1st IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages254-258
Number of pages5
ISBN (Electronic)9781538695555
ISBN (Print)9781538695562
DOIs
Publication statusPublished - Sep 2018
Event1st IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2018 - Laguna Hills, United States
Duration: 26 Sep 201828 Sep 2018

Publication series

NameProceedings - IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE

Conference

Conference1st IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2018
Country/TerritoryUnited States
CityLaguna Hills
Period26/09/1828/09/18

Scopus Subject Areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications

User-Defined Keywords

  • Collective knowledge
  • Context extraction
  • Image retrieval
  • Knowledge discovery
  • Semantic similarity
  • Web based proximity measures

Fingerprint

Dive into the research topics of 'Context-Based Image Semantic Similarity for Prosthetic Knowledge'. Together they form a unique fingerprint.

Cite this