Development of a mobile phone based tongue image acquisition system

Robert Parcus, Kin Long Chow, Hailong ZHU, Qin Yu, Shi Ping ZHANG

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Background. Tongue diagnosis is one of the main diagnostic methods in Chinese Medicine (CM). In addition to being used with other techniques to generate a CM diagnosis, methods derived from CM tongue diagnosis may have new applications, especially in early detection of certain diseases. Therefore, we believe that automating the collection and analysis of tongue images is of great benefit. While several methods for capturing images, extracting features and analyzing the data have been proposed over the years, most have limitations in reliability, accuracy, cost and usability. Nonetheless, recent advances in the field of image processing and machine learning (ML), together with improved hardware capabilities are rapidly enabling novel solutions to the problem. This paper describes a new mobile phone-based image acquisition method and reports our assessment of image quality from a clinical perspective. Methodology. A mobile phone-based system that uses a phone's flash and back camera to collect images with automatic white balance was developed. The usability and image quality were tested on forty (40) volunteers. Information pertaining to CM diagnosis of the tongue was collected through direct visual inspection, and by inspecting images produced by a commercially available tongue image diagnostic instrument, and by our newly developed system. The data collected amongst the three methods were compared using Cohen's kappa coefficient to evaluate the practical value of the images collected by the new system. Result. Our system is able to collect good quality tongue images and in general provides information comparable to those obtained through direct visual inspection or by the commercial instrument. Compared with the commercial instrument, our system has better inter-rater agreement with direct visual inspection in detecting the presence of tooth marks (kappa value: 0.633 vs 0.259), but inferior in detecting tongue coating greasiness (kappa value: 0.217 vs 0.739). Main contributions of this paper. We have presented a new mobile phone-based tongue image acquisition system that is low cost and convenient to use. Because of these desirable features, the system has the potential for mass public use to collect big data, paving the way for development of automatic tongue analysis using deep learning techniques.

Original languageEnglish
Title of host publicationProceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017
EditorsSong Qiu, Hongying Liu, Li Sun, Lipo Wang, Qingli Li, Mei Zhou
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-6
Number of pages6
ISBN (Electronic)9781538619377
DOIs
Publication statusPublished - 22 Feb 2018
Event10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017 - Shanghai, China
Duration: 14 Oct 201716 Oct 2017

Publication series

NameProceedings - 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017
Volume2018-January

Conference

Conference10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2017
Country/TerritoryChina
CityShanghai
Period14/10/1716/10/17

Scopus Subject Areas

  • Health Informatics
  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Biomedical Engineering

User-Defined Keywords

  • Data collection
  • Image Quality
  • Medical image processing
  • Mobile technology
  • Tongue Imaging
  • Traditional Chinese Medicine

Fingerprint

Dive into the research topics of 'Development of a mobile phone based tongue image acquisition system'. Together they form a unique fingerprint.

Cite this