Ensembling over-segmentations: From weak evidence to strong segmentation

Dong Huang, Jian Huang Lai*, Chang Dong Wang, Pong Chi YUEN

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

23 Citations (Scopus)


Due to the high diversity of image data, image segmentation is still a very challenging problem after decades of development. Each segmentation algorithm has its merits as well as its drawbacks. Instead of segmenting images via conventional techniques, inspired by the idea of the ensemble clustering technique that combines a set of weak clusterers to obtain a strong clusterer, we propose to achieve a consensus segmentation by fusing evidence accumulated from multiple weak segmentations (or over-segmentations). We present a novel image segmentation approach which exploits multiple over-segmentations and achieves segmentation results by hierarchical region merging. The cross-region evidence accumulation (CREA) mechanism is designed for collecting information among over-segmentations. The pixel-pairs across regions are treated as a bag of independent voters and the cumulative votes from multiple over-segmentations are fused to estimate the coherency of adjacent regions. We further integrate the brightness, color, and texture cues for measuring the appearance similarity between regions in an over-segmentation, which, together with the CREA information, are utilized for making the region merging decisions. Experiments are conducted on multiple public datasets, which demonstrate the superiority of our approach in terms of both effectiveness and efficiency when compared to the state-of-the-art.

Original languageEnglish
Pages (from-to)416-427
Number of pages12
Publication statusPublished - 26 Sept 2016

Scopus Subject Areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

User-Defined Keywords

  • Ensemble clustering
  • Ensemble segmentation
  • Image segmentation
  • Over-segmentation
  • Segmentation fusion


Dive into the research topics of 'Ensembling over-segmentations: From weak evidence to strong segmentation'. Together they form a unique fingerprint.

Cite this