Outlier detection in large-scale traffic data by Naïve Bayes method and Gaussian mixture model method

Philip Lam, Lili Wang, Henry Y T NGAN, Nelson H.C. Yung, Anthony G.O. Yeh

Research output: Contribution to journalConference articlepeer-review

7 Citations (Scopus)

Abstract

It is meaningful to detect outliers in traffic data for traffic management. However, this is a massive task for people from large-scale database to distinguish outliers. In this paper, we present two methods: Kernel Smoothing Naïve Bayes (NB) method and Gaussian Mixture Model (GMM) method to automatically detect any hardware errors as well as abnormal traffic events in traffic data collected at a four-arm junction in Hong Kong. Traffic data was recorded in a video format, and converted to spatial-temporal (ST) traffic signals by statistics. The ST signals are then projected to a two-dimensional (2D) (x, y)-coordinate plane by Principal Component Analysis (PCA) for dimension reduction. We assume that inlier data are normal distributed. As such, the NB and GMM methods are successfully applied in OD (Outlier Detection) for traffic data. The kernel smooth NB method assumes the existence of kernel distributions in traffic data and uses Bayes' Theorem to perform OD. In contrast, the GMM method believes the traffic data is formed by the mixture of Gaussian distributions and exploits confidence region for OD. This paper would address the modeling of each method and evaluate their respective performances. Experimental results show that the NB algorithm with Triangle kernel and GMM method achieve up to 93.78% and 94.50% accuracies, respectively.

Original languageEnglish
Pages (from-to)73-78
Number of pages6
JournalIS and T International Symposium on Electronic Imaging Science and Technology
DOIs
Publication statusPublished - 2017
EventIntelligent Robotics and Industrial Applications using Computer Vision 2017, IRIACV 2017 - Burlingame, United States
Duration: 29 Jan 20172 Feb 2017

Scopus Subject Areas

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Human-Computer Interaction
  • Software
  • Electrical and Electronic Engineering
  • Atomic and Molecular Physics, and Optics

Fingerprint

Dive into the research topics of 'Outlier detection in large-scale traffic data by Naïve Bayes method and Gaussian mixture model method'. Together they form a unique fingerprint.

Cite this