Self-Assessment and Robust Anomaly Detection with Bayesian Deep Learning

Giuseppina Carannante, Dimah Dera, Orune Aminul, Nidhal C. Bouaynaya, Ghulam Rasool

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Deep Learning (DL) models have achieved or even surpassed human-level accuracy in several areas, including computer vision and pattern recognition. The state-of-art performance of DL models has raised the interest in using them in real-world applications, such as disease diagnosis and clinical decision support systems. However, the challenge remains the lack of trustworthiness and reliability of these DL models. The detection of incorrect decisions or flagging suspicious input samples is essential for the reliability of machine learning models. Uncertainty estimation in the output decision is a key component in establishing the trustworthiness and reliability of these models. In this work, we use Bayesian techniques to estimate the uncertainty in the model's output and use this uncertainty to detect distributional shifts linked to both input perturbations and labels shifts. We use the learned uncertainty information (i.e., the variance of the predictive distribution) in two different ways to detect anomalous input samples: 1) a static threshold based on average uncertainty of a model evaluated on the clean test data, and 2) a statistical threshold based on the significant increase in the average uncertainty of the model evaluated on corrupted (anomalous) samples. Our extensive experiments demonstrate that both approaches can detect anomalous samples. We observe that the proposed thresholding techniques can distinguish misclassified examples in the presence of noise, adversarial attacks, anomalies or distributional shifts. For example, when considering corrupted versions of MNIST and CIFAR-10 datasets, the rate of detecting misclassified samples is almost twice as compared to Monte-Carlo-based approaches.

Original languageEnglish (US)
Title of host publication2022 25th International Conference on Information Fusion, FUSION 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781737749721
DOIs
StatePublished - 2022
Event25th International Conference on Information Fusion, FUSION 2022 - Linkoping, Sweden
Duration: Jul 4 2022Jul 7 2022

Publication series

Name2022 25th International Conference on Information Fusion, FUSION 2022

Conference

Conference25th International Conference on Information Fusion, FUSION 2022
Country/TerritorySweden
CityLinkoping
Period7/4/227/7/22

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Information Systems
  • Signal Processing
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'Self-Assessment and Robust Anomaly Detection with Bayesian Deep Learning'. Together they form a unique fingerprint.

Cite this