Experience report: Anomaly detection of cloud application operations using log and cloud metric correlation analysis

Mostafa Farshchi, Jean Guy Schneider, Ingo Weber, John Grundy

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

76 Scopus citations

Abstract

Failure of application operations is one of the main causes of system-wide outages in cloud environments. This particularly applies to DevOps operations, such as backup, redeployment, upgrade, customized scaling, and migration that are exposed to frequent interference from other concurrent operations, configuration changes, and resources failure. However, current practices fail to provide a reliable assurance of correct execution of these kinds of operations. In this paper, we present an approach to address this problem that adopts a regression-based analysis technique to find the correlation between an operation's activity logs and the operation activity's effect on cloud resources. The correlation model is then used to derive assertion specifications, which can be used for runtime verification of running operations and their impact on resources. We evaluated our proposed approach on Amazon EC2 with 22 rounds of rolling upgrade operations while other types of operations were running and random faults were injected. Our experiment shows that our approach successfully managed to raise alarms for 115 random injected faults, with a precision of 92.3%.

Original languageEnglish
Title of host publication2015 IEEE 26th International Symposium on Software Reliability Engineering, ISSRE 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages24-34
Number of pages11
ISBN (Electronic)9781509004065
DOIs
StatePublished - 13 Jan 2016
Externally publishedYes
Event26th IEEE International Symposium on Software Reliability Engineering, ISSRE 2015 - Gaithersbury, United States
Duration: 2 Nov 20155 Nov 2015

Publication series

Name2015 IEEE 26th International Symposium on Software Reliability Engineering, ISSRE 2015

Conference

Conference26th IEEE International Symposium on Software Reliability Engineering, ISSRE 2015
Country/TerritoryUnited States
CityGaithersbury
Period2/11/155/11/15

Keywords

  • Cloud application operations
  • Cloud monitoring
  • DevOps
  • anomaly detection
  • error detection
  • log analysis

Fingerprint

Dive into the research topics of 'Experience report: Anomaly detection of cloud application operations using log and cloud metric correlation analysis'. Together they form a unique fingerprint.

Cite this