Performance evaluation of anomaly detection in imbalanced system log data

Studiawan, H. and Sohel, F. (2020) Performance evaluation of anomaly detection in imbalanced system log data. In: 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4), 27 - 28 July 2020, London, UK

Abstract

An administrator needs to examine operating system log files for any anomalous events. In real-life log data, the number of anomalies is often smaller than the normal ones. This imbalance situation affects the performance of the anomaly detectors because a large number of normal events feed the training of the classifier. In this paper, we evaluate popular machine learning methods and consider this problem of data imbalance. We compare data oversampling and undersampling approaches before inputting them to the classifier. Experimental results demonstrate that by taking data imbalance into consideration, there is an improvement in the method performance in terms of precision and recall scores.

Item Type:	Conference Paper
Murdoch Affiliation(s):	Information Technology, Mathematics and Statistics
URI:	http://researchrepository.murdoch.edu.au/id/eprint/58706

Item Control Page