We study automated intrusion detection in an IT infrastructure, specifically
the problem of identifying the start of an attack, the type of attack, and the
sequence of actions an attacker takes, based on continuous measurements from
the infrastructure. We apply statistical learning methods, including Hidden
Markov Model (HMM), Long Short-Term Memory (LSTM), and Random Forest Classifier
(RFC) to map sequences of observations to sequences of predicted attack
actions. In contrast to most related research, we have abundant data to train
the models and evaluate their predictive power. The data comes from traces we
generate on an in-house testbed where we run attacks against an emulated IT
infrastructure. Central to our work is a machine-learning pipeline that maps
measurements from a high-dimensional observation space to a space of low
dimensionality or to a small set of observation symbols. Investigating
intrusions in offline as well as online scenarios, we find that both HMM and
LSTM can be effective in predicting attack start time, attack type, and attack
actions. If sufficient training data is available, LSTM achieves higher
prediction accuracy than HMM. HMM, on the other hand, requires less
computational resources and less training data for effective prediction. Also,
we find that the methods we study benefit from data produced by traditional
intrusion detection systems like SNORT.
外部データセット
CSE-CIC-IDS2018
DARPA2000
LLDDOS1.0
参考文献
Proceedings of the 13th USENIX Conference on System Administration
Snort - lightweight intrusion detection for networks
M. Roesch
Published: 1999
Cybersecur
Survey of intrusion detection systems: techniques, datasets, and challenges
Khraisat, A., et al.
Published: 2019
IEEE Transactions on Network and Service Management
Learning near-optimal intrusion responses against dynamic attackers
K. Hammar, R. Stadler
Published: 2023
Proceedings of the ML4Cyber workshop, ICML 2022
Learning security strategies through game play and optimal stopping
K. Hammar, R. Stadler
Published: 2022
Proceedings of the IEEE
The viterbi algorithm
G. D. Forney
Published: 1973
IEEE Transactions on dependable and secure computing
Credit card fraud detection using hidden markov model
A. Srivastava, A. Kundu, S. Sural, A. Majumdar
Published: 2008
Lecture notes in computer science
Using hidden markov models to evaluate the risks of intrusions: System architecture and model validation
A. ARNES, F. VALEUR, G. VIGNA, R. A. KEMMERER
Published: 2006
The Scientific World Journal
The application of baum-welch algorithm in multistep attack