Drift-Aware Real-Time Intrusion Detection for IoT Data Streams via Incremental Hoeffding Tree Learning
编号:177
访问权限:仅限参会人
更新:2026-11-10 17:02:52 浏览:10次
Online
摘要
Securing the Internet of Things poses a challenge that sits at the intersection of hardware scarcity and data velocity: edge nodes operate under severe compute budgets yet must make millisecond-scale security decisions against continuously evolv-ing attack traffic. Batch-trained classifiers impose mandatory retraining pauses that leave the network unguarded whenever attack behaviour drifts beyond a historical training boundary, while signature engines remain permanently blind to novel threat patterns. This paper describes a stream-native detection framework built around an incrementally trained Hoeffding Tree that processes every incoming flow record exactly once, in the order of arrival, without retaining historical data or interrupting classification for model updates. Raw IoT device traffic is ingested through an Apache Kafka message bus, per-flow statistics are materialised inside five-second tumbling windows managed by Apache Flink, and each resulting feature vector is forwarded to a River HoeffdingTreeClassifier that issues a prediction before absorbing the verified ground-truth label. Concept drift at individual decision tree leaves is identified and addressed by ADWIN, a statistically grounded change-detection component that resets only the subtrees affected by distributional shifts, leaving stable branches undisturbed. The complete pipeline was evaluated against 650,000 labelled flow records from the CICIoT 2025 and benchmark dataset under a strictly prequential assessment protocol, which prohibits any sample from informing a prediction made before its arrival. The system attained a macro-average accuracy of 94.3% and a corresponding F1-score of 94.4%, with a median end-to-end detection latency of 47 ms on commodity workstation hardware. SYN flood events were resolved at 97.4% accuracy in a median of 38 ms. Following a controlled mid-stream regime substitution, the drift-aware configuration recovered to stable accuracy approximately 35% faster than the non-adaptive baseline, confirming that localised leaf resetting maintains detection quality as attack patterns evolve without disrupting branches where no change has occurred.
Index Terms—IoT intrusion detection; Hoeffding Tree; online machine learning; Apache Flink; stream processing; ADWIN; CICIoT 2025; concept drift; real-time anomaly detection
关键词
Intrusion Detection System (IDS),Network Security,Machine Learning, Hoeffding Tree,Data Stream Mining,Concept Drift
发表评论