Widespread access to connectivity takes its toll on wireless spectrum and the ever-growing demand as well potential spectral inefficiencies, which are exasperated under static allocation paradigms. In this paper, we investigate a new framework of Deep Reinforcement Learning Based Cognitive Radio (DRL-CR) which combines A3C agent with CNN based spectrum feature extraction and enables dynamic and autonomous access to the cordial space. In contrast to traditional energy-detection or single-agent DQN scenarios, the proposed system allows a secondary-user (SU) agent to develop an optimal policy for channel selection and power adaptation directly from raw spectrum inputs, without requiring any explicit knowledge of the radio environment or PU activity statistics [1]. In A3C, these states are explored in parallel actor-learner threads with the goal of launching a myriad of state exploration at any one time to find converging policy faster and reduce gradient variance. Through MATLAB-based simulations in a ten-channel wideband cognitive radio scenario, we show that the proposed DRL-CR obtains 42.6 Mbps throughput with corresponding gains of 35.2% over DQN-based baselines, and attains spectrum detection probability of 0.96, along with false alarm rates as low as 0.03. Meanwhile, the framework features 89% average spectrum utilization and reaches 4.7 bits/Joule energy efficiency, confirming it is ready for deployment in both 5G heterogeneous networks, IoT ecosystems and spectrum-scarce emergency communication scenarios alike.
发表评论