Beamforming and Power Control in Sensor Arrays Using Reinforcement Learning

• Published in: Sensors (Basel, Switzerland) Vol. 15; no. 3; pp. 6668 - 6687
• Main Authors: Almeida, Náthalee, Fernandes, Marcelo, Neto, Adrião
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 19.03.2015; MDPI
• Subjects: Algorithms; Arrays; Beamforming; Learning; Policies; Power control; Q-learning; Receivers & amplifiers; Reinforcement; Sensor arrays; Sensors; Signal reception; Brazil
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s150306668

The use of beamforming and power control, combined or separately, has advantages and disadvantages, depending on the application. The combined use of beamforming and power control has been shown to be highly effective in applications involving the suppression of interference signals from different sources. However, it is necessary to identify efficient methodologies for the combined operation of these two techniques. The most appropriate technique may be obtained by means of the implementation of an intelligent agent capable of making the best selection between beamforming and power control. The present paper proposes an algorithm using reinforcement learning (RL) to determine the optimal combination of beamforming and power control in sensor arrays. The RL algorithm used was Q-learning, employing an ε-greedy policy, and training was performed using the offline method. The simulations showed that RL was effective for implementation of a switching policy involving the different techniques, taking advantage of the positive characteristics of each technique in terms of signal reception.