Practical Hybrid Beamforming for Millimeter Wave Massive MIMO Full Duplex with Limited Dynamic Range

Full-Duplex (FD) communication can revolutionize wireless communications as it doubles spectral efficiency and offers numerous other advantages over a half-duplex (HD) system. In this paper, we present a novel and practical joint hybrid beamforming (HYBF) and combining scheme for millimeter-wave (mmWave) massive MIMO FD system for weighted sum-rate (WSR) maximization with multi-antenna HD uplink and downlink users with non-ideal hardware. Moreover, we present a novel interference and self-interference (SI) aware optimal power allocation scheme for the optimal beamforming directions. The analog processing stage is assumed to be quantized, and both the unit-modulus and unconstrained cases are considered. Moreover, compared to the traditional sum-power constraints, the proposed algorithm is designed under the joint sum-power and the practical per-antenna power constraints. To model the non-ideal hardware of a hybrid FD transceiver, we extend the traditional limited dynamic range (LDR) noise model to mmWave. Our HYBF design relies on alternating optimization based on the minorization-maximization method. We investigate the maximum achievable gain of a hybrid FD system with different levels of the LDR noise variance and with different numbers of radio-frequency (RF) chains over a HD system. Simulation results show that the mmWave massive MIMO FD systems can significantly outperform the fully digital HD systems with only a few RF chains if the LDR noise generated from the limited number of RF chains available is low. If the LDR noise variance dominates, FD communication with HYBF results to be disadvantageous than a HD system.