Practical Hybrid Beamforming for Millimeter Wave Massive MIMO Full Duplex with Limited Dynamic Range

In this paper, we present a novel joint hybrid beamforming (HYBF) and combining scheme in a single-cell millimeter wave (mmWave) massive MIMO full-duplex (FD) system for weighted sum-rate (WSR) maximization with multi-antenna half-duplex (HD) uplink and downlink users with non-ideal hardware. Moreover, we present a novel interference and self-interference (SI) aware power allocation scheme for the optimal beamforming directions. Compared to the traditional sum-power constraints, the proposed algorithm is designed under the joint sum-power and per-antenna power constraints. The sum-power constraints are naturally imposed to limit the maximum transmission power. However, each antenna has its power amplifier (PA), and the per-antenna power constraints consider the physical limits of each PA while maximizing the communication system's performance. To model the non-ideal hardware of the FD base station and the half-duplex users, we extend the traditional limited dynamic range (LDR) noise model to mmWave with a FD hybrid transceiver. Our design relies on alternating optimization based on the minorization-maximization method. A detailed numerical analysis is presented, and the impact of the different levels of the LDR noise variance on the maximum achievable performance for HYBF in a practical FD system is investigated. Simulation results show significant performance improvement compared to the traditional HD system. However, the maximum achievable performance gain results to be limited by the LDR noise level.