ReDas: Supporting Fine-Grained Reshaping and Multiple Dataflows on Systolic Array

Current systolic arrays still suffer from low performance and PE utilization on many real workloads due to the mismatch between the fixed array topology and diverse DNN kernels. We present ReDas, a flexible and lightweight systolic array that can adapt to various DNN models by supporting dynamic fine-grained reshaping and multiple dataflows. The key idea is to construct reconfigurable roundabout data paths using only the short connections between neighbor PEs. The array with 128$\times$128 size supports 129 different logical shapes and 3 dataflows (IS/OS/WS). Experiments on DNN models of MLPerf demonstrate that ReDas can achieve 3.09x speedup on average compared to state-of-the-art work.