Accurate image reconstruction is crucial for photoacoustic (PA) computed tomography (PACT). Recently, deep learning has been used to reconstruct the PA image with a supervised scheme, which requires high-quality images as ground truth labels. In practice, there are inevitable trade-offs between cost and performance since the use of more channels is an expensive strategy to access more measurements. Here, we propose a cross-domain unsupervised reconstruction (CDUR) strategy with a pure transformer model, which overcomes the lack of ground truth labels from limited PA measurements. The proposed approach exploits the equivariance of PACT to achieve high performance with a smaller number of channels. We implement a self-supervised reconstruction in a model-based form. Meanwhile, we also leverage the self-supervision to enforce the measurement and image consistency on three partitions of measured PA data, by randomly masking different channels. We find that dynamically masking a high proportion of the channels, e.g., 80%, yields nontrivial self-supervisors in both image and signal domains, which decrease the multiplicity of the pseudo solution to efficiently reconstruct the image from fewer PA measurements with minimum error of the image. Experimental results on in-vivo PACT dataset of mice demonstrate the potential of our unsupervised framework. In addition, our method shows a high performance (0.83 structural similarity index (SSIM) in the extreme sparse case with 13 channels), which is close to that of supervised scheme (0.77 SSIM with 16 channels). On top of all the advantages, our method may be deployed on different trainable models in an end-to-end manner.
翻译:精确的图像重建对于光声学(PA) 计算断层图像(PACT) 至关重要。 最近,利用了深层次的学习来重建 PA图像, 以受监督的方案重建PA图像, 这需要高质量的图像作为地面真相标签。 在实践中, 成本和性能之间不可避免地发生权衡, 因为使用更多频道是一种获取更多测量的昂贵战略。 在这里, 我们建议采用一个纯变压器( CDUR) 战略, 以纯的变压器模式, 克服巴勒斯坦权力机构有限的测量中缺少地面真相标签的情况。 拟议的方法利用 PACT 的变压器, 以较少的频道实现高性能。 我们以模型的形式进行自我监督的重建。 同时, 我们还利用自我监督的视野, 通过随机遮盖不同频道, 来强制测量已测量的 PAP 数据的三个分区的测量和图像的一致性。 我们发现, 在图像和信号域的近距离域域中, 将产生非高度的自我监督的自我监督器。 在图像上, 我们的模型中, 最差的模型中, 最差的模型 将显示我们最差的模型 。