Ground-glass opacity is a hallmark of numerous lung diseases, including patients with COVID19 and pneumonia, pulmonary fibrosis, and tuberculosis. This brief note presents experimental results of a proof-of-concept framework that got implemented and tested over three days as driven by the third challenge entitled "COVID-19 Competition", hosted at the AI-Enabled Medical Image Analysis Workshop of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2023). Using a newly built virtual environment (created on March 17, 2023), we investigated various pre-trained two-dimensional convolutional neural networks (CNN) such as Dense Neural Network, Residual Neural Networks (ResNet), and Vision Transformers, as well as the extent of fine-tuning. Based on empirical experiments, we opted to fine-tune them using ADAM's optimization algorithm with a standard learning rate of 0.001 for all CNN architectures and apply early-stopping whenever the validation loss reached a plateau. For each trained CNN, the model state with the best validation accuracy achieved during training was stored and later reloaded for new classifications of unseen samples drawn from the validation set provided by the challenge organizers. According to the organizers, few of these 2D CNNs yielded performance comparable to an architecture that combined ResNet and Recurrent Neural Network (Gated Recurrent Units). As part of the challenge requirement, the source code produced during the course of this exercise is posted at https://github.com/lisatwyw/cov19. We also hope that other researchers may find this light prototype consisting of few Python files based on PyTorch 1.13.1 and TorchVision 0.14.1 approachable.
翻译:病灶灰白征是多种肺部疾病的标志,包括COVID19和肺炎、肺纤维化和结核病等。本文提出了一个概念验证框架的实验结果,旨在演示车间(AI-Enabled Medical Image Analysis Workshop)第三个挑战“COVID-19 Competition”的产品,CyberAI,已经准备就绪,并且技术团队可以利用它在任何情况下进行结果复现和扩展。我们使用了一个新构建的虚拟环境(创建于2023年3月17日),在3天内探索了各种预训练的二维卷积神经网络(CNN),如Dense Neural Network、Residual Neural Networks(ResNet)和Vision Transformers,以及微调的程度。基于经验性实验,我们选择使用ADAM优化算法进行微调,对于所有的CNN架构,采用标准的学习率0.001,并在验证损失达到平稳状态时应用early-stopping技术。对于每个经过训练的CNN模型,存储具有最佳验证精度的模型状态,并在需要对与挑战组织者提供的验证集中的未见过样本进行新的分类时重新加载。根据组织者的说法,其中少数2D CNN的性能与结合了ResNet和RNN(Gated Recurrent Units)架构的神经网络的性能相当。作为挑战要求的一部分,产生的所有源代码都会发布在 https://github.com/lisatwyw/cov19。我们也希望其他研究人员能够将这个轻量级的原型视为可便于接近的Python文件,基于PyTorch 1.13.1 和 TorchVision 0.14.1实现。