This article proposes and documents a machine-learning framework and tutorial for classifying images using mobile phones. Compared to computers, the performance of deep learning model performance degrades when deployed on a mobile phone and requires a systematic approach to find a model that performs optimally on both computers and mobile phones. By following the proposed pipeline, which consists of various computational tools, simple procedural recipes, and technical considerations, one can bring the power of deep learning medical image classification to mobile devices, potentially unlocking new domains of applications. The pipeline is demonstrated on four different publicly available datasets: COVID X-rays, COVID CT scans, leaves, and colorectal cancer. We used two application development frameworks: TensorFlow Lite (real-time testing) and Flutter (digital image testing) to test the proposed pipeline. We found that transferring deep learning models to a mobile phone is limited by hardware and classification accuracy drops. To address this issue, we proposed this pipeline to find an optimized model for mobile phones. Finally, we discuss additional applications and computational concerns related to deploying deep-learning models on phones, including real-time analysis and image preprocessing. We believe the associated documentation and code can help physicians and medical experts develop medical image classification applications for distribution.
翻译:与计算机相比,深学习模型性能的性能在移动电话上部署时会退化,要求采取系统的方法寻找一种在计算机和移动电话上最优化地发挥功能的模式。 遵循由各种计算工具、简单程序配方和技术考虑组成的拟议管道,我们可以将深学习医学图像分类的力量带给移动设备,有可能打开新的应用领域。与计算机相比,该管道在四种不同的公开数据集上展示:COVID X光、COVIDCT扫描、叶片和染色癌。我们使用了两种应用开发框架:TensorFlow Lite(实时测试)和Flutter(数字图像测试)来测试拟议管道。我们发现,将深学习模型转移到移动电话受到硬件和分类精度下降的限制。为解决这一问题,我们建议该管道为移动电话找到一个优化的模型。最后,我们讨论了与在手机上部署深学习模型有关的额外应用和计算问题,包括实时分析和图像应用前我们相信,为医疗分类和图像应用开发了相关文件。