Data acquisition and recording in the form of databases are routine operations. The process of collecting data, however, may experience irregularities, resulting in databases with missing data. Missing entries might alter analysis efficiency and, consequently, the associated decision-making process. This paper focuses on databases collecting information related to the natural environment. Given the broad spectrum of recorded activities, these databases typically are of mixed nature. It is therefore relevant to evaluate the performance of missing data processing methods considering this characteristic. In this paper we investigate the performances of several missing data imputation methods and their application to the problem of missing data in environment. A computational study was performed to compare the method missForest (MF) with two other imputation methods, namely Multivariate Imputation by Chained Equations (MICE) and K-Nearest Neighbors (KNN). Tests were made on 10 pretreated datasets of various types. Results revealed that MF generally outperformed MICE and KNN in terms of imputation errors, with a more pronounced performance gap for mixed typed databases where MF reduced the imputation error up to 150%, when compared to the other methods. KNN was usually the fastest method. MF was then successfully applied to a case study on Quebec wastewater treatment plants performance monitoring. We believe that the present study demonstrates the pertinence of using MF as imputation method when dealing with missing environmental data.
翻译:以数据库形式获取和记录数据的过程是例行作业。但是,收集数据的过程可能会出现不合规定的情况,导致缺少数据的数据库。缺失的条目可能会改变分析效率,从而改变相关的决策程序。本文件侧重于收集与自然环境有关的信息的数据库。鉴于所记录的活动范围很广,这些数据库通常具有混合性质。因此,有必要评估考虑到这一特点的缺失数据处理方法的性能。在本文件中,我们调查了一些缺失的数据估算方法的性能及其对环境缺失数据问题的应用。进行了计算研究,将方法误差(MF)与其他两种估算方法,即链式计算(MICE)和K-Nest Nearribirdbors(KNNN)的多变式计算方法进行比较,将方法误差(MF)与另外两种估算方法(MFR)的误差率降低到150%,而当时通常采用最快的MFM处理方法,然后用最新的方法来进行测试。我们认为,目前采用的是最快的MF方法,而现在采用的是最快的方法。我们通常采用这种方法来测试。