Continual Learning (CL) on time series data represents a promising but under-studied avenue for real-world applications. We propose two new CL benchmarks for Human State Monitoring. We carefully designed the benchmarks to mirror real-world environments in which new subjects are continuously added. We conducted an empirical evaluation to assess the ability of popular CL strategies to mitigate forgetting in our benchmarks. Our results show that, possibly due to the domain-incremental properties of our benchmarks, forgetting can be easily tackled even with a simple finetuning and that existing strategies struggle in accumulating knowledge over a fixed, held-out, test subject.
翻译:关于时间序列数据的持续学习(CL)是现实世界应用的一个有希望但研究不足的渠道。我们为人类国家监测提出了两个新的CL基准。我们仔细设计了基准,以反映不断增加新主题的现实世界环境。我们进行了经验评估,以评估流行CL战略的能力,以减缓基准中的遗忘。我们的结果显示,可能由于我们基准的域性特性,人们可以很容易地忘记,即使简单微调,而且现有的战略在固定的、停滞的、测试的课题上积累知识。