Continual Learning is an important and challenging problem in machine learning, where models must adapt to a continuous stream of new data without forgetting previously acquired knowledge. While existing frameworks are built on PyTorch, the rising popularity of JAX might lead to divergent codebases, ultimately hindering reproducibility and progress. To address this problem, we introduce SequeL, a flexible and extensible library for Continual Learning that supports both PyTorch and JAX frameworks. SequeL provides a unified interface for a wide range of Continual Learning algorithms, including regularization-based approaches, replay-based approaches, and hybrid approaches. The library is designed towards modularity and simplicity, making the API suitable for both researchers and practitioners. We release SequeL\footnote{\url{https://github.com/nik-dim/sequel}} as an open-source library, enabling researchers and developers to easily experiment and extend the library for their own purposes.
翻译:连续学习是机器学习中一个重要且具有挑战性的问题,模型需要适应连续的新数据流,而不会忘记先前获取的知识。现有框架都基于 PyTorch,而 JAX 越来越受欢迎,可能导致代码库分化,最终阻碍了再现性和进展。为解决这个问题,我们介绍 SequeL,一个灵活且可扩展的连续学习库,支持 PyTorch 和 JAX 框架。SequeL 提供了统一的界面,支持广泛的连续学习算法,包括基于正则化的方法、基于重放的方法和混合方法。该库设计易于模块化和简化,使 API 适用于研究人员和实践者。我们作为开源库发布 SequeL,使研究人员和开发人员能够轻松地为自己的目的实验和扩展该库。