Decentralized Storage Networks (DSNs) can gather storage resources from mutually untrusted providers and form worldwide decentralized file systems. Compared to traditional storage networks, DSNs are built on top of blockchains, which can incentivize service providers and ensure strong security. However, existing DSNs face two major challenges. First, deduplication can only be achieved at the directory-level. Missing file-level deduplication leads to unavoidable extra storage and bandwidth cost. Second, current DSNs realize file indexing by storing extra metadata while blockchain ledgers are not fully exploited. To overcome these problems, we propose FileDAG, a DSN built on DAG-based blockchain to support file-level deduplication in storing multi-versioned files. When updating files, we adopt an increment generation method to calculate and store only the increments instead of the entire updated files. Besides, we introduce a two-layer DAG-based blockchain ledger, by which FileDAG can provide flexible and storage-saving file indexing by directly using the blockchain database without incurring extra storage overhead. We implement FileDAG and evaluate its performance with extensive experiments. The results demonstrate that FileDAG outperforms the state-of-the-art industrial DSNs considering storage cost and latency.
翻译:分散存储网络(DSNs)可以收集来自互不信任的供应商的存储资源,并形成全球分散的文件系统。与传统的存储网络相比,DSNs建在块链的顶端,可以激励服务供应商并确保强有力的安全。然而,现有的DSNs面临两大挑战。首先,只有目录一级才能实现重复。缺失的文件级拆解会导致不可避免的额外存储和带宽成本。第二,目前的DSNs通过储存额外元数据实现文件索引化,而块链分类账则没有得到充分利用。为解决这些问题,我们提议在基于 DAG 的块链上建立DSNAG, 以支持储存多版本文件的文档的档案级消减。在更新文件时,我们采用递增生成方法来计算和存储增量,而不是全部更新的文档。此外,我们引入了基于双层 DAG的链分类,通过直接使用块链数据库提供灵活和储存保存文件索引化。我们实施了FileDAG, 并且用广泛的存储成本模型来评估其运行情况。我们实施了FDEDAG, 考虑广泛的存储模式。