RocksDBStateBackend支持增量检查点,而FsStateBackend不支持

huangapple go评论50阅读模式
英文:

RocksDBStateBackend supports incremental checkpoint while FsStateBackend doesn't

问题

对于FsStateBackend,本地检查点数据保存在内存中,而远程持久化检查点数据保存在分布式文件系统中,比如HDFS。

对于RocksDBStateBackend,本地检查点数据保存在本地的RocksDB中,而远程持久化检查点数据也保存在分布式文件系统中,比如HDFS。

所以,我想知道为什么FsStateBackend不提供增量检查点功能,因为它与RocksDBStateBackend相同,它们都将远程持久化检查点数据存储在分布式文件系统上,比如HDFS。

英文:

For FsStateBackend, local checkpoint data are saved in memory, and remote persistent checkpoint data are saved in distributed file system,such as HDFS

For RocksDBStateBackend,local checkpoint data are saved in local RocksDB, and remote persistent checkpoint data is also saved in distributed file system,such as HDFS.

So, I wonder why FsStateBackend doesn't provide the incremental checkpoint capabilities, since it is the same as RocksDBStateBackend,both of them store remote persistent checkpoint data on the distributed file system like HDFS.

答案1

得分: 1

FsStateBackend 是一个传统类,等同于使用 HashMapStateBackendFileSystemCheckpointStorage(请参阅此文档)。增量检查点的问题在于 HashMapStateBackend 尚不支持(但正在进行工作以添加支持)。

英文:

FsStateBackend is a legacy class, equivalent to using HashMapStateBackend and FileSystemCheckpointStorage (see this documentation). The issue with incremental checkpoints is that it's not (yet) supported by the HashMapStateBackend, though work is underway to add that.

huangapple
  • 本文由 发表于 2023年3月3日 19:30:24
  • 转载请务必保留本文链接:https://go.coder-hub.com/75626546.html
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定