[
https://issues.apache.org/jira/browse/ZOOKEEPER-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16804453#comment-16804453
]
Brian Nixon commented on ZOOKEEPER-3318:
----------------------------------------
In the interest of a compact backup, I would like to see a way to combine a
fuzzy snapshot and subsequent transaction logs into a single perfect snapshot
of the data tree. One possible backup solution based on this - start up an
observer process to pull the data tree live to a new directory then a
subsequent operation to combine the resultant files into the perfect snapshot.
> Add a complete backup mechanism for zookeeper internal
> ------------------------------------------------------
>
> Key: ZOOKEEPER-3318
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3318
> Project: ZooKeeper
> Issue Type: New Feature
> Components: other
> Reporter: maoling
> Assignee: maoling
> Priority: Major
>
> We already had some workaround ways for the backup, e.g
> *scenario 1:* just write a cron shell to copy the snapshots periodically.
> *scenario 2:* use the observer as the role of backup, then write the
> snapshots to file system. (e.g HDFS)
> this issue is aiming to implement a complete backup mechanism for zookeeper
> internal:
> the init propose:
> *1*. write a new CLI:snapshot
> *1.1*
> because this CLI may be time-consuming.A confirmation is needed. e.g.
> [zk: 127.0.0.1:2180(CONNECTED) 0] snapshot backupDataDir
> Are you sure to exec:snapshot [yes/no]
> *1.2*
> if no parameter, the default backupDataDir is the dataDir. the format of the
> backup-snapshot is just like: backup_snapshot.f9f800002834 with the "backup_"
> prefix,when recovering,rename backup_snapshot.f9f800002834 to
> snapshot.f9f800002834 and move it to the dataDir, then restart the ensemble.
> *1.3*
> don't worry about exposing the takeSnap() api to the client.Look at this two
> references:
> https://github.com/etcd-io/etcd/blob/master/clientv3/snapshot/v3_snapshot.go
>
> https://github.com/xetorthio/jedis/blob/master/src/main/java/redis/clients/jedis/commands/BasicCommands.java#L68
> *2*.
> *2.1*
> write a new tool/shell: zkBackup.sh which is the reverse proces of the
> zkCleanup.sh for no-realtime backup
> *2.2*
> write a new tool/shell: zkBackup_v2.sh which calls the api of the takeSnap()
> for realtime backup.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
