Hello Will Berkeley, Mike Percy, Kudu Jenkins, Adar Dembo, I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/12879 to look at the new patch set (#2). Change subject: WIP: [backup] Add incremental backup/restore support ...................................................................... WIP: [backup] Add incremental backup/restore support This patch adds initial support for incremental backup and restore. A high level overview of the changes in this patch is: - Added a version to the TableMetadata for future use. - Broke out io/layout logic to a SessionIO class so it could be easily shared. - Unified the BackupOptions and RestoreOptions so common options could be shared. - Introduced a BackupGraph class to handle chaining together backups for backup and restore jobs. - Enhanced the BackupRDD to output an additional RowAction byte column on backup and restore. - Enhanced the restore job to use the new RowAction column and translate them into operations for incremental restore jobs. - Added the ability to restore to a given “time” on a per backup basis. - Added example usage docs to the Backup and Restore classes. - Added hasIsDeleted to RowResult and hasColumn to Schema. TODO: More testing and docs. Change-Id: I50b21d921fefbf4d7e8bd1766285258e8014d890 --- M java/kudu-backup/src/main/protobuf/backup.proto A java/kudu-backup/src/main/scala/org/apache/kudu/backup/BackupGraph.scala M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackup.scala D java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackupOptions.scala M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackupRDD.scala M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduRestore.scala D java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduRestoreOptions.scala A java/kudu-backup/src/main/scala/org/apache/kudu/backup/Options.scala A java/kudu-backup/src/main/scala/org/apache/kudu/backup/RowAction.java A java/kudu-backup/src/main/scala/org/apache/kudu/backup/SessionIO.scala M java/kudu-backup/src/main/scala/org/apache/kudu/backup/TableMetadata.scala A java/kudu-backup/src/test/scala/org/apache/kudu/backup/TestBackupGraph.scala M java/kudu-backup/src/test/scala/org/apache/kudu/backup/TestKuduBackup.scala M java/kudu-client/src/main/java/org/apache/kudu/Schema.java M java/kudu-client/src/main/java/org/apache/kudu/client/AsyncKuduScanner.java M java/kudu-client/src/main/java/org/apache/kudu/client/RowResult.java M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/RowConverter.scala M java/kudu-spark/src/test/scala/org/apache/kudu/spark/kudu/KuduTestSuite.scala 18 files changed, 1,065 insertions(+), 389 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/79/12879/2 -- To view, visit http://gerrit.cloudera.org:8080/12879 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I50b21d921fefbf4d7e8bd1766285258e8014d890 Gerrit-Change-Number: 12879 Gerrit-PatchSet: 2 Gerrit-Owner: Grant Henke <granthe...@apache.org> Gerrit-Reviewer: Adar Dembo <a...@cloudera.com> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Mike Percy <mpe...@apache.org> Gerrit-Reviewer: Will Berkeley <wdberke...@gmail.com>