[jira] [Commented] (HBASE-21219) Hbase incremental backup fails with null pointer exception
[ https://issues.apache.org/jira/browse/HBASE-21219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641050#comment-16641050 ] Hudson commented on HBASE-21219: Results for branch master [build #530 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/530/]: (x) *{color:red}-1 overall{color}* details (if available): (x) {color:red}-1 general checks{color} -- Something went wrong running this stage, please [check relevant console output|https://builds.apache.org/job/HBase%20Nightly/job/master/530//console]. (x) {color:red}-1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/master/530//JDK8_Nightly_Build_Report_(Hadoop2)/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://builds.apache.org/job/HBase%20Nightly/job/master/530//JDK8_Nightly_Build_Report_(Hadoop3)/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Hbase incremental backup fails with null pointer exception > -- > > Key: HBASE-21219 > URL: https://issues.apache.org/jira/browse/HBASE-21219 > Project: HBase > Issue Type: Bug > Components: backup&restore >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov >Priority: Major > Fix For: 3.0.0 > > Attachments: HBASE-21219-v1.patch > > > hbase backup create incremental hdfs:///bkpHbase_Test/bkpHbase_Test2 -t > bkpHbase_Test2 > 2018-09-21 15:35:31,421 INFO [main] impl.TableBackupClient: Backup > backup_1537524313995 started at 1537524331419. 2018-09-21 15:35:31,454 INFO > [main] impl.IncrementalBackupManager: Execute roll log procedure for > incremental backup ... 2018-09-21 15:35:32,985 ERROR [main] > impl.TableBackupClient: Unexpected Exception : java.lang.NullPointerException > java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > 2018-09-21 15:35:32,989 ERROR [main] impl.TableBackupClient: > BackupId=backup_1537524313995,startts=1537524331419,failedts=1537524332989,failedphase=PREPARE_INCREMENTAL,failedmessage=null > 2018-09-21 15:35:57,167 ERROR [main] impl.TableBackupClient: Backup > backup_1537524313995 failed. > Backup session finished. Status: FAILURE 2018-09-21 15:35:57,175 ERROR [main] > backup.BackupDriver: Error running > command-line tool java.io.IOException: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:281) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > Caused by: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > ... 7 more -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21219) Hbase incremental backup fails with null pointer exception
[ https://issues.apache.org/jira/browse/HBASE-21219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640850#comment-16640850 ] Vladimir Rodionov commented on HBASE-21219: --- go ahead, [~te...@apache.org] > Hbase incremental backup fails with null pointer exception > -- > > Key: HBASE-21219 > URL: https://issues.apache.org/jira/browse/HBASE-21219 > Project: HBase > Issue Type: Bug > Components: backup&restore >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov >Priority: Major > Fix For: 3.0.0 > > Attachments: HBASE-21219-v1.patch > > > hbase backup create incremental hdfs:///bkpHbase_Test/bkpHbase_Test2 -t > bkpHbase_Test2 > 2018-09-21 15:35:31,421 INFO [main] impl.TableBackupClient: Backup > backup_1537524313995 started at 1537524331419. 2018-09-21 15:35:31,454 INFO > [main] impl.IncrementalBackupManager: Execute roll log procedure for > incremental backup ... 2018-09-21 15:35:32,985 ERROR [main] > impl.TableBackupClient: Unexpected Exception : java.lang.NullPointerException > java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > 2018-09-21 15:35:32,989 ERROR [main] impl.TableBackupClient: > BackupId=backup_1537524313995,startts=1537524331419,failedts=1537524332989,failedphase=PREPARE_INCREMENTAL,failedmessage=null > 2018-09-21 15:35:57,167 ERROR [main] impl.TableBackupClient: Backup > backup_1537524313995 failed. > Backup session finished. Status: FAILURE 2018-09-21 15:35:57,175 ERROR [main] > backup.BackupDriver: Error running > command-line tool java.io.IOException: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:281) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > Caused by: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > ... 7 more -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21219) Hbase incremental backup fails with null pointer exception
[ https://issues.apache.org/jira/browse/HBASE-21219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640845#comment-16640845 ] Ted Yu commented on HBASE-21219: Ping [~vrodionov] If you agree with my comment above, I can adjust the log level upon commit. > Hbase incremental backup fails with null pointer exception > -- > > Key: HBASE-21219 > URL: https://issues.apache.org/jira/browse/HBASE-21219 > Project: HBase > Issue Type: Bug > Components: backup&restore >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov >Priority: Major > Fix For: 3.0.0 > > Attachments: HBASE-21219-v1.patch > > > hbase backup create incremental hdfs:///bkpHbase_Test/bkpHbase_Test2 -t > bkpHbase_Test2 > 2018-09-21 15:35:31,421 INFO [main] impl.TableBackupClient: Backup > backup_1537524313995 started at 1537524331419. 2018-09-21 15:35:31,454 INFO > [main] impl.IncrementalBackupManager: Execute roll log procedure for > incremental backup ... 2018-09-21 15:35:32,985 ERROR [main] > impl.TableBackupClient: Unexpected Exception : java.lang.NullPointerException > java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > 2018-09-21 15:35:32,989 ERROR [main] impl.TableBackupClient: > BackupId=backup_1537524313995,startts=1537524331419,failedts=1537524332989,failedphase=PREPARE_INCREMENTAL,failedmessage=null > 2018-09-21 15:35:57,167 ERROR [main] impl.TableBackupClient: Backup > backup_1537524313995 failed. > Backup session finished. Status: FAILURE 2018-09-21 15:35:57,175 ERROR [main] > backup.BackupDriver: Error running > command-line tool java.io.IOException: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:281) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > Caused by: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > ... 7 more -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21219) Hbase incremental backup fails with null pointer exception
[ https://issues.apache.org/jira/browse/HBASE-21219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626653#comment-16626653 ] Hadoop QA commented on HBASE-21219: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 11s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s{color} | {color:green} Patch does not have any anti-patterns. {color} | | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange} 0m 0s{color} | {color:orange} The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color} | || || || || {color:brown} master Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 21s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 29s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 14s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m 21s{color} | {color:green} branch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 35s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 15s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 6s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 27s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 27s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 14s{color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m 0s{color} | {color:red} The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply {color} | | {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m 16s{color} | {color:green} patch has no errors when building our shaded downstream artifacts. {color} | | {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green} 12m 14s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4 or 3.0.0. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 17s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green} 13m 36s{color} | {color:green} hbase-backup in the patch passed. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 15s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 49m 19s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b | | JIRA Issue | HBASE-21219 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12941132/HBASE-21219-v1.patch | | Optional Tests | asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 77fb748a30ce 3.13.0-143-generic #192-Ubuntu SMP Tue Feb 27 10:45:36 UTC 2018 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build@2/component/dev-support/hbase-personality.sh | | git revision | master / 7ab77518a2 | | maven | version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) | | Default Java | 1.8.0_181 | | findbugs | v3.1.0-RC3 | | whitespace | https://builds.apache.org/job/PreCommit-HBASE-Build/14488/artifact/patchprocess/whitespace-eol.txt | | Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/14488/
[jira] [Commented] (HBASE-21219) Hbase incremental backup fails with null pointer exception
[ https://issues.apache.org/jira/browse/HBASE-21219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626634#comment-16626634 ] Ted Yu commented on HBASE-21219: {code} 307 LOG.warn("Known hosts (from newestTimestamps):"); 308 for (String s: newestTimestamps.keySet()) { 309 LOG.warn(s); {code} The above seems to be for debug purpose. Use LOG.debug ? > Hbase incremental backup fails with null pointer exception > -- > > Key: HBASE-21219 > URL: https://issues.apache.org/jira/browse/HBASE-21219 > Project: HBase > Issue Type: Bug > Components: backup&restore >Reporter: Vladimir Rodionov >Assignee: Vladimir Rodionov >Priority: Major > Fix For: 3.0.0 > > Attachments: HBASE-21219-v1.patch > > > hbase backup create incremental hdfs:///bkpHbase_Test/bkpHbase_Test2 -t > bkpHbase_Test2 > 2018-09-21 15:35:31,421 INFO [main] impl.TableBackupClient: Backup > backup_1537524313995 started at 1537524331419. 2018-09-21 15:35:31,454 INFO > [main] impl.IncrementalBackupManager: Execute roll log procedure for > incremental backup ... 2018-09-21 15:35:32,985 ERROR [main] > impl.TableBackupClient: Unexpected Exception : java.lang.NullPointerException > java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > 2018-09-21 15:35:32,989 ERROR [main] impl.TableBackupClient: > BackupId=backup_1537524313995,startts=1537524331419,failedts=1537524332989,failedphase=PREPARE_INCREMENTAL,failedmessage=null > 2018-09-21 15:35:57,167 ERROR [main] impl.TableBackupClient: Backup > backup_1537524313995 failed. > Backup session finished. Status: FAILURE 2018-09-21 15:35:57,175 ERROR [main] > backup.BackupDriver: Error running > command-line tool java.io.IOException: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:281) > at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:601) > at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:347) > at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:138) > at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:171) > at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:204) at > org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at > org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:179) > Caused by: java.lang.NullPointerException at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getLogFilesForNewBackup(IncrementalBackupManager.java:309) > at > org.apache.hadoop.hbase.backup.impl.IncrementalBackupManager.getIncrBackupLogFileMap(IncrementalBackupManager.java:103) > at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:276) > ... 7 more -- This message was sent by Atlassian JIRA (v7.6.3#76005)