[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158217#comment-14158217 ] Elliott Clark commented on HBASE-12152: --- Please take other comments/more findings to a new jira. This one has been rendered un-usable. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: TestSecureLoadIncrementalHFilesSplitRecovery-fix.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156753#comment-14156753 ] stack commented on HBASE-12152: --- Adding timeouts on these tests. Pushed to branch-1+ TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156810#comment-14156810 ] Andrew Purtell commented on HBASE-12152: Cool I cherry picked the timeout additions back to 0.98 and pushed them, they applied cleanly. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156913#comment-14156913 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-TRUNK #5607 (See [https://builds.apache.org/job/HBase-TRUNK/5607/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS (stack: rev e92036cd54ac313482a5c6cc3416add560c7600c) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156934#comment-14156934 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #532 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/532/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS (apurtell: rev b5360829398922ceccc87fa24ba901543ed4db32) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157007#comment-14157007 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-1.0 #261 (See [https://builds.apache.org/job/HBase-1.0/261/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS (stack: rev 4598628ef27f5c4b205f44fcd38e5ac9136f52e1) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157078#comment-14157078 ] Ted Yu commented on HBASE-12152: I got the following test failure: {code} testGroupOrSplitPresplit(org.apache.hadoop.hbase.mapreduce.TestSecureLoadIncrementalHFilesSplitRecovery) Time elapsed: 0.147 sec ERROR! java.lang.Exception: test timed out after 120 milliseconds at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1087) at org.apache.hadoop.hbase.client.HTable.getDefaultExecutor(HTable.java:205) at org.apache.hadoop.hbase.client.HTable.init(HTable.java:302) at org.apache.hadoop.hbase.client.HTable.init(HTable.java:280) at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:145) at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:86) at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:538) at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:430) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.setupTable(TestLoadIncrementalHFilesSplitRecovery.java:132) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitPresplit(TestLoadIncrementalHFilesSplitRecovery.java:380) {code} Looks like timeout was specified as 120 milliseconds TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157102#comment-14157102 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-0.98 #561 (See [https://builds.apache.org/job/HBase-0.98/561/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS (apurtell: rev b5360829398922ceccc87fa24ba901543ed4db32) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157112#comment-14157112 ] stack commented on HBASE-12152: --- Upped timeout from 120 to 12 in 0.98+ TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157134#comment-14157134 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-0.98 #562 (See [https://builds.apache.org/job/HBase-0.98/562/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS -- Up timeout from 120 to 12 (stack: rev d2111dbda4a874224f9f4f0ba9d16edcc104c98a) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157153#comment-14157153 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-1.0 #263 (See [https://builds.apache.org/job/HBase-1.0/263/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS -- Up timeout from 120 to 12 (stack: rev 74c4dbdf39fa11aa0537b8c4b17785452c2dae21) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157202#comment-14157202 ] Andrew Purtell commented on HBASE-12152: Oops :-) TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157213#comment-14157213 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #533 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/533/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS -- Up timeout from 120 to 12 (stack: rev d2111dbda4a874224f9f4f0ba9d16edcc104c98a) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157262#comment-14157262 ] stack commented on HBASE-12152: --- Why does it fix the problem? TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157324#comment-14157324 ] Hudson commented on HBASE-12152: FAILURE: Integrated in HBase-TRUNK #5610 (See [https://builds.apache.org/job/HBase-TRUNK/5610/]) HBASE-12152 TestLoadIncrementalHFiles shows up as zombie test; ADD TIMEOUT ON TESTS -- Up timeout from 120 to 12 (stack: rev 546f436a4145647e595354372af23cdb6d8a1f28) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157337#comment-14157337 ] Ted Yu commented on HBASE-12152: In SecureBulkLoadEndpoint, the following condition isn't met during test run: {code} if (request.getFsToken().hasIdentifier() request.getFsToken().hasPassword()) { {code} leading to userToken being null which aborts secure bulk load. The proposed change would allow userToken to be created. Jeff has another fix for the hanging test. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157342#comment-14157342 ] stack commented on HBASE-12152: --- So it is not a fix for TestLoadIncrementalHFiles? TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157348#comment-14157348 ] Ted Yu commented on HBASE-12152: My attachment is to make TestSecureLoadIncrementalHFilesSplitRecovery pass. Jeff has another fix for TestLoadIncrementalHFiles TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157352#comment-14157352 ] stack commented on HBASE-12152: --- This issue is 'TestLoadIncrementalHFiles shows up as zombie test'. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157359#comment-14157359 ] Ted Yu commented on HBASE-12152: Let me create another JIRA for fixing TestSecureLoadIncrementalHFilesSplitRecovery TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157367#comment-14157367 ] stack commented on HBASE-12152: --- [~ted_yu] you are impossible to fathom/follow. Are you doing relay between this issue and [~jeffreyz]? Is [~jeffreyz] unable? TestSecureLoadIncremtalHFileSplitRecovery is failing in here in SecureBulkLoadEndpoint } else if (userProvider.isHadoopSecurityEnabled()) { //we allow this to pass through in simple security mode //for mini cluster testing ResponseConverter.setControllerException(controller, new DoNotRetryIOException(User token cannot be null)); // HERE... we are returning w/o setitng 'loaded'. + done.run(SecureBulkLoadHFilesResponse.newBuilder().setLoaded(false).build()); return; Which is causing 2014-10-02 15:48:44,970 ERROR [B.defaultRpcServer.handler=2,queue=0,port=60236] ipc.RpcServer(2053): Unexpected throwable object com.google.protobuf.UninitializedMessageException: Message missing required fields: loaded at com.google.protobuf.AbstractMessage$Builder.newUninitializedMessageException(AbstractMessage.java:770) at org.apache.hadoop.hbase.protobuf.generated.SecureBulkLoadProtos$SecureBulkLoadHFilesResponse$Builder.build(SecureBulkLoadProtos.java:1542) at org.apache.hadoop.hbase.protobuf.generated.SecureBulkLoadProtos$SecureBulkLoadHFilesResponse$Builder.build(SecureBulkLoadProtos.java:1486) at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:5901) at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1644) at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1626) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:30426) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2020) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) at java.lang.Thread.run(Thread.java:745) ... test does not complete. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157369#comment-14157369 ] Ted Yu commented on HBASE-12152: I debugged the failure in TestSecureLoadIncrementalHFilesSplitRecovery with Jeff. I tried the above change which didn't make TestSecureLoadIncrementalHFilesSplitRecovery pass - userToken is null, skipping the bulk load. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157385#comment-14157385 ] stack commented on HBASE-12152: --- I give up. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: 12152-v3.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157410#comment-14157410 ] Hadoop QA commented on HBASE-12152: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12672658/12152-v3.txt against trunk revision . ATTACHMENT ID: 12672658 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint org.apache.hadoop.hbase.master.TestDistributedLogSplitting Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/11198//console This message is automatically generated. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: TestSecureLoadIncrementalHFilesSplitRecovery-fix.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157433#comment-14157433 ] Ted Yu commented on HBASE-12152: In the QA run above, TestLoadIncrementalHFiles didn't hang, neither did TestSecureLoadIncrementalHFilesSplitRecovery. The initial subject of the JIRA was inaccurate - although TestLoadIncrementalHFiles showed up in stack trace of hanging test, it was TestSecureLoadIncrementalHFilesSplitRecovery that actually hung because of userToken being null, aborting bulk load. Since there was no timeout prior to today, TestSecureLoadIncrementalHFilesSplitRecovery hung. The addition of the timeout exposed the bug. The above was result of discussion with Jeff. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: TestSecureLoadIncrementalHFilesSplitRecovery-fix.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157436#comment-14157436 ] Andrew Purtell commented on HBASE-12152: Definitely invalid then, good resolution. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: TestSecureLoadIncrementalHFilesSplitRecovery-fix.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157438#comment-14157438 ] Jeffrey Zhong commented on HBASE-12152: --- Sorry I came to the thread late. The fix I suggested to Ted is due to my recent change where I added this following line to prevent possible toByteArray() from throwing NPE. While it seems, in test case, request.getFsToken().hasIdentifier() returns false and request.getFsToken().getIdentifier() is empty byte array. So my previous NPE worry isn't needed and the fix just restores previous behavior. {quote} if (request.getFsToken().hasIdentifier() request.getFsToken().hasPassword()) { {quote} TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: TestSecureLoadIncrementalHFilesSplitRecovery-fix.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157440#comment-14157440 ] Andrew Purtell commented on HBASE-12152: I suggest opening a clean issue that clearly explains this and provides a patch. This issue is FUBAR TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: TestSecureLoadIncrementalHFilesSplitRecovery-fix.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157446#comment-14157446 ] Jeffrey Zhong commented on HBASE-12152: --- What Stack found is another bug that {quote} done.run(null) {quote} doesn't work in existing code and we have to use something proposed by [~saint@gmail.com] {code} done.run(SecureBulkLoadHFilesResponse.newBuilder().setLoaded(false).build()); {code} TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu Attachments: TestSecureLoadIncrementalHFilesSplitRecovery-fix.txt TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156038#comment-14156038 ] Andrew Purtell commented on HBASE-12152: So what do you think we should do here Ted? Should this be moved to hbase-it? TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156040#comment-14156040 ] Ted Yu commented on HBASE-12152: From earlier in the stack trace: {code} LoadIncrementalHFiles-10 prio=10 tid=0x7f86716ee800 nid=0x7b5a in Object.wait() [0x7f8642bea000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:147) - locked 0x0007e4dbf6a0 (a java.util.concurrent.atomic.AtomicBoolean) at org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:95) at org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callMethod(CoprocessorRpcChannel.java:57) at org.apache.hadoop.hbase.protobuf.generated.SecureBulkLoadProtos$SecureBulkLoadService$Stub.secureBulkLoadHFiles(SecureBulkLoadProtos.java:4720) at org.apache.hadoop.hbase.client.coprocessor.SecureBulkLoadClient.bulkLoadHFiles(SecureBulkLoadClient.java:162) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3.call(LoadIncrementalHFiles.java:649) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3.call(LoadIncrementalHFiles.java:634) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.tryAtomicRegionLoad(LoadIncrementalHFiles.java:690) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$1.call(LoadIncrementalHFiles.java:371) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$1.call(LoadIncrementalHFiles.java:369) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) {code} I haven't figured out why SecureBulkLoadClient came into play where the test specifies for CoprocessorHost.REGION_COPROCESSOR_CONF_KEY TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12152) TestLoadIncrementalHFiles shows up as zombie test
[ https://issues.apache.org/jira/browse/HBASE-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156098#comment-14156098 ] stack commented on HBASE-12152: --- And Would be cool if someone fixed this else lets just turn it off. TestLoadIncrementalHFiles shows up as zombie test - Key: HBASE-12152 URL: https://issues.apache.org/jira/browse/HBASE-12152 Project: HBase Issue Type: Test Reporter: Ted Yu TestLoadIncrementalHFiles and TestLoadIncrementalHFilesSplitRecovery frequently show up as zombie tests (from 0.98 to master branch). e.g. https://builds.apache.org/job/hbase-0.98/558/console Here is snippet of stack trace for TestLoadIncrementalHFilesSplitRecovery : {code} main prio=10 tid=0x7f8670008000 nid=0x1105 waiting on condition [0x7f8674b57000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for 0x00078d4c3ba0 (a java.util.concurrent.FutureTask$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:248) at java.util.concurrent.FutureTask.get(FutureTask.java:111) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:382) at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:324) at org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery.testGroupOrSplitWhenRegionHoleExistsInMeta(TestLoadIncrementalHFilesSplitRecovery. java:470) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)