[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Enis Soztutar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Enis Soztutar updated HBASE-11671:
--
Fix Version/s: (was: 1.0.0)
   0.99.0

 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 0.99.0, 2.0.0

 Attachments: HBASE-11671-v2.patch, HBASE-11671.patch


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Mikhail Antonov (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-11671:


Status: Patch Available  (was: Open)

 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 0.99.0

 Attachments: HBASE-11671.patch


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Mikhail Antonov (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-11671:


Attachment: HBASE-11671.patch

attached one-liner patch which fixes the test by setting usezk=true in 
config, just to get the test passing, looking further in the test.

 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 0.99.0

 Attachments: HBASE-11671.patch


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Mikhail Antonov (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-11671:


Status: Open  (was: Patch Available)

 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 0.99.0

 Attachments: HBASE-11671-v2.patch, HBASE-11671.patch


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Mikhail Antonov (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-11671:


Attachment: HBASE-11671-v2.patch

Ah, seems to be the problem was the the tests used to mimic the codepath of 
SplitTransaction, but became obsolete after SplitTransaction started using 
different codepath for zk-less assignment around postOpenDeployTasks(). 
Attaching better patch (in sense with it test passes with either useZK true or 
false).

[~jxiang] could you take a look?

 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 0.99.0

 Attachments: HBASE-11671-v2.patch, HBASE-11671.patch


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Mikhail Antonov (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-11671:


Status: Patch Available  (was: Open)

 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 0.99.0

 Attachments: HBASE-11671-v2.patch, HBASE-11671.patch


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Jimmy Xiang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jimmy Xiang updated HBASE-11671:


   Resolution: Fixed
Fix Version/s: (was: 0.99.0)
   2.0.0
   1.0.0
 Hadoop Flags: Reviewed
   Status: Resolved  (was: Patch Available)

Integrated v2 into master and branch 1. Thanks a lot for the patch.

 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 1.0.0, 2.0.0

 Attachments: HBASE-11671-v2.patch, HBASE-11671.patch


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HBASE-11671) TestEndToEndSplitTransaction fails on master

[Mikhail Antonov (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HBASE-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Antonov updated HBASE-11671:


Description: 
#testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
Here're the only log snippets which seem relevant.

{quote}
java.io.IOException: Failed to report opened region to master: 
TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
at 
org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
at 
org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
{quote}

{quote}
java.io.IOException: Cannot append; log is closed
at 
org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
at 
org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
at 
org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
at 
org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
at 
org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
at 
org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
{quote}

  was:#testMasterOpsWhileSplitting() fails, seems after enabling ZK-less 
assignment.


 TestEndToEndSplitTransaction fails on master
 

 Key: HBASE-11671
 URL: https://issues.apache.org/jira/browse/HBASE-11671
 Project: HBase
  Issue Type: Bug
  Components: Region Assignment, test
Affects Versions: 0.99.0
Reporter: Mikhail Antonov
Assignee: Mikhail Antonov
 Fix For: 0.99.0


 #testMasterOpsWhileSplitting() fails, seems after enabling ZK-less assignment.
 Here're the only log snippets which seem relevant.
 {quote}
 java.io.IOException: Failed to report opened region to master: 
 TestSplit,lll,1407218018712.030c51654a5cbe9e0489a50762bb9075.
   at 
 org.apache.hadoop.hbase.regionserver.HRegionServer.postOpenDeployTasks(HRegionServer.java:1731)
   at 
 org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction.testMasterOpsWhileSplitting(TestEndToEndSplitTransaction.java:130)
 {quote}
 {quote}
 java.io.IOException: Cannot append; log is closed
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.append(FSHLog.java:1146)
   at 
 org.apache.hadoop.hbase.regionserver.wal.FSHLog.appendNoSync(FSHLog.java:1120)
   at 
 org.apache.hadoop.hbase.regionserver.wal.HLogUtil.writeCompactionMarker(HLogUtil.java:266)
   at 
 org.apache.hadoop.hbase.regionserver.HStore.writeCompactionWalRecord(HStore.java:1211)
   at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1158)
   at 
 org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1514)
   at 
 org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:478)
   at 
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
 {quote}



--
This message was sent by Atlassian JIRA
(v6.2#6252)