[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2

2013-01-22 Thread Andrew Purtell (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560415#comment-13560415
 ] 

Andrew Purtell edited comment on HBASE-7594 at 1/23/13 6:10 AM:


Patch v5 makes a minor change to HBaseTestingUtility to add a facility for 
creating a LocalHBaseCluster with custom master and regionserver classes by way 
of the HBaseTestingUtility methods. This way we get per-test data dirs set up 
for us, and HBaseTestingUtility uses LocalHBaseCluster internally anyway. Most 
of TestLocalHBaseCluster goes away. We also retain some of the changes in 
earlier patches that sets the default comparator in FixedFileTrailer to 
KeyComparator, validates that the comparator can be instantiated in 
FixedFileTrailer#setComparatorClass, and the fix to TestHFile described above.

  was (Author: apurtell):
Patch v5 makes a minor change to HBaseTestingUtility to add a facility for 
creating a LocalHBaseCluster with custom master and regionserver classes by way 
of the HBaseTestingUtility methods. This way we get per-test data dirs set up 
for us, and HBaseTestingUtility uses LocalHBaseCluster internally anyway. Most 
of LocalHBaseCluster goes away. We also retain some of the changes in earlier 
patches that sets the default comparator in FixedFileTrailer to KeyComparator, 
validates that the comparator can be instantiated in 
FixedFileTrailer#setComparatorClass, and the fix to TestHFile described above.
  
> TestLocalHBaseCluster failing on ubuntu2
> 
>
> Key: HBASE-7594
> URL: https://issues.apache.org/jira/browse/HBASE-7594
> Project: HBase
>  Issue Type: Bug
>  Components: test
>Affects Versions: 0.96.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Attachments: 7594-1.patch, 7594-2.patch, 7594-3.patch, 7594-4.patch, 
> 7594-5.patch
>
>
> {noformat}
> java.io.IOException: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
>   at 
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>   at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
>   at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   ... 3 more
> Caused by: java.io.IOException: java.lang.InstantiationException: 
> org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
>   at org.apache.hadoop.hbase.regi

[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2

2013-01-22 Thread Andrew Purtell (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559961#comment-13559961
 ] 

Andrew Purtell edited comment on HBASE-7594 at 1/22/13 8:08 PM:


By the way thanks [~saint@gmail.com] for enabling this. Now we can throw 
things at Jenkins specials without needing to patch trunk, via patches on 
precommit builds.

  was (Author: apurtell):
By the way thanks [~saint@gmail.com] for enabling this. Now we can 
throw things a Jenkins specials without needing to patch trunk, via patches on 
precommit builds.
  
> TestLocalHBaseCluster failing on ubuntu2
> 
>
> Key: HBASE-7594
> URL: https://issues.apache.org/jira/browse/HBASE-7594
> Project: HBase
>  Issue Type: Bug
>  Components: test
>Affects Versions: 0.96.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Attachments: 7594-1.patch, 7594-2.patch, 7594-3.patch, 7594-4.patch
>
>
> {noformat}
> java.io.IOException: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
>   at 
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>   at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
>   at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   ... 3 more
> Caused by: java.io.IOException: java.lang.InstantiationException: 
> org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
>   at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426)
>   at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422)
>   ... 8 more
> Caused by: java.lang.InstantiationException: 
> org.apache.hadoop.io.RawComparator
>   at java.lang.Class.newInstance0(Class.java:340)
>   at java.lang.Class.newInstance(Class.java:308)
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605)
>   ... 17 more
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2

2013-01-21 Thread Andrew Purtell (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559420#comment-13559420
 ] 

Andrew Purtell edited comment on HBASE-7594 at 1/22/13 6:08 AM:


v3 patch removes where comparatorClassName is set directly and instead assigns 
through setComparatorClass, which does an instantiation check. Might catch the 
problem earlier. Needs precommit builds to save test logs.

  was (Author: apurtell):
v3 patch removes where comparatorClassName is set directly and instead 
assigns through setComparatorClass, which does an instantiation check. Might 
catch the problem earlier.
  
> TestLocalHBaseCluster failing on ubuntu2
> 
>
> Key: HBASE-7594
> URL: https://issues.apache.org/jira/browse/HBASE-7594
> Project: HBase
>  Issue Type: Bug
>  Components: test
>Affects Versions: 0.96.0
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
> Attachments: 7594-1.patch, 7594-2.patch, 7594-3.patch
>
>
> {noformat}
> java.io.IOException: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
>   at 
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>   at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
>   at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   ... 3 more
> Caused by: java.io.IOException: java.lang.InstantiationException: 
> org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
>   at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426)
>   at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422)
>   ... 8 more
> Caused by: java.lang.InstantiationException: 
> org.apache.hadoop.io.RawComparator
>   at java.lang.Class.newInstance0(Class.java:340)
>   at java.lang.Class.newInstance(Class.java:308)
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605)
>   ... 17 more
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2

2013-01-16 Thread Andrew Purtell (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13555784#comment-13555784
 ] 

Andrew Purtell edited comment on HBASE-7594 at 1/17/13 3:08 AM:


bq. I have noticed this failure since we committed HBASE-7414. I'm not sure 
whether they are related. 

Yes I have noticed this too but as I have stated several times this is not 
reproducable locally nor apparently on any other host than ubuntu2. While I am 
concerned about it, I am not in favor of a revert. I think anyone who wants to 
revert HBASE-7414 it is incumbent to demonstrate the patch is actually in 
error. Then I will happily do it, and fix it.

  was (Author: apurtell):
bq. I have noticed this failure since we committed HBASE-7414. I'm not sure 
whether they are related. 

Yes I have noticed this too but as I have stated several times this is not 
reproducable locally nor apparently on any other host than ubuntu2. While I am 
concerned about it, I am not in favor of a revert.
  
> TestLocalHBaseCluster failing on ubuntu2
> 
>
> Key: HBASE-7594
> URL: https://issues.apache.org/jira/browse/HBASE-7594
> Project: HBase
>  Issue Type: Bug
>Reporter: Andrew Purtell
>Assignee: Andrew Purtell
>
> {noformat}
> java.io.IOException: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
>   at 
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
>   at 
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>   at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: java.io.IOException: 
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
>   at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215)
>   at 
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
>   at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   ... 3 more
> Caused by: java.io.IOException: java.lang.InstantiationException: 
> org.apache.hadoop.io.RawComparator
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
>   at 
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
>   at 
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
>   at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426)
>   at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422)
>   ... 8 more
> Caused by: java.lang.InstantiationException: 
> org.apache.hadoop.io.RawComparator
>   at java.lang.Class.newInstance0(Class.java:340)
>   at java.lang.Class.newInstance(Class.java:308)
>   at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605)
>   ... 17 more
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administra