[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2
[ https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13560415#comment-13560415 ] Andrew Purtell edited comment on HBASE-7594 at 1/23/13 6:10 AM: Patch v5 makes a minor change to HBaseTestingUtility to add a facility for creating a LocalHBaseCluster with custom master and regionserver classes by way of the HBaseTestingUtility methods. This way we get per-test data dirs set up for us, and HBaseTestingUtility uses LocalHBaseCluster internally anyway. Most of TestLocalHBaseCluster goes away. We also retain some of the changes in earlier patches that sets the default comparator in FixedFileTrailer to KeyComparator, validates that the comparator can be instantiated in FixedFileTrailer#setComparatorClass, and the fix to TestHFile described above. was (Author: apurtell): Patch v5 makes a minor change to HBaseTestingUtility to add a facility for creating a LocalHBaseCluster with custom master and regionserver classes by way of the HBaseTestingUtility methods. This way we get per-test data dirs set up for us, and HBaseTestingUtility uses LocalHBaseCluster internally anyway. Most of LocalHBaseCluster goes away. We also retain some of the changes in earlier patches that sets the default comparator in FixedFileTrailer to KeyComparator, validates that the comparator can be instantiated in FixedFileTrailer#setComparatorClass, and the fix to TestHFile described above. > TestLocalHBaseCluster failing on ubuntu2 > > > Key: HBASE-7594 > URL: https://issues.apache.org/jira/browse/HBASE-7594 > Project: HBase > Issue Type: Bug > Components: test >Affects Versions: 0.96.0 >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Attachments: 7594-1.patch, 7594-2.patch, 7594-3.patch, 7594-4.patch, > 7594-5.patch > > > {noformat} > java.io.IOException: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612) > at > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130) > at > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450) > at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215) > at > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > ... 3 more > Caused by: java.io.IOException: java.lang.InstantiationException: > org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607) > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615) > at > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115) > at > org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564) > at > org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599) > at > org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294) > at > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525) > at > org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628) > at org.apache.hadoop.hbase.regi
[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2
[ https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559961#comment-13559961 ] Andrew Purtell edited comment on HBASE-7594 at 1/22/13 8:08 PM: By the way thanks [~saint@gmail.com] for enabling this. Now we can throw things at Jenkins specials without needing to patch trunk, via patches on precommit builds. was (Author: apurtell): By the way thanks [~saint@gmail.com] for enabling this. Now we can throw things a Jenkins specials without needing to patch trunk, via patches on precommit builds. > TestLocalHBaseCluster failing on ubuntu2 > > > Key: HBASE-7594 > URL: https://issues.apache.org/jira/browse/HBASE-7594 > Project: HBase > Issue Type: Bug > Components: test >Affects Versions: 0.96.0 >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Attachments: 7594-1.patch, 7594-2.patch, 7594-3.patch, 7594-4.patch > > > {noformat} > java.io.IOException: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612) > at > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130) > at > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450) > at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215) > at > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > ... 3 more > Caused by: java.io.IOException: java.lang.InstantiationException: > org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607) > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615) > at > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115) > at > org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564) > at > org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599) > at > org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294) > at > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525) > at > org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628) > at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426) > at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422) > ... 8 more > Caused by: java.lang.InstantiationException: > org.apache.hadoop.io.RawComparator > at java.lang.Class.newInstance0(Class.java:340) > at java.lang.Class.newInstance(Class.java:308) > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605) > ... 17 more > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2
[ https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559420#comment-13559420 ] Andrew Purtell edited comment on HBASE-7594 at 1/22/13 6:08 AM: v3 patch removes where comparatorClassName is set directly and instead assigns through setComparatorClass, which does an instantiation check. Might catch the problem earlier. Needs precommit builds to save test logs. was (Author: apurtell): v3 patch removes where comparatorClassName is set directly and instead assigns through setComparatorClass, which does an instantiation check. Might catch the problem earlier. > TestLocalHBaseCluster failing on ubuntu2 > > > Key: HBASE-7594 > URL: https://issues.apache.org/jira/browse/HBASE-7594 > Project: HBase > Issue Type: Bug > Components: test >Affects Versions: 0.96.0 >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Attachments: 7594-1.patch, 7594-2.patch, 7594-3.patch > > > {noformat} > java.io.IOException: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612) > at > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130) > at > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450) > at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215) > at > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > ... 3 more > Caused by: java.io.IOException: java.lang.InstantiationException: > org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607) > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615) > at > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115) > at > org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564) > at > org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599) > at > org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294) > at > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525) > at > org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628) > at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426) > at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422) > ... 8 more > Caused by: java.lang.InstantiationException: > org.apache.hadoop.io.RawComparator > at java.lang.Class.newInstance0(Class.java:340) > at java.lang.Class.newInstance(Class.java:308) > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605) > ... 17 more > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (HBASE-7594) TestLocalHBaseCluster failing on ubuntu2
[ https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13555784#comment-13555784 ] Andrew Purtell edited comment on HBASE-7594 at 1/17/13 3:08 AM: bq. I have noticed this failure since we committed HBASE-7414. I'm not sure whether they are related. Yes I have noticed this too but as I have stated several times this is not reproducable locally nor apparently on any other host than ubuntu2. While I am concerned about it, I am not in favor of a revert. I think anyone who wants to revert HBASE-7414 it is incumbent to demonstrate the patch is actually in error. Then I will happily do it, and fix it. was (Author: apurtell): bq. I have noticed this failure since we committed HBASE-7414. I'm not sure whether they are related. Yes I have noticed this too but as I have stated several times this is not reproducable locally nor apparently on any other host than ubuntu2. While I am concerned about it, I am not in favor of a revert. > TestLocalHBaseCluster failing on ubuntu2 > > > Key: HBASE-7594 > URL: https://issues.apache.org/jira/browse/HBASE-7594 > Project: HBase > Issue Type: Bug >Reporter: Andrew Purtell >Assignee: Andrew Purtell > > {noformat} > java.io.IOException: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612) > at > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092) > at > org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427) > at > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130) > at > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: java.io.IOException: > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450) > at org.apache.hadoop.hbase.regionserver.HStore.(HStore.java:215) > at > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585) > at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > ... 3 more > Caused by: java.io.IOException: java.lang.InstantiationException: > org.apache.hadoop.io.RawComparator > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607) > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615) > at > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.(HFileReaderV2.java:115) > at > org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564) > at > org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599) > at > org.apache.hadoop.hbase.regionserver.StoreFile$Reader.(StoreFile.java:1294) > at > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525) > at > org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628) > at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426) > at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422) > ... 8 more > Caused by: java.lang.InstantiationException: > org.apache.hadoop.io.RawComparator > at java.lang.Class.newInstance0(Class.java:340) > at java.lang.Class.newInstance(Class.java:308) > at > org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605) > ... 17 more > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administra