Hi JM,
Yeah you are right about when the exception happens. I just went through
all the logs of table creation and don't see an exception. Though there was
a "LONG" pause when doing the create table. I cannot find any kind of logs
on the hbase side as to why the long pause happened around that time.
The bigger problem now is the table does not show up in the hbase ui and I
can't do a drop on it. At the same time the regionserver logs are flooded
with that exception. I think I will have to muck around with ZK and remove
traces of that table.
Will try to repro this issue but it seems weird since I am able to create
other tables with no issue.
Thanks,
Viral
On Tue, Jun 25, 2013 at 4:22 AM, Jean-Marc Spaggiari <
jean-m...@spaggiari.org> wrote:
> Hi Viral,
>
> This exception is when you tries to read/open the able, right? Any
> exception when you have created it? Your table has not been fully
> created. So it's just normal for HBase to not open it. The issue is on
> the creation time. Do you sill have the logs?
>
> Thanks,
>
> JM
>
> 2013/6/25 Viral Bajaria <viral.baja...@gmail.com>:
> > Hi,
> >
> > I created a new table on my cluster today and hit a weird issue which I
> > have not come across before. I wanted to run it by the list and see if
> > anyone has seen this issue before and if not should I open a JIRA for it.
> > it's still unclear of why it would happen. I create the
> > table programmatically using the HBaseAdmin api's and not through the
> shell.
> >
> > hbase: 0.94.4
> > hadoop: 1.0.4
> >
> > There are 2 stack traces back to back and I think one might be leading to
> > the other, but I have to dive in deeper to confirm this.
> >
> > Thanks,
> > Viral
> >
> > ===StackTrace===
> >
> > 2013-06-25 09:58:46,041 DEBUG
> > org.apache.hadoop.hbase.util.FSTableDescriptors: Exception during
> > readTableDecriptor. Current table name = test_table_id
> > org.apache.hadoop.hbase.TableInfoMissingException: No .tableinfo file
> under
> > hdfs://
> ec2-54-242-168-35.compute-1.amazonaws.com:8020/hbase/test_table_id
> > at
> >
> org.apache.hadoop.hbase.util.FSTableDescriptors.getTableDescriptorModtime(FSTableDescriptors.java:416)
> > at
> >
> org.apache.hadoop.hbase.util.FSTableDescriptors.getTableDescriptorModtime(FSTableDescriptors.java:408)
> > at
> >
> org.apache.hadoop.hbase.util.FSTableDescriptors.get(FSTableDescriptors.java:163)
> > at
> >
> org.apache.hadoop.hbase.util.FSTableDescriptors.get(FSTableDescriptors.java:126)
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:2829)
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:2802)
> > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source)
> > at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
> > at
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
> > 2013-06-25 09:58:46,094 WARN
> > org.apache.hadoop.hbase.util.FSTableDescriptors: The following folder is
> in
> > HBase's root directory and doesn't contain a table descriptor, do
> consider
> > deleting it: test_table_id
> > 2013-06-25 09:58:46,094 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
> > regionserver:60020-0xaa3f4e93eed83504 Attempting to transition node
> > 8eac5d6cf6ce4c61fb47bf357af60213 from M_ZK_REGION_OFFLINE to
> > RS_ZK_REGION_OPENING
> > 2013-06-25 09:58:46,151 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
> > regionserver:60020-0xaa3f4e93eed83504 Successfully transitioned node
> > 8eac5d6cf6ce4c61fb47bf357af60213 from M_ZK_REGION_OFFLINE to
> > RS_ZK_REGION_OPENING
> > 2013-06-25 09:58:46,151 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion:
> > Opening region: {NAME =>
> > 'test_table_id,,1372103768783.8eac5d6cf6ce4c61fb47bf357af60213.',
> STARTKEY
> > => '', ENDKEY => '', ENCODED => 8eac5d6cf6ce4c61fb47bf357af60213,}
> > 2013-06-25 09:58:46,152 INFO
> > org.apache.hadoop.hbase.coprocessor.CoprocessorHost: System coprocessor
> > org.apache.hadoop.hbase.coprocessors.GroupBy was loaded successfully with
> > priority (536870911).
> > 2013-06-25 09:58:46,152 ERROR
> > org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed
> open
> > of region=test_table_id,,1372103768783.8eac5d6cf6ce4c61fb47bf357af60213.,
> > starting to roll back the global memstore size.
> > java.lang.IllegalStateException: Could not instantiate a region instance.
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:3776)
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3954)
> > at
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:332)
> > at
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:108)
> > at
> > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: java.lang.reflect.InvocationTargetException
> > at sun.reflect.GeneratedConstructorAccessor42.newInstance(Unknown
> > Source)
> > at
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> > at
> java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> > at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:3773)
> > ... 7 more
> > Caused by: java.lang.NullPointerException
> > at
> >
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.loadTableCoprocessors(RegionCoprocessorHost.java:159)
> > at
> >
> org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.<init>(RegionCoprocessorHost.java:151)
> > at
> > org.apache.hadoop.hbase.regionserver.HRegion.<init>(HRegion.java:455)
> > ... 11 more
>
