We're also getting a bunch of errors like the one below. We've verified that we've got the Phoenix jars on the classpath since we've got this in hbase-env.sh:
export HBASE_CLASSPATH=$*PHOENIX*_HOME/* $PHOENIX_HOME points at a directory which has phoenix-4.3.1-client.jar which contains MetaDataEndpointImpl. Sample stack: 2015-11-04 19:36:52,006 FATAL [RS_OPEN_REGION-acme-qa1:60020-1] regionserver.HRegionServer: ABORTING region server acme-qa1,60020,1446683806900: The coprocessor org.apache.phoenix. coprocessor.MetaDataEndpointImpl threw java.io.IOException: No jar path specified for org.apache.phoenix.coprocessor.MetaDataEndpointImpl java.io.IOException: No jar path specified for org.apache.phoenix.coprocessor.MetaDataEndpointImpl at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.load(CoprocessorHost.java:210) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.loadTableCoprocessors(RegionCoprocessorHost.java:370) at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.<init>(RegionCoprocessorHost.java:232) at org.apache.hadoop.hbase.regionserver.HRegion.<init>(HRegion.java:649) at org.apache.hadoop.hbase.regionserver.HRegion.<init>(HRegion.java:556) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at org.apache.hadoop.hbase.regionserver.HRegion.newHRegion(HRegion.java:4476) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4787) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4760) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4716) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4667) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:489) at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:149) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:128) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) On Wed, Nov 4, 2015 at 2:21 PM, Michael Mior <[email protected]> wrote: > Check the logs on the HBase server. Often this is a result of some > error there where the table couldn't be created correctly. > > -- > Michael Mior > [email protected] > > 2015-11-04 14:13 GMT-05:00 Dmitry Goldenberg <[email protected]>: > > Could someone provide any insight on why we might be seeing the below > > exception with Phoenix? We're seeing this while trying to connect > > programmatically in Java or when trying to run sqlline. > > > > We're running HBase 0.98.15 for Hadoop 2. > > > > Anything to try here? workarounds, fixes, troubleshooting tips? > > > > Thanks. > > > > Error: SYSTEM.CATALOG (state=08000,code=101) > > > > org.apache.phoenix.exception.PhoenixIOException: SYSTEM.CATALOG > > > > at > > > org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:108) > > > > at > > > org.apache.phoenix.query.ConnectionQueryServicesImpl.metaDataCoprocessorExec(ConnectionQueryServicesImpl.java:1022) > > > > at > > > org.apache.phoenix.query.ConnectionQueryServicesImpl.createTable(ConnectionQueryServicesImpl.java:1230) > > > > at > > > org.apache.phoenix.query.DelegateConnectionQueryServices.createTable(DelegateConnectionQueryServices.java:111) > > > > at > > > org.apache.phoenix.schema.MetaDataClient.createTableInternal(MetaDataClient.java:1696) > > > > at > > > org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:594) > > > > at > > > org.apache.phoenix.compile.CreateTableCompiler$2.execute(CreateTableCompiler.java:186) > > > > at > > > org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:296) > > > > at > > > org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:288) > > > > at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) > > > > at > > > org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:287) > > > > at > > > org.apache.phoenix.jdbc.PhoenixStatement.executeUpdate(PhoenixStatement.java:1086) > > > > at > > > org.apache.phoenix.query.ConnectionQueryServicesImpl$11.call(ConnectionQueryServicesImpl.java:1841) > > > > at > > > org.apache.phoenix.query.ConnectionQueryServicesImpl$11.call(ConnectionQueryServicesImpl.java:1810) > > > > at > > > org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:77) > > > > at > > > org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:1810) > > > > at > > > org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:162) > > > > at > > > org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.connect(PhoenixEmbeddedDriver.java:126) > > > > at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:133) > > > > at sqlline.DatabaseConnection.connect(DatabaseConnection.java:157) > > > > at sqlline.DatabaseConnection.getConnection(DatabaseConnection.java:203) > > > > at sqlline.Commands.connect(Commands.java:1064) > > > > at sqlline.Commands.connect(Commands.java:996) > > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:497) > > > > at > > > sqlline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:36) > > > > at sqlline.SqlLine.dispatch(SqlLine.java:804) > > > > at sqlline.SqlLine.initArgs(SqlLine.java:588) > > > > at sqlline.SqlLine.begin(SqlLine.java:656) > > > > at sqlline.SqlLine.start(SqlLine.java:398) > > > > at sqlline.SqlLine.main(SqlLine.java:292) > > > > Caused by: org.apache.hadoop.hbase.TableNotFoundException: SYSTEM.CATALOG > > > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1279) > > > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1150) > > > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1107) > > > > at > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:948) > > > > at > org.apache.hadoop.hbase.client.HTable.getRegionLocation(HTable.java:522) > > > > at > > > org.apache.hadoop.hbase.client.HTable.getKeysAndRegionsInRange(HTable.java:723) > > > > at > > > org.apache.hadoop.hbase.client.HTable.getKeysAndRegionsInRange(HTable.java:695) > > > > at > > > org.apache.hadoop.hbase.client.HTable.getStartKeysInRange(HTable.java:1641) > > > > at > > > org.apache.hadoop.hbase.client.HTable.coprocessorService(HTable.java:1596) > > > > at > > > org.apache.hadoop.hbase.client.HTable.coprocessorService(HTable.java:1577) > > > > at > > > org.apache.phoenix.query.ConnectionQueryServicesImpl.metaDataCoprocessorExec(ConnectionQueryServicesImpl.java:1007) > > > > ... 31 more >
