Hi,
could you post the output of "describe" for that table? I am having a very
similar problem (added an index to an existing table and getting the
NoServerForRegionException). This is what I am getting when typing "describe
<TableName>" in the shell:
{NAME => 'Records', FAMILIES => [{NAME => 'data', VERSIONS => '5', COMPRESSION
=> 'GZ', INDEX_DESC =>
'5org.apache.hadoop.hbase.client.idx.IdxIndexDescriptoramazon.de:rating
CHAR_ARRAY', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}, {NAME => 'permissions', VERSIONS => '1', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}
I am seeing the following exception on startup in the master log:
Processing MSG_REPORT_CLOSE: Records,,1267632504185:
java.lang.IllegalArgumentException: Argument 'needle' cannot be null
at
org.apache.hadoop.hbase.regionserver.idx.support.arrays.BinarySearch.search(BinarySearch.java:58)
at
org.apache.hadoop.hbase.regionserver.idx.support.arrays.BinarySearch.search(BinarySearch.java:108)
at
org.apache.hadoop.hbase.regionserver.CompleteIndexBuilder.addKeyValue(CompleteIndexBuilder.java:119)
at
org.apache.hadoop.hbase.regionserver.IdxRegionIndexManager.fillIndex(IdxRegionIndexManager.java:198)
at
org.apache.hadoop.hbase.regionserver.IdxRegionIndexManager.rebuildIndexes(IdxRegionIndexManager.java:112)
at
org.apache.hadoop.hbase.regionserver.IdxRegion.rebuildIndexes(IdxRegion.java:126)
at
org.apache.hadoop.hbase.regionserver.IdxRegion.initialize(IdxRegion.java:108)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:1564)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:1531)
at
org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:1451)
at java.lang.Thread.run(Thread.java:619)
the region Records,,1267632504185 is the one being reported in the
NoServerForRegionException. Right now I am unable to disable the table so I'm
kinda stuck :-(
greetz,
Vukasin
> Also, could you try rolling back to your original configuration and
> check that everything goes back to normal?
>
> 2010/3/5 Dan Washusen <d...@reactive.org>:
> > Then something is not right... Could you post up a region server log in
> > pastebin?
> >
> > 2010/3/5 Ted Yu <yuzhih...@gmail.com>
> >
> >> I searched all existing hbase logs but didn't see 'Filled indices for
> >> region'
> >>
> >> 2010/3/4 Dan Washusen <d...@reactive.org>
> >>
> >> > Hi Ted,
> >> > Did you verify that all the regions came back online after re-enabling
> >> the
> >> > table? Depending on the size of the table it may time some time...
> >> >
> >> > You should see something like the following logged in the region server
> >> > logs
> >> > for each region:
> >> >
> >> > > Filled indices for region: 'ruletable,,1267641828807' with 55555555
> >> > entries
> >> > > in 00:05:99
> >> >
> >> >
> >> > Cheers,
> >> > Dan
> >> >
> >> > 2010/3/5 Ted Yu <yuzhih...@gmail.com>
> >> >
> >> > > 2010/3/3 Ted Yu <yuzhih...@gmail.com>
> >> > >
> >> > > > Hi,
> >> > > > I wrote a utility to add index to my table.
> >> > > > After running it, I couldn't see the rows in that table I saw before.
> >> > > >
> >> > > > hbase(main):007:0> count 'ruletable'
> >> > > > NativeException:
> >> > > org.apache.hadoop.hbase.client.NoServerForRegionException:
> >> > > > No server address listed in .META. for region
> >> ruletable,,1267641828807
> >> > > >
> >> > > > My code follows, how do I determine the correct IdxQualifierType ?
> >> > > >
> >> > > >
> >> > > > HBaseAdmin admin = new HBaseAdmin(conf);
> >> > > > admin.disableTable(tableName);
> >> > > > System.out.println(tableName + " disabled");
> >> > > >
> >> > > > for (int i = 1; i < otherArgs.length; i+=2)
> >> > > > {
> >> > > > String colFam = otherArgs[i];
> >> > > > byte[] familyName = Bytes.toBytes(colFam);
> >> > > > byte[] qualifier = Bytes.toBytes(otherArgs[i+1]);
> >> > > >
> >> > > > IdxColumnDescriptor idxColumnDescriptor = new
> >> > > > IdxColumnDescriptor(familyName);
> >> > > > IdxIndexDescriptor indexDescriptor = new
> >> > > > IdxIndexDescriptor(qualifier, IdxQualifierType.CHAR_ARRAY);
> >> > > > idxColumnDescriptor.addIndexDescriptor(indexDescriptor);
> >> > > >
> >> > > > admin.modifyColumn(tableName, colFam, idxColumnDescriptor);
> >> > > > System.out.println(colFam + ":" + otherArgs[i+1] + "
> >> indexed");
> >> > > > }
> >> > > > admin.enableTable(tableName);
> >> > > >
> >> > > >
> >> > > >
> >> > > > 2010/2/26 Ram Kulbak <ram.kul...@gmail.com>
> >> > > >
> >> > > >> You will need to use an IdxColumnDescriptor:
> >> > > >>
> >> > > >> Here's a code example for creating a table with a byte array index:
> >> > > >>
> >> > > >> HTableDescriptor tableDescriptor = new
> >> > HTableDescriptor(TABLE_NAME);
> >> > > >> IdxColumnDescriptor idxColumnFamilyDescriptor = new
> >> > > >> IdxColumnDescriptor(FAMILY_NAME);
> >> > > >> try {
> >> > > >> idxColumnFamilyDescriptor.addIndexDescriptor(
> >> > > >> new IdxIndexDescriptor(QUALIFIER_NAME,
> >> > > IdxQualifierType.BYTE_ARRAY)
> >> > > >> );
> >> > > >> } catch (IOException e) {
> >> > > >> throw new IllegalStateException(e);
> >> > > >> }
> >> > > >> tableDescriptor.addFamily(idxColumnFamilyDescriptor);
> >> > > >>
> >> > > >>
> >> > > >> You can add several index descriptors to the same column family
> and
> >> > > >> you can put indexes on more than one column families. You should
> use
> >> > > >> IdxScan with an org.apache.hadoop.hbase.client.idx.exp.Expression
> >> set
> >> > > >> to match your query criteria. The expression may cross columns
> from
> >> > > >> the same or different families using ANDs and ORs.
> >> > > >>
> >> > > >> Note that several index types are supported. Current types include
> >> all
> >> > > >> basic types and BigDecimals. Char arrays are also supported. Types
> >> > > >> allow for correct range checking (for example you can quickly
> >> evaluate
> >> > > >> a scan getting all rows for which a given column has values between
> >> 42
> >> > > >> and 314). You should make sure that columns which are indexed
> with a
> >> > > >> given qualifier type are actually populated with bytes matching
> >> their
> >> > > >> type, e.g. it you use IdxQualifierType.LONG make sure that you
> >> > > >> actually put values which are 8-long byte arrays which were produced
> >> > > >> in a method similar to Bytes.toBytes(long).
> >> > > >>
> >> > > >> Yoram
> >> > > >>
> >> > > >> 2010/2/27 Ted Yu <yuzhih...@gmail.com>:
> >> > > >> > Ram:
> >> > > >> > How do I specify index in HColumnDescriptor that is passed
> to
> >> > > >> modifyColumn()
> >> > > >> > ?
> >> > > >> >
> >> > > >> > Thanks
> >> > > >> >
> >> > > >> > 2010/2/26 Ram Kulbak <ram.kul...@gmail.com>
> >> > > >> >>
> >> > > >> >> Hi Shen,
> >> > > >> >>
> >> > > >> >> The first thing you need to verify is that you can switch
> to the
> >> > > >> >> IdxRegion implementation without problems. I've just
> checked that
> >> > the
> >> > > >> >> following steps work on the PerformanceEvaluation tables.
> I would
> >> > > >> >> suggest you backup your hbase production instance before
> >> attempting
> >> > > >> >> this (or create and try it out on a sandbox instance)
> >> > > >> >>
> >> > > >> >> * Stop hbase
> >> > > >> >> * Edit conf/hbase-env.sh file and add IHBASE to your
> classpath.
> >> > > >> >> Here's an example which assumes you don't need to add
> anything
> >> else
> >> > > to
> >> > > >> >> your classpath, make sure the HBASE_HOME is defined or
> simply
> >> > > >> >> substiute it with the full path of hbase installation
> directory:
> >> > > >> >> export HBASE_CLASSPATH=(`find $HBASE_HOME/contrib/indexed
> -name
> >> > > >> >> '*jar' | tr -s "\n" ":"`)
> >> > > >> >>
> >> > > >> >> * Edit conf/hbase-site.xml and set IdxRegion to be the
> region
> >> > > >> >> implementation:
> >> > > >> >>
> >> > > >> >> <property>
> >> > > >> >> <name>hbase.hregion.impl</name>
> >> > > >> >> <value>org.apache.hadoop.hbase.regionserver.IdxRegion</value>
> >> > > >> >> </property>
> >> > > >> >>
> >> > > >> >> * Propagate the configuration to all slaves
> >> > > >> >> * Start HBASE
> >> > > >> >>
> >> > > >> >>
> >> > > >> >> Next, modify the table you want to index using code similar
> to
> >> > this:
> >> > > >> >>
> >> > > >> >> HBaseConfiguration conf = new HBaseConfiguration();
> >> > > >> >>
> >> > > >> >> HBaseAdmin admin = new HBaseAdmin(conf);
> >> > > >> >> admin.disableTable(TABLE_NAME);
> >> > > >> >> admin.modifyColumn(TABLE_NAME, FAMILY_NAME1,
> >> > > >> IDX_COLUMN_DESCRIPTOR1);
> >> > > >> >> ...
> >> > > >> >> admin.modifyColumn(TABLE_NAME, FAMILY_NAMEN,
> >> > > >> IDX_COLUMN_DESCRIPTORN);
> >> > > >> >> admin.enableTable(TABLE_NAME);
> >> > > >> >>
> >> > > >> >> Wait for the table to get indexed. This may take a few
> minutes.
> >> > Check
> >> > > >> >> the master web page and verify your index definitions
> appear
> >> > > correctly
> >> > > >> >> in the table description.
> >> > > >> >>
> >> > > >> >> This is it. Please let me know how it goes.
> >> > > >> >>
> >> > > >> >> Yoram
> >> > > >> >>
> >> > > >> >>
> >> > > >> >>
> >> > > >> >>
> >> > > >> >> 2010/2/26 ChingShen <chingshenc...@gmail.com>:
> >> > > >> >> > Thanks, But I think I need the indexed HBase rather
> than
> >> > > >> transactional
> >> > > >> >> > HBase.
> >> > > >> >> >
> >> > > >> >> > Shen
> >> > > >> >> >
> >> > > >> >> > 2010/2/26 <y_823...@tsmc.com>
> >> > > >> >> >
> >> > > >> >> >> You can try my code to create a index in the
> existing table.
> >> > > >> >> >>
> >> > > >> >> >> public void AddIdx2ExistingTable(String tablename,String
> >> > > >> >> >> columnfamily,String idx_column) throws IOException
> {
> >> > > >> >> >> IndexedTableAdmin admin = null;
> >> > > >> >> >> admin = new IndexedTableAdmin(config);
> >> > > >> >> >> admin.addIndex(Bytes.toBytes(tablename),
> new
> >> > > >> >> >> IndexSpecification(idx_column,
> >> > > >> >> >> Bytes.toBytes(columnfamily+":"+idx_column)));
> >> > > >> >> >> }
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >> Fleming Chiu(邱宏明)
> >> > > >> >> >> 707-6128
> >> > > >> >> >> y_823...@tsmc.com
> >> > > >> >> >> 週一無肉日吃素救地球(Meat Free Monday
> Taiwan)
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >> ChingShen
> >> > > >> >> >> <chingshenc...@gm
> To:
> >> > hbase-user
> >> > > <
> >> > > >> >> >> hbase-user@hadoop.apache.org>
> >> > > >> >> >> ail.com>
> cc: (bcc:
> >> > > >> >> >> Y_823910/TSMC)
> >> > > >> >> >>
> Subject:
> >> [Indexed
> >> > > >> HBase]
> >> > > >> >> >> Can
> >> > > >> >> >> I add index in an existing table?
> >> > > >> >> >> 2010/02/26 10:18
> >> > > >> >> >> AM
> >> > > >> >> >> Please respond
> to
> >> > > >> >> >> hbase-user
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >> Hi,
> >> > > >> >> >>
> >> > > >> >> >> I got http://issues.apache.org/jira/browse/HBASE-2037
> that
> >> can
> >> > > >> create a
> >> > > >> >> >> new
> >> > > >> >> >> table with index, but can I add index in an
> existing table?
> >> > > >> >> >> Any code examples?
> >> > > >> >> >>
> >> > > >> >> >> Thanks.
> >> > > >> >> >>
> >> > > >> >> >> Shen
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >>
> >> > >
> >> >
> >>
> >> ---------------------------------------------------------------------------
> >> > > >> >> >>
> TSMC
> >> > > >> PROPERTY
> >> > > >> >> >> This email communication (and any attachments)
> is proprietary
> >> > > >> >> >> information
> >> > > >> >> >> for the sole use of its
> >> > > >> >> >> intended recipient. Any unauthorized review,
> use or
> >> > distribution
> >> > > by
> >> > > >> >> >> anyone
> >> > > >> >> >> other than the intended
> >> > > >> >> >> recipient is strictly prohibited. If you
> are not the
> >> intended
> >> > > >> >> >> recipient,
> >> > > >> >> >> please notify the sender by
> >> > > >> >> >> replying to this email, and then delete this
> email and any
> >> > copies
> >> > > >> of
> >> > > >> >> >> it
> >> > > >> >> >> immediately. Thank you.
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >>
> >> > >
> >> >
> >>
> >> ---------------------------------------------------------------------------
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >>
> >> > > >> >> >
> >> > > >> >> >
> >> > > >> >> > --
> >> > > >> >> > *****************************************************
> >> > > >> >> > Ching-Shen Chen
> >> > > >> >> > Advanced Technology Center,
> >> > > >> >> > Information & Communications Research Lab.
> >> > > >> >> > E-mail: chenchings...@itri.org.tw
> >> > > >> >> > Tel:+886-3-5915542
> >> > > >> >> > *****************************************************
> >> > > >> >> >
> >> > > >> >
> >> > > >> >
> >> > > >>
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> >
>
>
