Re: HBase fail-over/reliability issues

Hi James, I'd recommend just the following in your log4j properties to tone down the log volume: log4j.logger.org.apache.hadoop.fs.FSNamesystem.audit=WARN log4j.logger.org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace=WARN This will keep the INFO level logs that are very useful for deb

Re: locality and tasktracker vs split hostname

On Mon, May 10, 2010 at 6:26 PM, John Sichi wrote: >... > (a) making the Hadoop locality code use a hostname comparison which is > insensitive to the presence of the trailing dot > > or > > (b) making the HBase split's hostname consistent with the task tracker > > Any opinions? > Lets do (b). U

locality and tasktracker vs split hostname

Hi there, I was running a mapreduce job (via Hive) against HBase, and noticed that I wasn't getting any locality (the input split location and the task tracker machine in the job tracker UI were always different, and "Rack-local map tasks" in the job counters was 0). I tracked this down to a d

Re: java.lang.IllegalAccessError while opening region

This looks like https://issues.apache.org/jira/browse/HBASE-1925. A storefile in the problematic region is missing its sequenceid. Try and figure it (see the issue for clues). There is also the hfile tool for examing metainfo in storefiles: ./bin/hbase org.apache.hadoop.hbase.io.hfile.HFile Do

java.lang.IllegalAccessError while opening region

Hi All, I have reams of errors in my master log for a single region. It keeps trying and failing to open the region. An example of the exception is below. Are there conceivable ways of fixing this or am I most likely going to have to delete the region. If deleting the region is the likely optio

Re: Deprecated Table Map in Hbase-0.20.3

JD Your explanation was very helpful ! Thanks for replying ! On Mon, May 10, 2010 at 10:29 PM, Jean-Daniel Cryans wrote: > Two things: > > First TableMap was using the raw type instead of a generic one, this > was fixed in https://issues.apache.org/jira/browse/HBASE-876 > > Then it wasn't gene

Re: Got some question for begin HBase (KeyValue, data structure)

Inline. J-D > 1. How can i get the key name for KeyValue? I > use Bytes.toString(KeyValue.getKey()) cannot got any return. The javadoc of this method says: * Do not use unless you have to. Used internally for compacting and testing. The row key is given by http://hadoop.apache.org/hbase/docs/r0

Re: Enabling Indexing in HBase

Did you include the jar (contrib/indexed/hbase-0.20.3-indexed.jar) in your class path? J-D On Mon, May 10, 2010 at 6:43 AM, Michelan Arendse wrote: > Hi. > > I added the following properties  to hbase-site.xml > >        hbase.regionserver.class >        org.apache.hadoop.hbase.ipc.IndexedRegio

Re: HBase fail-over/reliability issues

Hi Todd, Our log files were getting to be several gigabytes in size at the INFO level (particularly the datanode logs), so we changed the log level in all log4j configs to be WARN. Do you think we're potentially missing some useful information at INFO and lower? I could lower the log level if yo

Re: Deprecated Table Map in Hbase-0.20.3

Two things: First TableMap was using the raw type instead of a generic one, this was fixed in https://issues.apache.org/jira/browse/HBASE-876 Then it wasn't generic enough, so this was filed https://issues.apache.org/jira/browse/HBASE-1725 That's the explanation. I remember having the same issue

Enabling Indexing in HBase

Hi. I added the following properties to hbase-site.xml hbase.regionserver.class org.apache.hadoop.hbase.ipc.IndexedRegionInterface hbase.regionserver.impl org.apache.hadoop.hbase.regionserver.tableindexed.IndexedRegionServer I'm

Re: HBase Design Considerations

Hi Saajan, you may be interested in an integration project of Lucene+HBase: http://github.com/akkumar/hbasene Best regards, Thomas Koch, http://www.koch.ro

Re: Help! Cannot reply to the mailing list

Hi, Jeff I'm using plain text format. As my previous mail shows, the mail header contains the following: Content-Type: text/plain; However, I can't figure out what the following line indicates. This may be related, but I couldn't find useful information. format=flowed; Maumau -

Re: Help! Cannot reply to the mailing list

I encounter this same problem before, You only need to use Plain text format rather than rich formatting to solve this problem. 2010/5/10 MauMau : > Hi, > > Whenever I reply to the mailing list, I get the following error reply and > can't send the reply. I'm using Gmail. When I send the same mail

Help! Cannot reply to the mailing list

Hi, Whenever I reply to the mailing list, I get the following error reply and can't send the reply. I'm using Gmail. When I send the same mail from the same Gmail account to my non-Gmail account, I succeed. I searched for the solution at Google with the keyword "552 552 spam score (5.8) exce

Regarding IntSet implementation

Hi folks, I have to use numerous search criteria and each having lots of distinct values. So, the secondary indexing like IHBase will require lots of memory. I think I require a custom index implementation in which I decided to persist some of the IHBase like implementation. For that case I n

Deprecated Table Map in Hbase-0.20.3

Hey folks , I have a small question regarding TableMap class. I know it is deprecated in 0.20.3 , But the declaration was changed from public interface TableMap extends Mapper TO public interface TableMap, V extends Writable> extends Mapper { Why is there an additional restriction on K tha

Got some question for begin HBase (KeyValue, data structure)

Hi, I'm new to HBase, i would like to ask some question for read data via java code. 1. How can i get the key name for KeyValue? I use Bytes.toString(KeyValue.getKey()) cannot got any return. 2. Usually what value are u set for rowid? 3. How are you deploy the data structure from development serv

RE: working with versions

Can you please elaborate (or refer me to the documentation) on the versions mechanism - 1. What's the trigger for a new version creation ? 2. can I control version creation ? 3. For which scenarios should I use versions ? Thanks, Lior -Original Message- From: Ryan Rawson [mailto:ryano.