Which version of branch-1 to pick up for product environment

Hi All, As titled, now we're using 0.98.12 in our product env but would like to do some planing for upgrading to branch-1. I could see 1.1.2 is coming soon but 1.2 is also in progress w/ some important improvements, so my question basically includes two parts: a) If for planning (not action), whic

Thrift node.js code not working

Hi, I am trying to use following code to test HBase Thrift interface for Node.js but it is not working. *var thrift = require('thrift');* *var hbase = require('./gen-nodejs/THBaseService');* *var hbaseTypes = require('./gen-nodejs/hbase_types');* *var connection = thrift.createConnection('nn2',

Re: Thrift node.js code not working

Which hbase release are you using ? Which version of thrift do you use in your app ? Thanks > On Aug 24, 2015, at 5:00 AM, Chandrashekhar Kotekar > wrote: > > Hi, > > I am trying to use following code to test HBase Thrift interface for > Node.js but it is not working. > > *var thrift = re

Re: Thrift node.js code not working

I am using HBase 0.98.6 which is shipped with CDH 5.3.0, Thrift compiler version is 0.9.2 and I guess I have started HBase thrift server. I am not sure if Thrift2 is available with 0.98.6 or not and even if it is available not sure how do I start thrift2 service. Regards, Chandrash3khar Kotekar M

Re: Thrift node.js code not working

Looking at pom.xml in 0.98 branch I see: 0.9.0 Not sure which thrift version is used in CDH. BTW thrift2 is supported in 0.98 Take a look at hbase-thrift module and its git log. Cheers On Mon, Aug 24, 2015 at 5:47 AM, Chandrashekhar Kotekar < shekhar.kote...@gmail.com> wrote: > I am using H

Re: Thrift node.js code not working

Figured it out. I was passing wrong javascript object to that method but now getting ' ERROR thrift.ProcessFunction: Internal error processing get' error in Thrift server logs. Shall I write separate thread about this error? Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Mon, Aug 24,

Re: Thrift node.js code not working

Separate thread would be good - with pastebin of relevant error / exception. Please check region server log as well. > On Aug 24, 2015, at 7:05 AM, Chandrashekhar Kotekar > wrote: > > Figured it out. I was passing wrong javascript object to that method but > now getting ' ERROR thrift.Proc

Re: Thrift node.js code not working

Okay. thanks. Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Mon, Aug 24, 2015 at 7:43 PM, Ted Yu wrote: > Separate thread would be good - with pastebin of relevant error / > exception. > > Please check region server log as well. > > > > > On Aug 24, 2015, at 7:05 AM, Chandrashekha

thrift.ProcessFunction: Internal error processing get

Hi, I have generated node.js files using Thrift and trying to get a single row from HBase. I am getting thrift.ProcessFunction: Internal error processing get error when I execute Node.js code. When I try to put dummy column to existing row then I get this

Re: thrift.ProcessFunction: Internal error processing get

When I clicked on http://pastebin.com/embed.php?i=r9uqr8iN , I didn't see 'Internal error ' message. I tried the above operation both at home and at work. Can you double check your code, considering the 'Invalid method name' message ? Thanks On Mon, Aug 24, 2015 at 7:32 AM, Chandrashekhar Koteka

optimal size for Hbase.hregion.memstore.flush.size and its impact

Hi all, The default size of Hbase.hregion.memstore.flush.size is define as 128 MB for Hbase.hregion.memstore.flush.size. Could anyone kindly explain what would be the impact if we increase this to a higher value 512 MB or 800 MB or higher. We have a very write heavy cluster. Also we run periodi

Re: optimal size for Hbase.hregion.memstore.flush.size and its impact

1. How many regions per RS? 2. What is your dfs.block.size? 3. What is your hbase.regionserver.maxlogs? Flush can be requested when: 1. Region size exceeds hbase.hregion.memstore.flush.size 2. Region's memstore is too old (periodic memstore flusher checks the age of memstore, default is 1hour) Co

Re: optimal size for Hbase.hregion.memstore.flush.size and its impact

The split policy also uses the flush size to estimate how to split tables... It's sometime fine to upgrade thise number a bit. Like, to 256MB. But 512 is pretty high And 800MB is even more. Big memstores takes more time to get flush and can block the writes if they are not fast enough. If you

Re: optimal size for Hbase.hregion.memstore.flush.size and its impact

Related please see HBASE-13408 HBase In-Memory Memstore Compaction FYI On Mon, Aug 24, 2015 at 10:32 AM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > The split policy also uses the flush size to estimate how to split > tables... > > It's sometime fine to upgrade thise number a bit. Li

Re: optimal size for Hbase.hregion.memstore.flush.size and its impact

Correction: > 4. WAL is rolling prematurely, controlled by hbase.regionserver.maxlogs and dfs.block.size. Should read: 4. WAL is rolling, controlled by hbase.regionserver.maxlogs and dfs.block.size. -Vlad On Mon, Aug 24, 2015 at 10:36 AM, Ted Yu wrote: > Related please see HBASE-13408 H

Re: thrift.ProcessFunction: Internal error processing get

Did it worked on your system? Are you able to get some row from HBase using Node.js? Regards, Chandrash3khar Kotekar Mobile - +91 8600011455 On Mon, Aug 24, 2015 at 9:22 PM, Ted Yu wrote: > When I clicked on http://pastebin.com/embed.php?i=r9uqr8iN , I didn't > see 'Internal > error ' message.

Re: thrift.ProcessFunction: Internal error processing get

Issue resolved. Startup script shipped with CDH5.3 starts "thrift" service but in source code "hbase.thrift" file is for "Thrift2". So we need to stop "Thrift" server and start "Thrift2" server. After starting "Thrift2" server my problem got resolved. Regards, Chandrash3khar Kotekar Mobile - +91