autoflush, modify/drop columns via Thrift

2010-11-22 Thread Saptarshi Guha
Hello, Having gone through the Hbase thift file in 0.89.20100924, I couldn't find a way to turn of autoflush (it appears that ThriftServer.java does not turn it off either before a large insert/delete). Also, is it possible to drop/modify columns to an HBase table? Comments like this /** * An H

DemoClient.cpp modifications and question about thrift client / HBase 0.89.20100924

2010-11-21 Thread Saptarshi Guha
0) The DemoClient.cpp (versions, see [a]) does not compile on FC8 with thrift 0.5. I modified DemoClient.cpp to make it work. I've attached a diff. (Compiles on OS X Snow Leopard and FC 8 (EC2 instance)) [a] HBase Change Log Release 0.89.20100924 - Fri Sep 24 13:51:36 PDT 2010 1) Question abou

Re: Ganglia website refuses connection despite proxy (Hbase EC2)

2010-11-19 Thread Saptarshi Guha
noatime /dev/sdb /mnt Cheers Joy On Fri, Nov 19, 2010 at 1:03 PM, Lars George wrote: > Let us know what you find. Thanks! > > On Fri, Nov 19, 2010 at 6:49 PM, Saptarshi Guha > wrote: > > Yes, messages is the right place. Saw this > > Nov 19 12:25:26 ip-10-98-154-214 /

Re: Adding packages to the HBase AMI (ami-fe698397 and ami-c86983a1) - no space on device

2010-11-19 Thread Saptarshi Guha
7;) to hang the additional > storage off arbitrary points in your filesystem hierarchy. > > Best regards, > >- Andy > > > --- On Fri, 11/19/10, Saptarshi Guha wrote: > > > From: Saptarshi Guha > > Subject: Re: Adding packages to the HBase AMI (ami-fe6983

Re: Adding packages to the HBase AMI (ami-fe698397 and ami-c86983a1) - no space on device

2010-11-19 Thread Saptarshi Guha
there something more to it than just longer start up times? Cheers and thanks Joy On Fri, Nov 19, 2010 at 2:11 PM, Saptarshi Guha wrote: > Hello, > > Both packages have HBAse 0.89.20100726 installed, the former is c1.xlarge > and the latter is medium). > I'm trying to install

Adding packages to the HBase AMI (ami-fe698397 and ami-c86983a1) - no space on device

2010-11-19 Thread Saptarshi Guha
Hello, Both packages have HBAse 0.89.20100726 installed, the former is c1.xlarge and the latter is medium). I'm trying to install some extra packages (see [1]) By the time I've come to install R, I'm almost out of space on the root device. I would like to add some packages to the task nodes (whic

Re: Ganglia website refuses connection despite proxy (Hbase EC2)

2010-11-19 Thread Saptarshi Guha
essages or so. > > Please feel free to add any idea to the above WHIRR-25 > (https://issues.apache.org/jira/browse/WHIRR-25) so that we can > include it. > > Lars > > On Fri, Nov 19, 2010 at 8:55 AM, Saptarshi Guha > wrote: > > Hello, > > > > Thanks to

Re: Ganglia website refuses connection despite proxy (Hbase EC2)

2010-11-19 Thread Saptarshi Guha
gt; please have a look into the logs on the servers, the user scripts > usually log their process in the /var/log/messages or so. > > Please feel free to add any idea to the above WHIRR-25 > (https://issues.apache.org/jira/browse/WHIRR-25) so that we can > include it. > > Lars >

Ganglia website refuses connection despite proxy (Hbase EC2)

2010-11-18 Thread Saptarshi Guha
Hello, Thanks to apurtells github repo of the hbase-ec2 i managed to start an hbase cluster. Everything works nicely, I can check the uis of the JT/NN and Hbase Master. What I cant see are the ganglia metrics despite the url provided by the proxy http://ec2-a-b-c-d.compute-1.amazonaws.com/gangli

Re: TableInputFormat vs. a map of table regions (data locality)

2010-11-18 Thread Saptarshi Guha
st a thin wrapper around the raw API. > > And as Alex pointed out and you noticed too, [2] adds the benefit to > have locality support. If you were to add this to [1] then you have > [2]. > > Lars > > On Thu, Nov 18, 2010 at 5:30 AM, Saptarshi Guha > wrote: >> Hell

TableInputFormat vs. a map of table regions (data locality)

2010-11-17 Thread Saptarshi Guha
Hello, I'm fairly new to HBase and would appreciate your comments. [1] One way compute across an HBase dataset would be to run as many maps as regions, for each map, run a scan across the region row limits (within the map method). This approach does not use TableInputFormat.In the reduce (if need