Integration of Hadoop Streaming with Ruby and HBase

2012-03-16 Thread Subir S
Hi, I just joined HBase user list. So this is my first question :-) Is there any way i can dump the output of my Ruby Map Reduce jobs into HBase directly? In other words does Hadoop Streaming with Ruby integrate with HBase? Like Pig has HBaseStorage etc. Thanks in advance! Regards Subir

Re: gc pause killing regionserver

2012-03-16 Thread Ferdy Galema
CPU resources never was a problem, munin shows there is enough idle time. Although the graphs might exclude sharp peaks, I'm pretty certain CPU is not a problem. After some experiments it seems that disabling swap indeed seems to be the solution to the aborting regionserver problem. I reverted

Re: Can anyone show me how to construct the HFileReaderV2 object to read the HFile content.

2012-03-16 Thread Stack
On Fri, Mar 16, 2012 at 9:01 AM, yonghu yongyong...@gmail.com wrote: Hello, Can anyone give me a example to construct the  HFileReaderV2 object to read the HFile content. Thanks! See http://hbase.apache.org/xref/org/apache/hadoop/hbase/io/hfile/HFile.html#499 St.Ack

Re: Can anyone show me how to construct the HFileReaderV2 object to read the HFile content.

2012-03-16 Thread yonghu
I implemented the code like this way. My Hbase version is 0.92.0. Configuration conf = new Configuration(); CacheConfig cconf = new CacheConfig(conf); FileSystem fs = FileSystem.get(conf); Path path = new

Re: Streaming data processing and hBase

2012-03-16 Thread N Keywal
Hi, The way you describe the in memory caching component, it looks very similar to HBase memstore. Any reason for not relying on it? N. On Fri, Mar 16, 2012 at 4:21 PM, Kleegrewe, Christian christian.kleegr...@siemens.com wrote: Dear all, We are currently working on an architecture for a

Re: Problem accessing table.jsp page in HBase

2012-03-16 Thread anil gupta
Hi Steven, Thanks for your reply. The folder is present under the hbase home directory. Here is the output of ls -lRt run on that folder: [root@namenode1 hbase]# ls -lRt hbase-webapps/ hbase-webapps/: total 12 drwxr-xr-x. 2 root root 4096 Jan 20 08:26 static drwxr-xr-x. 3 root root 4096 Jan 20

ANN: HBase 0.90.6 is available for download

2012-03-16 Thread Ramakrishna s vasudevan
Hi All, Your HBase Crew are pleased to announce the release of HBase 0.90.6. Download it from your favourite Apache mirror [1]. HBase 0.90.6 is a bug-fix version on the 0.90 branch, with a handful of issues fixed in it. For the complete list of changes, see the release notes [2]. Yours The

Re: Can anyone show me how to construct the HFileReaderV2 object to read the HFile content.

2012-03-16 Thread yonghu
I noticed the problem is that somehow I lost the data from hdfs. The code is ok. Regards! Yong On Fri, Mar 16, 2012 at 5:59 PM, yonghu yongyong...@gmail.com wrote: I implemented the code like this way. My Hbase version is 0.92.0.                Configuration conf = new Configuration();      

Re: HBase Region splitting may times.

2012-03-16 Thread hdev ml
Does anybody have an answer to this? Please let me know. Thanks Harshad On Mar 15, 2012, at 11:12 PM, hdev ml wrote: Hi, We are using HBase version 0.90.3 in a 2 node cluster. Maybe this question has been asked too many times. But I could not find a good answer for this. I

Re: HBase Region splitting may times.

2012-03-16 Thread Jean-Daniel Cryans
On Fri, Mar 16, 2012 at 10:40 AM, hdev ml hde...@gmail.com wrote: Does anybody have an answer to this? Is there a hurry? Have you tried gathering more data about it? I created a test table with one column family cf with 2 columns a and b, each having value of a 3000 character long string.

Re: HBase Region splitting may times.

2012-03-16 Thread hdev ml
Thanks J-D for the answers. My answers in *bold* below. On Fri, Mar 16, 2012 at 10:52 AM, Jean-Daniel Cryans jdcry...@apache.orgwrote: On Fri, Mar 16, 2012 at 10:40 AM, hdev ml hde...@gmail.com wrote: Does anybody have an answer to this? Is there a hurry? Have you tried gathering more data

Re: Can anyone show me how to construct the HFileReaderV2 object to read the HFile content.

2012-03-16 Thread Stack
On Fri, Mar 16, 2012 at 10:12 AM, yonghu yongyong...@gmail.com wrote: I noticed the problem is that somehow I lost the data from hdfs. The code is ok. Regards! Why write code? The hfile tool, http://hbase.apache.org/book.html#hfile_tool2, gives a pretty rich summary on file content (or you

Re: Streaming data processing and hBase

2012-03-16 Thread N Keywal
Hi Christian, It's a component internal to HBase, so you don't have to use it directly. See http://hbase.apache.org/book/wal.html on how writes are handled by HBase to ensure reliability data distribution... Cheers, N. On Fri, Mar 16, 2012 at 7:39 PM, Kleegrewe, Christian