I do not know if there is a general hbase load/import tool. That
would be a good question for the hbase-user list.
Right now Pig does not have a store function to write data into
hbase. It is possible to write such a function. If you are
interested I can send you specific details on how to do it.
Alan.
On Aug 19, 2009, at 12:49 PM, Nikhil Gupta wrote:
Hi all,
I am working no building a analytics kind of engine which takes
daily server
logs, crunches the data using Pig scripts and (for now) outputs data
to
HDFS. Later, this data is to be stored on HBase to enable efficient
querying
from front-end.
Currently, I am searching for efficient ways of moving the Pig
output on
HDFS to the HBase tables. Though this seems to be a very basic task,
I could
not find any easy way of doing that, except for writing some Java
code. The
problem is I'll have many different kind of output formats, and
writing java
code for loading each such file seems wrong. Probably I am missing
something.
Is there any way of storing Pig output directly in a Hbase table
[loading is
possible by HBaseStorage, but that doesn't talk of storing]. Or is
there any
general data load/import tool for Hbase?
Thanks!
Nikhil Gupta
Graduate Student,
Stanford University
