Re: is there any tool that facilitate the import of data to hbase

2011-02-04 Thread Weishung Chung
I am looking forward to it :) btw, I found this informative video about Sqoop. http://www.cloudera.com/blog/2009/12/hadoop-world-sqoop-database-import-for-hadoop/ On Thu, Feb 3, 2011 at 4:44 PM, arv...@cloudera.com arv...@cloudera.comwrote: On Thu, Feb 3, 2011 at 2:17 PM, Weishung Chung

is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Weishung Chung
I am looking for tool that allows me to import data from mysql to hbase. Any suggestion? Thank you :)

RE: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Buttler, David
Sqoop? http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html -Original Message- From: Weishung Chung [mailto:weish...@gmail.com] Sent: Thursday, February 03, 2011 1:18 PM To: user@hbase.apache.org Subject: is there any tool that facilitate the import of data to hbase I am looking

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Ryan Rawson
ImportTSV? http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html Also writing a job to read from JDBC and write to hbase isnt too bad if your schema isnt too insanely complex. -ryan On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David buttl...@llnl.gov wrote: Sqoop?

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Mark Kerzner
Overview: http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson ryano...@gmail.com wrote: ImportTSV? http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html Also writing a job to read from

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Weishung Chung
Thank you for all the quick response. This really helps me along. How about facebook's scribe? On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner markkerz...@gmail.com wrote: Overview: http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html On Thu, Feb 3, 2011 at 3:28

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Weishung Chung
thank you for the clarification :) I am reading about sqoop now... On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner markkerz...@gmail.com wrote: scribe is a tool for log aggregation, at face value, not mysql On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung weish...@gmail.com wrote: Thank you for

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Weishung Chung
About Sqoop, could I import the data specifically into HBase ? I know I could write a program to read from mysql and use HBase API to write to HBase. On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung weish...@gmail.com wrote: thank you for the clarification :) I am reading about sqoop now... On

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread arv...@cloudera.com
On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung weish...@gmail.com wrote: About Sqoop, could I import the data specifically into HBase ? Yes - Sqoop supports direct imports from external databases into HBase. More details can be found in Sqoop documentation available

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Dani Rayan
Hey, Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase sink. Flume is similar to Scribe, but has more to it. Original Jira: https://issues.cloudera.org/browse/FLUME-6 Branch: https://github.com/cloudera/flume/tree/hbase -Thanks, Dani. http://www.cc.gatech.edu/~iar3/ On

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread Weishung Chung
Got lotsa reading to do tonite :D On Thu, Feb 3, 2011 at 4:17 PM, Dani Rayan dani.ra...@gmail.com wrote: Hey, Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase sink. Flume is similar to Scribe, but has more to it. Original Jira:

Re: is there any tool that facilitate the import of data to hbase

2011-02-03 Thread arv...@cloudera.com
On Thu, Feb 3, 2011 at 2:17 PM, Weishung Chung weish...@gmail.com wrote: that's awesome !!! could I go from HBase to Mysql too since I might have to maintain backward compatibility between the two systems in the process of switch over to HBase? At this time Sqoop supports importing data