I am looking forward to it :) btw, I found this informative video about Sqoop. http://www.cloudera.com/blog/2009/12/hadoop-world-sqoop-database-import-for-hadoop/
On Thu, Feb 3, 2011 at 4:44 PM, arv...@cloudera.com <arv...@cloudera.com>wrote: > On Thu, Feb 3, 2011 at 2:17 PM, Weishung Chung <weish...@gmail.com> wrote: > > > that's awesome !!! > > could I go from HBase to Mysql too since I might have to maintain > > backward compatibility between the two systems in the process of switch > > over > > to HBase? > > > > At this time Sqoop supports importing data from external databases into > Hive > and HBase. However, exporting is not directly supported. You could extract > data into HDFS and then move it back to the external system possibly. > > We are working on providing export capability from HBase and Hive > to external databases in Sqoop. This will likely be implemented in the next > few releases. > > Arvind > > > > > > On Thu, Feb 3, 2011 at 4:11 PM, arv...@cloudera.com <arv...@cloudera.com > > >wrote: > > > > > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <weish...@gmail.com> > > wrote: > > > > > > > About Sqoop, could I import the data specifically into HBase ? > > > > > > > > > > Yes - Sqoop supports direct imports from external databases into HBase. > > > More > > > details can be found in Sqoop documentation available > > > here< > > > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase > > > > > > > . > > > > > > Arvind > > > > > > > > > > I know I could write a program to read from mysql and use HBase API > to > > > > write > > > > to HBase. > > > > > > > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <weish...@gmail.com> > > > wrote: > > > > > > > > > thank you for the clarification :) I am reading about sqoop now... > > > > > > > > > > > > > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner < > markkerz...@gmail.com > > > > >wrote: > > > > > > > > > >> scribe is a tool for log aggregation, at face value, not mysql > > > > >> > > > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung < > weish...@gmail.com> > > > > >> wrote: > > > > >> > > > > >> > Thank you for all the quick response. This really helps me > along. > > > How > > > > >> about > > > > >> > facebook's scribe? > > > > >> > > > > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner < > > markkerz...@gmail.com > > > > > > > > >> > wrote: > > > > >> > > > > > >> > > Overview: > > > > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html > > > > >> > > > > > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson < > ryano...@gmail.com > > > > > > > >> wrote: > > > > >> > > > > > > >> > > > ImportTSV? > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html > > > > >> > > > > > > > >> > > > Also writing a job to read from JDBC and write to hbase isnt > > too > > > > bad > > > > >> > > > if your schema isnt too insanely complex. > > > > >> > > > > > > > >> > > > -ryan > > > > >> > > > > > > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David < > > > buttl...@llnl.gov > > > > > > > > > >> > > wrote: > > > > >> > > > > Sqoop? > > > > >> > > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html > > > > >> > > > > > > > > >> > > > > -----Original Message----- > > > > >> > > > > From: Weishung Chung [mailto:weish...@gmail.com] > > > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM > > > > >> > > > > To: user@hbase.apache.org > > > > >> > > > > Subject: is there any tool that facilitate the import of > > data > > > to > > > > >> > hbase > > > > >> > > > > > > > > >> > > > > I am looking for tool that allows me to import data from > > mysql > > > > to > > > > >> > > hbase. > > > > >> > > > Any > > > > >> > > > > suggestion? > > > > >> > > > > Thank you :) > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > > > > > > > > > > > > > > > > >
