But how to achieve dynamic partitioning. For each row in mysql date from column get partition name and insert in corresponding partition in hive. Sqoop requires partition t be told beforehand.
On Fri, May 2, 2014 at 8:36 AM, unmesha sreeveni <unmeshab...@gmail.com>wrote: > I suggest you to go for sqoop - They imports data from RDBMS. > > > On Thu, May 1, 2014 at 7:13 PM, Shushant Arora > <shushantaror...@gmail.com>wrote: > >> Hi >> >> I have a requirement to transfer data from RDBMS mysql to partitioned >> hive table >> Partitioned on Year and month. >> Each record in mysql data contains timestamp of user activity. >> >> What is the best tool for that. >> >> 1.Shall I go with sqoop? >> >> 2.How to compute dynamic partition from RDBMS data . >> >> Shall I bucketised my fetched data on User Key. >> Shall I use day also in partition? >> My requirement is to analyse user activity per day basis. >> >> Thanks >> Shushant >> >> >> >> > > > -- > *Thanks & Regards * > > > *Unmesha Sreeveni U.B* > *Hadoop, Bigdata Developer* > *Center for Cyber Security | Amrita Vishwa Vidyapeetham* > http://www.unmeshasreeveni.blogspot.in/ > > >
