Re: Hive to Oracle using Spark - Type(Date) conversion issue

2018-03-20 Thread Gurusamy Thirupathy
etails/examples? Do you aim at a generic hive to > Oracle import tool using Spark? Sqoop would not be an alternative? > > On 20. Mar 2018, at 03:45, Gurusamy Thirupathy <thirug...@gmail.com> > wrote: > > Hi guha, > > Thanks for your quick response, option a and b are

Re: Hive to Oracle using Spark - Type(Date) conversion issue

2018-03-19 Thread Gurusamy Thirupathy
e to temp table and then merge the data. > But this may be expensive solution. > > Thanks > Deepak > > On Mon, Mar 19, 2018, 08:04 Gurusamy Thirupathy <thirug...@gmail.com> > wrote: > >> Hi, >> >> I am trying to read data from Hive as DataFrame,

Hive to Oracle using Spark - Type(Date) conversion issue

2018-03-18 Thread Gurusamy Thirupathy
Hi, I am trying to read data from Hive as DataFrame, then trying to write the DF into the Oracle data base. In this case, the date field/column in hive is with Type Varchar(20) but the corresponding column type in Oracle is Date. While reading from hive , the hive table names are dynamically

Subtract two DataFrames is not working

2016-05-26 Thread Gurusamy Thirupathy
I have to subtract two dataframes, I tried with except method but it's not working. I tried with drop also. I am using spark 1.4.1 version. And Scala 2.10. Can you please help? Thanks, Guru