subject:"Spark Hive Rejection"

Re: Spark Hive Rejection

2016-09-29 Thread Michael Segel

Correct me if I’m wrong but isn’t hive schema on read and not on write? So you shouldn’t fail on write. On Sep 29, 2016, at 1:25 AM, Mostafa Alaa Mohamed > wrote: Dears, I want to ask • What will happened if there are

Spark Hive Rejection

2016-09-29 Thread Mostafa Alaa Mohamed

Dears, I want to ask * What will happened if there are rejections rows when inserting dataframe into hive? o Rejection will be for example table required integer into column and dataframe include string. o Duplication rejection restriction from the table itself? * How can