Re: spark sql write orc table on viewFS throws exception

2016-05-15 Thread Mich Talebzadeh
I am not sure this is going to resolve INSERT OVEERWRITE into ORC table issue. Can you go to hive and do show create table custom.rank_less_orc_none and send the output. Is that table defined as transactional? Other alternative is to use Spark to insert into a normal text table and do insert

spark sql write orc table on viewFS throws exception

2016-05-14 Thread linxi zeng
hi, all: Recently, we have encountered a problem while using spark sql to write orc table, which is related to https://issues.apache.org/jira/browse/HIVE-10790. In order to fix this problem we decided to patched the PR to the hive branch which spark1.5 rely on. We pull the hive branch(