Re: Can Spark Execute Hive Update/Delete operations

2015-12-03 Thread
, Dec 2, 2015 at 9:58 PM Ted Yu <yuzhih...@gmail.com> wrote: > The referenced link seems to be w.r.t. Hive on Spark which is still in its > own branch of Hive. > > FYI > > On Tue, Dec 1, 2015 at 11:23 PM, 张炜 <zhangwei...@gmail.com> wrote: > >> Hello Ted and al

Re: Can Spark Execute Hive Update/Delete operations

2015-12-01 Thread
<yuzhih...@gmail.com> wrote: > Can you tell us the version of Spark and hive you use ? > > Thanks > > On Tue, Dec 1, 2015 at 7:08 PM, 张炜 <zhangwei...@gmail.com> wrote: > >> Dear all, >> We have a requirement that needs to update delete records in hive. The

Re: Hive on Spark orc file empty

2015-11-16 Thread
being member of DataFrame. > error:value write is not a member of org.apache.spark.sql.DataFrame > > Thanks > Deepak > > On Mon, Nov 16, 2015 at 4:10 PM, 张炜 <zhangwei...@gmail.com> wrote: > >> Dear all, >> I am following this article to try Hive on Spark &g

Hive on Spark orc file empty

2015-11-16 Thread
Dear all, I am following this article to try Hive on Spark http://hortonworks.com/hadoop-tutorial/using-hive-with-orc-from-apache-spark/ My environment: Hive 1.2.1 Spark 1.5.1 in a nutshell, I ran spark-shell, created a hive table hiveContext.sql("create table yahoo_orc_table (date STRING,