Re: Re: Re: How to change output mode to Update

2016-05-18 Thread Sachin Aggarwal
sorry my mistake i gave wrong id here is correct one https://issues.apache.org/jira/browse/SPARK-15183 On Wed, May 18, 2016 at 11:19 AM, Todd wrote: > Hi Sachin, > > Could you please give the url of jira-15146? Thanks! > > > > > > At 2016-05-18 13:33:47, "Sachin Aggarwal"

Re:Re: Re: How to change output mode to Update

2016-05-17 Thread Todd
Hi Sachin, Could you please give the url of jira-15146? Thanks! At 2016-05-18 13:33:47, "Sachin Aggarwal" wrote: Hi, there is some code I have added in jira-15146 please have a look at it, I have not finished it. U can use the same code in ur example as of

Re: Re: How to change output mode to Update

2016-05-17 Thread Sachin Aggarwal
Hi, there is some code I have added in jira-15146 please have a look at it, I have not finished it. U can use the same code in ur example as of now On 18-May-2016 10:46 AM, "Saisai Shao" wrote: > > .mode(SaveMode.Overwrite) > > From my understanding mode is not supported

Re: Re: How to change output mode to Update

2016-05-17 Thread Saisai Shao
> .mode(SaveMode.Overwrite) >From my understanding mode is not supported in continuous query. def mode(saveMode: SaveMode): DataFrameWriter = { // mode() is used for non-continuous queries // outputMode() is used for continuous queries assertNotStreaming("mode() can only be called on

Re: How to change output mode to Update

2016-05-17 Thread Ted Yu
Have you tried adding: .mode(SaveMode.Overwrite) On Tue, May 17, 2016 at 8:55 PM, Todd wrote: > scala> records.groupBy("name").count().write.trigger(ProcessingTime("30 > seconds")).option("checkpointLocation", >