Thanks Micheal!
On Tue, Feb 7, 2017 at 4:49 PM, Michael Armbrust <mich...@databricks.com> wrote: > Here a JIRA: https://issues.apache.org/jira/browse/SPARK-19497 > > We should add this soon. > > On Tue, Feb 7, 2017 at 8:35 AM, Sam Elamin <hussam.ela...@gmail.com> > wrote: > >> Hi All >> >> When trying to read a stream off S3 and I try and drop duplicates I get >> the following error: >> >> Exception in thread "main" org.apache.spark.sql.AnalysisException: >> Append output mode not supported when there are streaming aggregations on >> streaming DataFrames/DataSets;; >> >> >> Whats strange if I use the batch "spark.read.json", it works >> >> Can I assume you cant drop duplicates in structured streaming >> >> Regards >> Sam >> > >
