[DISCUSS] Disable streaming query with possible correctness issue by default

2020-11-06 Thread Liang-Chi Hsieh
Hi devs, In Spark structured streaming, chained stateful operators possibly produces incorrect results under the global watermark. SPARK-33259 (https://issues.apache.org/jira/browse/SPARK-33259) has an example demostrating what the correctness issue could be. Currently we don't prevent users

Re: [VOTE] Standardize Spark Exception Messages SPIP

2020-11-06 Thread Xiao Li
+1 On Fri, Nov 6, 2020 at 6:23 AM Gengliang Wang wrote: > +1 > > On Nov 6, 2020, at 1:52 PM, Wenchen Fan wrote: > > +1 > > On Fri, Nov 6, 2020 at 12:56 PM kalyan wrote: > >> +1 >> >> On Fri, Nov 6, 2020, 5:58 AM Matei Zaharia >> wrote: >> >>> +1 >>> >>> Matei >>> >>> > On Nov 5, 2020, at

Re: [VOTE] Standardize Spark Exception Messages SPIP

2020-11-06 Thread Gengliang Wang
+1 > On Nov 6, 2020, at 1:52 PM, Wenchen Fan wrote: > > +1 > > On Fri, Nov 6, 2020 at 12:56 PM kalyan > wrote: > +1 > > On Fri, Nov 6, 2020, 5:58 AM Matei Zaharia > wrote: > +1 > > Matei > > > On Nov 5, 2020, at 10:25 AM,