Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Maxim Gekk
+1 On Thu, Jan 5, 2023 at 12:25 AM huaxin gao wrote: > +1 Thanks! > > On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh wrote: > >> +1 >> >> Thank you! >> >> On Wed, Jan 4, 2023 at 9:13 AM Chao Sun wrote: >> >>> +1, thanks! >>> >>> Chao >>> >>> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan

Why does Spark SQL not support the syntax of create temporary table

2023-01-04 Thread Weiliang Hao
Hi All, I have a question why Spark SQL does not support the syntax of CREATE TEMPORARY TABLE. Thanks, Weiliang Hao

Re: Time for Spark 3.4.0 release?

2023-01-04 Thread huaxin gao
+1 Thanks! On Wed, Jan 4, 2023 at 10:19 AM L. C. Hsieh wrote: > +1 > > Thank you! > > On Wed, Jan 4, 2023 at 9:13 AM Chao Sun wrote: > >> +1, thanks! >> >> Chao >> >> On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan >> wrote: >> >>> >>> +1, Thanks ! >>> >>> Regards, >>> Mridul >>> >>> On

Re: Time for Spark 3.4.0 release?

2023-01-04 Thread L. C. Hsieh
+1 Thank you! On Wed, Jan 4, 2023 at 9:13 AM Chao Sun wrote: > +1, thanks! > > Chao > > On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan > wrote: > >> >> +1, Thanks ! >> >> Regards, >> Mridul >> >> On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang wrote: >> >>> +1, thanks for driving the

Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Chao Sun
+1, thanks! Chao On Wed, Jan 4, 2023 at 1:56 AM Mridul Muralidharan wrote: > > +1, Thanks ! > > Regards, > Mridul > > On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang wrote: > >> +1, thanks for driving the release! >> >> >> Gengliang >> >> On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun >> wrote:

Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Enrico Minack
Hi All, can we get these correctness issues fixed with the 3.4 release, please? SPARK-41162 incorrect query plan for anti-join and semi-join of self-joined aggregations (since 3.1), fix in https://github.com/apache/spark/pull/39131 SPARK-40885 loosing in-partition order for string type

[Bug] dataframe.show() prints incorrect numbers

2023-01-04 Thread Belch, Yaakov (Agoda)
What is the right process for reporting this bug in spark? SUMMARY: For some small numbers, dataframe.show() chops off the exponential field showing wrong numbers instead. HOW TO REPRODUCE THE BUG: This is a one-liner on the command line: echo 'Seq((1.8181682328650097E-4)).toDF("x").show()' |

Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Mridul Muralidharan
+1, Thanks ! Regards, Mridul On Wed, Jan 4, 2023 at 2:20 AM Gengliang Wang wrote: > +1, thanks for driving the release! > > > Gengliang > > On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun > wrote: > >> +1 >> >> Thank you! >> >> Dongjoon >> >> On Tue, Jan 3, 2023 at 9:44 PM Rui Wang wrote: >>

Re: Time for Spark 3.4.0 release?

2023-01-04 Thread Gengliang Wang
+1, thanks for driving the release! Gengliang On Tue, Jan 3, 2023 at 10:55 PM Dongjoon Hyun wrote: > +1 > > Thank you! > > Dongjoon > > On Tue, Jan 3, 2023 at 9:44 PM Rui Wang wrote: > >> +1 to cut the branch starting from a workday! >> >> Great to see this is happening! >> >> Thanks Xinrong!