Re: [VOTE] Release Spark 3.2.2 (RC1)

2022-07-12 Thread Mridul Muralidharan
+1 Signatures, digests, etc check out fine. Checked out tag and build/tested with "-Pyarn -Pmesos -Pkubernetes" As always, the test "SPARK-33084: Add jar support Ivy URI in SQL" in sql.SQLQuerySuite fails in my env; but other than that, the rest looks good. Regards, Mridul On Tue, Jul 12,

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread qcsd2011
Hi dev,We would like raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread qcsd2011
Hi dev,We would like raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread stc
Hi dev, We would like raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 35669.

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread Jacky Lee
Hi dev, We would like to raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 35669

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread Jacky Lee
Hi dev, We would like to raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 35669

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread qcsd2011
Hi dev,We would like to raise a discussion about supporting `DataFilterpushed down dynamically`. We are trying to push down dataFilter withPartitionFilter, and prune partitionFilter at runtime before push toparquet, which can push less filter to parquet. More details

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread Jacky Lee
Hi dev, We would like raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 35669

[DISCUSS] DataFilter pushed down dynamically

2022-07-12 Thread Jacky Lee
Hi dev, We would like to raise a discussion about supporting `DataFilter pushed down dynamically`. We are trying to push down dataFilter with PartitionFilter, and prune partitionFilter at runtime before push to parquet, which can push less filter to parquet. More details can be found in 35669.

Re: [VOTE] Release Spark 3.2.2 (RC1)

2022-07-12 Thread Maxim Gekk
+1 On Tue, Jul 12, 2022 at 11:05 AM Yang,Jie(INF) wrote: > +1 (non-binding) > > > > Yang Jie > > > > > > *发件人**: *Dongjoon Hyun > *日期**: *2022年7月12日 星期二 16:03 > *收件人**: *dev > *抄送**: *Cheng Su , "Yang,Jie(INF)" , > Sean Owen > *主题**: *Re: [VOTE] Release Spark 3.2.2 (RC1) > > > > +1 > > > >

Re: [VOTE] Release Spark 3.2.2 (RC1)

2022-07-12 Thread Yang,Jie(INF)
+1 (non-binding) Yang Jie 发件人: Dongjoon Hyun 日期: 2022年7月12日 星期二 16:03 收件人: dev 抄送: Cheng Su , "Yang,Jie(INF)" , Sean Owen 主题: Re: [VOTE] Release Spark 3.2.2 (RC1) +1 Dongjoon. On Mon, Jul 11, 2022 at 11:34 PM Cheng Su mailto:scnj...@gmail.com>> wrote: +1 (non-binding). Built from

Re: [VOTE] Release Spark 3.2.2 (RC1)

2022-07-12 Thread Dongjoon Hyun
+1 Dongjoon. On Mon, Jul 11, 2022 at 11:34 PM Cheng Su wrote: > +1 (non-binding). Built from source, and ran some scala unit tests on M1 > mac, with OpenJDK 8 and Scala 2.12. > > Thanks, > Cheng Su > > On Mon, Jul 11, 2022 at 10:31 PM Yang,Jie(INF) > wrote: > >> Does this happen when running

Re: [VOTE] Release Spark 3.2.2 (RC1)

2022-07-12 Thread Dongjoon Hyun
I also didn't hit that issue (Temurin Java 8 on Intel MacOS). $ java -version openjdk version "1.8.0_332" OpenJDK Runtime Environment (Temurin)(build 1.8.0_332-b09) OpenJDK 64-Bit Server VM (Temurin)(build 25.332-b09, mixed mode) $ sw_vers ProductName: macOS ProductVersion: 12.4 Dongjoon. On

Re: [VOTE] Release Spark 3.2.2 (RC1)

2022-07-12 Thread Cheng Su
+1 (non-binding). Built from source, and ran some scala unit tests on M1 mac, with OpenJDK 8 and Scala 2.12. Thanks, Cheng Su On Mon, Jul 11, 2022 at 10:31 PM Yang,Jie(INF) wrote: > Does this happen when running all UTs? I ran this suite several times > alone using OpenJDK(zulu) 8u322-b06 on