Re: Issue Upgrading to 3.2

2021-11-02 Thread Linhong Liu
Hello Adam, I just made a PR that should fix your issue. Would you like to give it a try? PR Link: https://github.com/apache/spark/pull/34473 Thanks, Linhong On Tue, Nov 2, 2021 at 1:16 AM Adam Binford wrote: > Sorry yeah good question. It happens on the call to spark.table("pixels") > > On

Re: [VOTE][RESULT] SPIP: Storage Partitioned Join for Data Source V2

2021-11-02 Thread Chao Sun
Thanks all for voting on this proposal! On Tue, Nov 2, 2021 at 9:39 AM Liang Chi Hsieh wrote: > Hi all, > > The vote passed with the following 9 +1 votes and no -1 or +0 votes: > Liang-Chi Hsieh* > Russell Spitzer > Dongjoon Hyun* > Huaxin Gao > Ryan Blue > DB Tsai* > Holden Karau* > Cheng Su >

Re: [DISCUSS] SPIP: Row-level operations in Data Source V2

2021-11-02 Thread L. C. Hsieh
+1 for the idea to commit the work earlier. I think we will raise the voting soon. Once it is passed, we can submit the PRs. What do you think? Anton. On Mon, Nov 1, 2021 at 7:59 AM Wenchen Fan wrote: > > The general idea looks great. This is indeed a complicated API and we > probably need

[VOTE][RESULT] SPIP: Storage Partitioned Join for Data Source V2

2021-11-02 Thread Liang Chi Hsieh
Hi all, The vote passed with the following 9 +1 votes and no -1 or +0 votes: Liang-Chi Hsieh* Russell Spitzer Dongjoon Hyun* Huaxin Gao Ryan Blue DB Tsai* Holden Karau* Cheng Su Wenchen Fan* * = binding Thank you guys all for your feedback and votes.