Re: Spark 3.2 - ReusedExchange not present in join execution plan

2022-01-06 Thread Abdeali Kothari
Thanks a lot for the reply Albert. On looking at it and reading about it further - I do see that "AdaptiveSparkPlan isFinalPlan=false" is mentioned. Could you point me to how I can see the final plan ? I couldn't find that in any of the resources I was referring to On Fri, 7 Jan 2022, 07:25

Re: Spark 3.2 - ReusedExchange not present in join execution plan

2022-01-06 Thread Albert
I happen to encounter something similar. it's probably because you are just `explain` it. when you actually `run` it. you will get the final spark plan in which case the exchange will be reused. right, this is different compared with 3.1 probably because the upgraded aqe. not sure whether this

Re: [VOTE][SPIP] Support Customized Kubernetes Schedulers Proposal

2022-01-06 Thread John Zhuge
+1 (non-binding) On Thu, Jan 6, 2022 at 8:39 AM Chenya Zhang wrote: > +1 (non-binding) > > On Thu, Jan 6, 2022 at 1:30 AM Mich Talebzadeh > wrote: > >> +1 (non-binding) >> >> >> >>view my Linkedin profile >> >> >> >> >>

Re: [VOTE][SPIP] Support Customized Kubernetes Schedulers Proposal

2022-01-06 Thread Chenya Zhang
+1 (non-binding) On Thu, Jan 6, 2022 at 1:30 AM Mich Talebzadeh wrote: > +1 (non-binding) > > > >view my Linkedin profile > > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or

Re: [DISCUSSION] SPIP: Support Volcano/Alternative Schedulers Proposal

2022-01-06 Thread Mich Talebzadeh
Further to this, I think we ought to broaden *Background and Motivation section *of the proposed doc to give more impetus to reasons behind this project. I quote " Kubernetes is

Re: [VOTE][SPIP] Support Customized Kubernetes Schedulers Proposal

2022-01-06 Thread Mich Talebzadeh
+1 (non-binding) view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical

Re: About contribution

2022-01-06 Thread Dennis Jung
Oh, yes. Also check on that. I just want to know if there's a bit more detail about contribution, because not just for contribution, but also want to know more deeply of spark project. - To review the base code, what is a good point to start? - Or recommending a blog post or document will be