Re: Welcoming some new Apache Spark committers

2020-07-16 Thread Dilip Biswal
Thank you all for your kind words. A special "thank you" to *Xiao Li *for his help and mentorship over the years that helped me immensely. I would also like to mention *Wenchen Fan*, *Takeshi Yamamuro,* *Sean Owen*, *Dongjoon hyun*, *Hyukjin Kwon, *and *Liang-Chi Hsieh,* who all helped review the

Re: [DISCUSS] -1s and commits

2020-07-16 Thread Jungtaek Lim
On Fri, Jul 17, 2020 at 8:06 AM Holden Karau wrote: > > > On Thu, Jul 16, 2020 at 3:34 PM Jungtaek Lim > wrote: > >> I agree with Wenchen that there are different topics. >> > I agree. I mentioned it in my postscript because I wanted to provide the > context around why I felt extra strongly

Re: [DISCUSS] -1s and commits

2020-07-16 Thread Holden Karau
On Thu, Jul 16, 2020 at 3:34 PM Jungtaek Lim wrote: > I agree with Wenchen that there are different topics. > I agree. I mentioned it in my postscript because I wanted to provide the context around why I felt extra strongly about the importance of folks following the explicit rules. It makes it

Re: [DISCUSS] -1s and commits

2020-07-16 Thread Jungtaek Lim
I agree with Wenchen that there are different topics. The policy of veto is obvious, as ASF doc describes it with explicitly saying non-overridable per project. In any way, the approach of resolving the situation should lead to voters withdrawing their vetoes. There's nothing to interpret

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-16 Thread Holden Karau
Sounds good, thanks. No rush :) On Thu, Jul 16, 2020 at 3:03 PM shane knapp ☠ wrote: > i'll get to this tomorrow afternoon, and there will be a short downtime. > more details to come. > > On Wed, Jul 15, 2020 at 12:17 PM Holden Karau > wrote: > >> Oh cool, I filed a JIRA for this already and

Re: R installation broken on ubuntu workers, impacts K8s PRB builds

2020-07-16 Thread shane knapp ☠
i'll get to this tomorrow afternoon, and there will be a short downtime. more details to come. On Wed, Jul 15, 2020 at 12:17 PM Holden Karau wrote: > Oh cool, I filed a JIRA for this already and assigned it to you (noticed > in one of my PRs)- https://issues.apache.org/jira/browse/SPARK-32326 >

Catalog API for Partition

2020-07-16 Thread JackyLee
Hi devs, In order to support Partition Commands for datasourcev2 and Lakehouse, I'm trying to add Partition API for multiple Catalog. They are widely used APIs in mysql or hive or other datasources, we can use these API to mange Partition metadata in Lakehouse. JIRA:

Resolve _temporary directory uncleaned

2020-07-16 Thread JackyLee
hi devs, In InsertIntoHiveTable and InsertIntoHiveDirCommand, we use deleteExternalTmpPath to clean temporary directories after Job committed and cancel deleteOnExit if succeeded.But sometimes (e.g., when speculative task is enabled), temporary directories may be left uncleaned. This is happened

Re: Welcoming some new Apache Spark committers

2020-07-16 Thread Gengliang Wang
Congratulations! On Thu, Jul 16, 2020 at 3:17 PM Dr. Kent Yao wrote: > Congrats and welcome!!! > > > > -- > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ > > - > To unsubscribe e-mail:

Re: [DISCUSS] -1s and commits

2020-07-16 Thread Wenchen Fan
It looks like there are two topics: 1. PRs with -1 2. PRs with someone asking to wait for certain days. Holden, it seems you are hitting 2? I think 2 can be problematic if there are people who keep asking to wait, and block the PR indefinitely. But if it's only asked once, this seems OK. BTW,

Re: Welcoming some new Apache Spark committers

2020-07-16 Thread Dr. Kent Yao
Congrats and welcome!!! -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org