branch-3.0 vs branch-3.0-preview (?)

2019-10-15 Thread Dongjoon Hyun
Hi, It seems that we have `branch-3.0-preview` branch. https://github.com/apache/spark/commits/branch-3.0-preview Can we have `branch-3.0` instead of `branch-3.0-preview`? We can tag `v3.0.0-preview` on `branch-3.0` and continue to use for `v3.0.0` later. Bests, Dongjoon.

Re: Add spark dependency on on org.opencypher:okapi-shade.okapi

2019-10-15 Thread Sean Owen
I do not have a very informed opinion here, so take this with a grain of salt. I'd say that we need to either commit a coherent version of this for Spark 3, or not at all. If it doesn't have support, I'd back out the existing changes. I was initially skeptical about how much this needs to be in

Re: Add spark dependency on on org.opencypher:okapi-shade.okapi

2019-10-15 Thread Weichen Xu
Hi Mats Rydberg, Although this dependency "org.opencypher:okapi-shade.okapi" was added into spark, but Xiangrui raised two concerns (see above mail) about it, so we'd better rethink on this and consider whether this is a good choice, so I call this vote. Thanks! On Tue, Oct 15, 2019 at 10:56 PM

Cancel DSv2 sync this week

2019-10-15 Thread Ryan Blue
Hi everyone, I can't make it to the DSv2 sync tomorrow, so let's skip it. If anyone would prefer to have one and is willing to take notes, I can send out the invite. Just let me know, otherwise let's consider it cancelled. Thanks, rb -- Ryan Blue Software Engineer Netflix

Re: Add spark dependency on on org.opencypher:okapi-shade.okapi

2019-10-15 Thread Mats Rydberg
Hello Weichen, community I'm sorry, I'm feeling a little bit confused about this vote. Is this about the PR (https://github.com/apache/spark/pull/24490) that was merged in early June and introduced the spark-graph module including the okapi-shade dependency? Regarding the okapi-shade dependency

Add spark dependency on on org.opencypher:okapi-shade.okapi

2019-10-15 Thread Weichen Xu
Hi everyone, I'd like to call a new vote on the issue: should we add dependency "org.opencypher:okapi-shade.okapi" into spark ? The issue background is: Spark is going to add a big feature "Spark Graph", the prototypical implementation is here https://github.com/apache/spark/pull/24297 which