> That's not a new requirement, that's an "implicit" requirement via
semantic versioning.
The expectation is that the DSv2 API will change in minor versions in the
2.x line. The API is marked with the Experimental API annotation to signal
that it can change, and it has been changing.
A
Shane, thanks for the hard work!
Bests,
Takeshi
On Wed, Sep 25, 2019 at 6:07 AM Jungtaek Lim wrote:
> Awesome, thanks for the quick update!
>
> On Wed, Sep 25, 2019 at 6:04 AM Shane Knapp wrote:
>
>> no worries. since we deprecated the packaging builds i put that
>> worker back in to the
>> Apache Spark 2.4.x and 2.5.x DSv2 should be compatible.
> This has not been a requirement for DSv2 development so far. If this is a
new requirement, then we should not do a 2.5 release.
My 2 cents, target version of new DSv2 has been only 3.0 so we don't ever
have a chance to think about such
Awesome, thanks for the quick update!
On Wed, Sep 25, 2019 at 6:04 AM Shane Knapp wrote:
> no worries. since we deprecated the packaging builds i put that
> worker back in to the rotation... there was a slight env issue but
> that's fixed and we should be g2g w/python.
>
> On Tue, Sep 24,
no worries. since we deprecated the packaging builds i put that
worker back in to the rotation... there was a slight env issue but
that's fixed and we should be g2g w/python.
On Tue, Sep 24, 2019 at 1:50 PM Jungtaek Lim wrote:
>
> Hi Shane,
>
> Thanks for the update, and take care of build
Hi Shane,
Thanks for the update, and take care of build system!
Looks like some of build just got failed without test failures, looks like
env. issue.
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/111308/
+ ./dev/run-tests-jenkins
Python versions prior to 2.7 are not
>From those questions, I can see that there is significant confusion about
what I'm proposing, so let me try to clear it up.
> 1. Is DSv2 stable in `master`?
DSv2 has reached a stable API that is capable of supporting all of the
features we intend to deliver for Spark 3.0. The proposal is to
quick update from our colo admin: they are going to keep the colo on
generator power until monday morning and not switch back and forth.
this is great as we'll have solid uptime until monday morning when we
go back to grid power.
if this changes i will be certain to update everyone here.
aand that was quick! everything is back up and building
On Tue, Sep 24, 2019 at 9:39 AM Shane Knapp wrote:
>
> power switchover is happening now. more updates to come once machines
> come back up.
>
> On Mon, Sep 23, 2019 at 3:16 PM Shane Knapp wrote:
> >
> > the main transformer for our
power switchover is happening now. more updates to come once machines
come back up.
On Mon, Sep 23, 2019 at 3:16 PM Shane Knapp wrote:
>
> the main transformer for our colo is experiencing major issues, and
> campus be performing emergency work on it starting tomorrow morning
> (tuesday sept
10 matches
Mail list logo
