Re: Initial Decom PR for Spark 3?

[Holden Karau]

I believe so, however since Hyukjin is a committer and has asked for an
SPIP I'll be making an SPIP for this next week. I hope to send out the
draft for comment by the end of Spark summit. I'll be using the same design
document for the design component, so if anyone has input on the design
document feel free to start leaving comments there now.

On Sat, Jun 20, 2020 at 4:23 PM Stephen Boesch  wrote:

> Hi given there is a design doc (contrary to that common) - is this going
> to move forward?
>
> On Thu, 18 Jun 2020 at 18:05, Hyukjin Kwon  wrote:
>
>> Looks it had to be with SPIP and a proper design doc to discuss.
>>
>> 2020년 2월 9일 (일) 오전 1:23, Erik Erlandson 님이 작성:
>>
>>> I'd be willing to pull this in, unless others have concerns post
>>> branch-cut.
>>>
>>> On Tue, Feb 4, 2020 at 2:51 PM Holden Karau 
>>> wrote:
>>>
 Hi Y’all,

 I’ve got a K8s graceful decom PR (
 https://github.com/apache/spark/pull/26440
  ) I’d love to try and get in for Spark 3, but I don’t want to push on
 it if folks don’t think it’s worth it. I’ve been working on it since 2017
 and it was really close in November but then I had the crash and had to
 step back for awhile.

 It’s effectiveness is behind a feature flag and it’s been outstanding
 for awhile so those points are in its favour. It does however change things
 in core which is not great.

 Cheers,

 Holden
 --
 Twitter: https://twitter.com/holdenkarau
 Books (Learning Spark, High Performance Spark, etc.):
 https://amzn.to/2MaRAG9  
 YouTube Live Streams: https://www.youtube.com/user/holdenkarau

>>>

-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Re: Initial Decom PR for Spark 3?

[Stephen Boesch]

Hi given there is a design doc (contrary to that common) - is this going to
move forward?

On Thu, 18 Jun 2020 at 18:05, Hyukjin Kwon  wrote:

> Looks it had to be with SPIP and a proper design doc to discuss.
>
> 2020년 2월 9일 (일) 오전 1:23, Erik Erlandson 님이 작성:
>
>> I'd be willing to pull this in, unless others have concerns post
>> branch-cut.
>>
>> On Tue, Feb 4, 2020 at 2:51 PM Holden Karau  wrote:
>>
>>> Hi Y’all,
>>>
>>> I’ve got a K8s graceful decom PR (
>>> https://github.com/apache/spark/pull/26440
>>>  ) I’d love to try and get in for Spark 3, but I don’t want to push on
>>> it if folks don’t think it’s worth it. I’ve been working on it since 2017
>>> and it was really close in November but then I had the crash and had to
>>> step back for awhile.
>>>
>>> It’s effectiveness is behind a feature flag and it’s been outstanding
>>> for awhile so those points are in its favour. It does however change things
>>> in core which is not great.
>>>
>>> Cheers,
>>>
>>> Holden
>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9  
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>