Dongjoon Hyun
, Saisai Shao , Imran Rashid
, Ilan Filonenko , bo yang
, Matt Cheah , Spark Dev List
, "Yifei Huang (PD)" , Imran Rashid
Subject: Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API
Results of the voting:
Binding +1s: 5 (Tom Graves, Dongjoon Hyun, Felix Cheung, Saisai S
, Imran Rashid
, Ilan Filonenko , bo yang
, Matt Cheah , Spark Dev List
, "Yifei Huang (PD)" , Imran Rashid
Subject: Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API
+1 (binding)
I haven't looked at the low level api, but like the idea and approach to get it
started.
Tom
On Tuesda
: Vinoo Ganesh ; Felix Cheung
; Yinan Li ;
rb...@netflix.com; Dongjoon Hyun ; Saisai Shao
; Imran Rashid ; Ilan Filonenko
; bo yang ; Matt Cheah
; Spark Dev List ; Yifei Huang (PD)
; Imran Rashid
Subject: Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API
+1 (non-binding)
On Tue
; Spark Dev List ; Yifei Huang (PD)
; Imran Rashid
Subject: Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API
+1 (non-binding)
On Tue, Jun 18, 2019 at 12:12 PM John Zhuge
mailto:john.zh...@gmail.com>> wrote:
+1 (non-binding) Great work!
On Tue, Jun 18, 2019 at 6:22 AM Vinoo Ganesh
mailt
n
>> Filonenko , bo yang , Matt Cheah <
>> mch...@palantir.com>, Spark Dev List , "Yifei
>> Huang (PD)" , Vinoo Ganesh ,
>> Imran Rashid
>> *Subject: *Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API
>>
>>
>>
>> +1
>>
>>
...@netflix.com" <
> rb...@netflix.com>
> *Cc: *Dongjoon Hyun , Saisai Shao <
> sai.sai.s...@gmail.com>, Imran Rashid , Ilan
> Filonenko , bo yang , Matt Cheah <
> mch...@palantir.com>, Spark Dev List , "Yifei Huang
> (PD)" , Vinoo Ganesh ,
ifei Huang
(PD)" , Vinoo Ganesh , Imran Rashid
Subject: Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API
+1
Glad to see the progress in this space - it’s been more than a year since the
original discussion and effort started.
From: Yinan Li
Sent: Monday, June
yang; Matt
Cheah; Spark Dev List; Yifei Huang (PD); Vinoo Ganesh; Imran Rashid
Subject: Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API
+1 (non-binding)
On Mon, Jun 17, 2019 at 1:58 PM Ryan Blue wrote:
+1 (non-binding)
On Sun, Jun 16, 2019 at 11:11 PM Dongjoon Hyun
mailto:dongjoon.h
+1 (non-binding)
On Mon, Jun 17, 2019 at 1:58 PM Ryan Blue wrote:
> +1 (non-binding)
>
> On Sun, Jun 16, 2019 at 11:11 PM Dongjoon Hyun
> wrote:
>
>> +1
>>
>> Bests,
>> Dongjoon.
>>
>>
>> On Sun, Jun 16, 2019 at 9:41 PM Saisai Shao
>> wrote:
>>
>>> +1 (binding)
>>>
>>> Thanks
>>> Saisai
>>>
+1 (non-binding)
On Sun, Jun 16, 2019 at 11:11 PM Dongjoon Hyun
wrote:
> +1
>
> Bests,
> Dongjoon.
>
>
> On Sun, Jun 16, 2019 at 9:41 PM Saisai Shao
> wrote:
>
>> +1 (binding)
>>
>> Thanks
>> Saisai
>>
>> Imran Rashid 于2019年6月15日周六 上午3:46写道：
>>
>>> +1 (binding)
>>>
>>> I think this is a
+1
Bests,
Dongjoon.
On Sun, Jun 16, 2019 at 9:41 PM Saisai Shao wrote:
> +1 (binding)
>
> Thanks
> Saisai
>
> Imran Rashid 于2019年6月15日周六 上午3:46写道：
>
>> +1 (binding)
>>
>> I think this is a really important feature for spark.
>>
>> First, there is already a lot of interest in alternative
+1 (binding)
Thanks
Saisai
Imran Rashid 于2019年6月15日周六 上午3:46写道：
> +1 (binding)
>
> I think this is a really important feature for spark.
>
> First, there is already a lot of interest in alternative shuffle storage
> in the community. There is already a lot of interest in alternative
> shuffle
+1 (binding)
I think this is a really important feature for spark.
First, there is already a lot of interest in alternative shuffle storage in
the community. There is already a lot of interest in alternative shuffle
storage, from dynamic allocation in kubernetes, to even just improving
+1 (non-binding). This API is versatile and flexible enough to handle
Bloomberg's internal use-cases. The ability for us to vary implementation
strategies is quite appealing. It is also worth to note the minimal changes
to Spark core in order to make it work. This is a very much needed addition
+1 This is great work, allowing plugin of different sort shuffle write/read
implementation! Also great to see it retain the current Spark configuration
(spark.shuffle.manager=org.apache.spark.shuffle.YourShuffleManagerImpl).
On Thu, Jun 13, 2019 at 2:58 PM Matt Cheah wrote:
> Hi everyone,
>
>
Hi everyone,
I would like to call a vote for the SPIP for SPARK-25299, which proposes to
introduce a pluggable storage API for temporary shuffle data.
You may find the SPIP document here.
The discussion thread for the SPIP was conducted here.
Please vote on whether or not this
16 matches
Mail list logo
