Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API

2019-06-17 Thread Felix Cheung
+1 Glad to see the progress in this space - it’s been more than a year since the original discussion and effort started. From: Yinan Li Sent: Monday, June 17, 2019 7:14:42 PM To: rb...@netflix.com Cc: Dongjoon Hyun; Saisai Shao; Imran Rashid; Ilan Filonenko; bo

Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API

2019-06-17 Thread Yinan Li
+1 (non-binding) On Mon, Jun 17, 2019 at 1:58 PM Ryan Blue wrote: > +1 (non-binding) > > On Sun, Jun 16, 2019 at 11:11 PM Dongjoon Hyun > wrote: > >> +1 >> >> Bests, >> Dongjoon. >> >> >> On Sun, Jun 16, 2019 at 9:41 PM Saisai Shao >> wrote: >> >>> +1 (binding) >>> >>> Thanks >>> Saisai >>>

Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API

2019-06-17 Thread Ryan Blue
+1 (non-binding) On Sun, Jun 16, 2019 at 11:11 PM Dongjoon Hyun wrote: > +1 > > Bests, > Dongjoon. > > > On Sun, Jun 16, 2019 at 9:41 PM Saisai Shao > wrote: > >> +1 (binding) >> >> Thanks >> Saisai >> >> Imran Rashid 于2019年6月15日周六 上午3:46写道: >> >>> +1 (binding) >>> >>> I think this is a

Re: [DISCUSS] Increasing minimum supported version of Pandas

2019-06-17 Thread shane knapp
pyarrow is currently testing against 0.12.1. On Fri, Jun 14, 2019 at 2:56 PM Bryan Cutler wrote: > Yeah, PyArrow is the only other PySpark dependency we check for a minimum > version. We updated that not too long ago to be 0.12.1, which I think we > are still good on for now. > > On Fri, Jun

Re: Exposing JIRA issue types at GitHub PRs

2019-06-17 Thread Gabor Somogyi
Dongjoon, I think it's useful. Thanks for adding it! On Mon, Jun 17, 2019 at 8:05 AM Dongjoon Hyun wrote: > Thank you, Hyukjin ! > > On Sun, Jun 16, 2019 at 4:12 PM Hyukjin Kwon wrote: > >> Labels look good and useful. >> >> On Sat, 15 Jun 2019, 02:36 Dongjoon Hyun, >> wrote: >> >>> Now, you

Re: [VOTE][SPARK-25299] SPIP: Shuffle Storage API

2019-06-17 Thread Dongjoon Hyun
+1 Bests, Dongjoon. On Sun, Jun 16, 2019 at 9:41 PM Saisai Shao wrote: > +1 (binding) > > Thanks > Saisai > > Imran Rashid 于2019年6月15日周六 上午3:46写道: > >> +1 (binding) >> >> I think this is a really important feature for spark. >> >> First, there is already a lot of interest in alternative

Re: Exposing JIRA issue types at GitHub PRs

2019-06-17 Thread Dongjoon Hyun
Thank you, Hyukjin ! On Sun, Jun 16, 2019 at 4:12 PM Hyukjin Kwon wrote: > Labels look good and useful. > > On Sat, 15 Jun 2019, 02:36 Dongjoon Hyun, wrote: > >> Now, you can see the exposed component labels (ordered by the number of >> PRs) here and click the component to search. >> >>