Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-01 Thread Sean Owen
(Direct link to design doc, linked from JIRA) https://issues.apache.org/jira/browse/SPARK-18085 https://issues.apache.org/jira/secure/attachment/12835040/spark_hs_next_gen.pdf I know Marcelo has looked closely at this issue for a long while and trust his judgment about what needs to be fixed, and

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-01 Thread Denis Bolshakov
+1 Absolutely agree on SPARK-18085. On 1 August 2017 at 12:18, Sean Owen wrote: > (Direct link to design doc, linked from JIRA) > https://issues.apache.org/jira/browse/SPARK-18085 > https://issues.apache.org/jira/secure/attachment/ > 12835040/spark_hs_next_gen.pdf > > I know Marcelo has looked

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-01 Thread Hyukjin Kwon
+1 Although I am not used to this code path, I read the proposal few times and it makes sense to me. On 1 Aug 2017 7:01 pm, "Denis Bolshakov" wrote: +1 Absolutely agree on SPARK-18085. On 1 August 2017 at 12:18, Sean Owen wrote: > (Direct link to design doc, linked from JIRA) > https://iss

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-01 Thread Tom Graves
+1.  Tom On Monday, July 31, 2017, 12:28:02 PM CDT, Marcelo Vanzin wrote: Hey all, Following the SPIP process, I'm putting this SPIP up for a vote. It's been open for comments as an SPIP for about 3 weeks now, and had been open without the SPIP label for about 9 months before that. There has

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-01 Thread Ryan Blue
+1 (non-binding) On Tue, Aug 1, 2017 at 6:48 AM, Tom Graves wrote: > +1. > > > Tom > > > > On Monday, July 31, 2017, 12:28:02 PM CDT, Marcelo Vanzin < > van...@cloudera.com> wrote: > > > Hey all, > > Following the SPIP process, I'm putting this SPIP up for a vote. It's > been open for comments a

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-01 Thread Dong Joon Hyun
+1 (non-binding) Dongjoon. From: Ryan Blue Reply-To: "rb...@netflix.com" Date: Tuesday, August 1, 2017 at 9:06 AM To: Tom Graves Cc: Marcelo Vanzin , "dev@spark.apache.org" Subject: Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability +1 (non-binding) On Tue, Aug 1, 2017 at 6:4

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-01 Thread Marcelo Vanzin
Thanks all for the comments. Just a clarification: On Tue, Aug 1, 2017 at 2:18 AM, Sean Owen wrote: > Is 'spark-ui' too broad? doesn't sound like this module would actually house > all the UIs. spark-shs-ui or something? > Good that this can be implemented in parallel to the existing mechanism fo