+1 (non-binding) Thanks for proposing this improvement to SHS, it resolves the main performance issue within SHS.
On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim <kabhwan.opensou...@gmail.com> wrote: > +1 > > Nice to see the chance for driver to reduce resource usage and increase > stability, especially the fact that the driver is SPOF. It's even promising > to have a future plan to pre-bake the kvstore for SHS from the driver. > > Thanks for driving the effort, Gengliang! > > On Thu, Nov 17, 2022 at 5:32 AM Chris Nauroth <cnaur...@apache.org> wrote: > >> +1 (non-binding) >> >> Gengliang, thank you for the SPIP. >> >> Chris Nauroth >> >> >> On Wed, Nov 16, 2022 at 4:27 AM Maciej <mszymkiew...@gmail.com> wrote: >> >>> +1 >>> >>> On 11/16/22 13:19, Yuming Wang wrote: >>> > +1, non-binding >>> > >>> > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) <yangji...@baidu.com >>> > <mailto:yangji...@baidu.com>> wrote: >>> > >>> > +1, non-binding____ >>> > >>> > __ __ >>> > >>> > Yang Jie____ >>> > >>> > __ __ >>> > >>> > *发件人**: *Mridul Muralidharan <mri...@gmail.com >>> > <mailto:mri...@gmail.com>> >>> > *日期**: *2022年11月16日星期三17:35 >>> > *收件人**: *Kent Yao <y...@apache.org <mailto:y...@apache.org>> >>> > *抄送**: *Gengliang Wang <ltn...@gmail.com >>> > <mailto:ltn...@gmail.com>>, dev <dev@spark.apache.org >>> > <mailto:dev@spark.apache.org>> >>> > *主题**: *Re: [VOTE][SPIP] Better Spark UI scalability and Driver >>> > stability for large applications____ >>> > >>> > __ __ >>> > >>> > __ __ >>> > >>> > +1____ >>> > >>> > __ __ >>> > >>> > Would be great to see history server performance improvements and >>> > lower resource utilization at driver !____ >>> > >>> > __ __ >>> > >>> > Regards,____ >>> > >>> > Mridul ____ >>> > >>> > __ __ >>> > >>> > On Wed, Nov 16, 2022 at 2:38 AM Kent Yao <y...@apache.org >>> > <mailto:y...@apache.org>> wrote:____ >>> > >>> > +1, non-binding >>> > >>> > Gengliang Wang <ltn...@gmail.com <mailto:ltn...@gmail.com>> 于 >>> > 2022年11月16日周三16:36写道: >>> > > >>> > > Hi all, >>> > > >>> > > I’d like to start a vote for SPIP: "Better Spark UI >>> scalability and Driver stability for large applications" >>> > > >>> > > The goal of the SPIP is to improve the Driver's stability by >>> supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the >>> read and write operations on RocksDB, it introduces a new Protobuf >>> serializer. >>> > > >>> > > Please also refer to the following: >>> > > >>> > > Previous discussion in the dev mailing list: [DISCUSS] SPIP: >>> Better Spark UI scalability and Driver stability for large applications >>> > > Design Doc: Better Spark UI scalability and Driver stability >>> for large applications >>> > > JIRA: SPARK-41053 >>> > > >>> > > >>> > > Please vote on the SPIP for the next 72 hours: >>> > > >>> > > [ ] +1: Accept the proposal as an official SPIP >>> > > [ ] +0 >>> > > [ ] -1: I don’t think this is a good idea because … >>> > > >>> > > Kind Regards, >>> > > Gengliang >>> > >>> > >>> --------------------------------------------------------------------- >>> > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>> > <mailto:dev-unsubscr...@spark.apache.org>____ >>> > >>> >>> -- >>> Best regards, >>> Maciej Szymkiewicz >>> >>> Web: https://zero323.net >>> PGP: A30CEF0C31A501EC >>> >>> -- *Zhou, Ye **周晔*