Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

t; *Cc:* "Jungtaek Lim";"Chris Nauroth"< > cnaur...@apache.org>;"Maciej";"dev"< > dev@spark.apache.org>; > *Subject:* Re: [VOTE][SPIP] Better Spark UI scalability and Driver > stability for large applications > > +1, I'm loo

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1 RuifengZheng ruife...@foxmail.com --Original-- From: "Wenchen Fan"

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1, I'm looking forward to it! On Thu, Nov 17, 2022 at 9:44 AM Ye Zhou wrote: > +1 (non-binding) > Thanks for proposing this improvement to SHS, it resolves the main > performance issue within SHS. > > On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim > wrote: > >> +1 >> >> Nice to see the chance

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1 (non-binding) Thanks for proposing this improvement to SHS, it resolves the main performance issue within SHS. On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim wrote: > +1 > > Nice to see the chance for driver to reduce resource usage and increase > stability, especially the fact that the driver

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1 Nice to see the chance for driver to reduce resource usage and increase stability, especially the fact that the driver is SPOF. It's even promising to have a future plan to pre-bake the kvstore for SHS from the driver. Thanks for driving the effort, Gengliang! On Thu, Nov 17, 2022 at 5:32 AM

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1 (non-binding) Gengliang, thank you for the SPIP. Chris Nauroth On Wed, Nov 16, 2022 at 4:27 AM Maciej wrote: > +1 > > On 11/16/22 13:19, Yuming Wang wrote: > > +1, non-binding > > > > On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) > > wrote: > > > > +1,

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1 On 11/16/22 13:19, Yuming Wang wrote: +1, non-binding On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) > wrote: +1, non-binding __ __ Yang Jie __ __ *发件人**: *Mridul Muralidharan mailto:mri...@gmail.com>> *日期**:

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1, non-binding On Wed, Nov 16, 2022 at 8:12 PM Yang,Jie(INF) wrote: > +1, non-binding > > > > Yang Jie > > > > *发件人**: *Mridul Muralidharan > *日期**: *2022年11月16日 星期三 17:35 > *收件人**: *Kent Yao > *抄送**: *Gengliang Wang , dev > *主题**: *Re: [VOTE][SPIP]

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1, non-binding Yang Jie 发件人: Mridul Muralidharan 日期: 2022年11月16日 星期三 17:35 收件人: Kent Yao 抄送: Gengliang Wang , dev 主题: Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications +1 Would be great to see history server performance improvements and lower

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1 Would be great to see history server performance improvements and lower resource utilization at driver ! Regards, Mridul On Wed, Nov 16, 2022 at 2:38 AM Kent Yao wrote: > +1, non-binding > > Gengliang Wang 于2022年11月16日周三 16:36写道： > > > > Hi all, > > > > I’d like to start a vote for SPIP:

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1, non-binding Gengliang Wang 于2022年11月16日周三 16:36写道： > > Hi all, > > I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver > stability for large applications" > > The goal of the SPIP is to improve the Driver's stability by supporting > storing Spark's UI data on

[VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

Hi all, I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver stability for large applications" The goal of the SPIP is to improve the Driver's stability by supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the read and write operations on RocksDB, it