gengliangwang commented on PR #38567:
URL: https://github.com/apache/spark/pull/38567#issuecomment-1324085444
@mridulm @LuciferYang @tgravescs Thanks for the review.
I am merging this one to the master branch.
--
This is an automated message from the Apache Git Service.
To respond to th
gengliangwang commented on PR #38567:
URL: https://github.com/apache/spark/pull/38567#issuecomment-1312210749
@mridulm FYI I have sent the SPIP to the dev list.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
gengliangwang commented on PR #38567:
URL: https://github.com/apache/spark/pull/38567#issuecomment-1309119625
> A newbie question: Does this design prefer the driver instance to
monopolize a disk to ensure performance? If the driver shares a disk with other
executors, will disk r/w caused b
gengliangwang commented on PR #38567:
URL: https://github.com/apache/spark/pull/38567#issuecomment-1309116975
@mridulm yes I can start a SPIP since you have doubts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
U
gengliangwang commented on PR #38567:
URL: https://github.com/apache/spark/pull/38567#issuecomment-1308227478
> Or part of a larger set of changes
Yes, I created Jira https://issues.apache.org/jira/browse/SPARK-41053, and
this one is just the beginning.
> Maintaining state at
gengliangwang commented on PR #38567:
URL: https://github.com/apache/spark/pull/38567#issuecomment-1308222974
> It seems to not match what is described in the pr description or add
equivalent functionality which was reverted
I believe it covers the reverted PR
https://github.com/apac
