[GitHub] yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-23 Thread GitBox
yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-457059167 @tgravescs, yes, exactly as you understood. This is

[GitHub] yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-23 Thread GitBox
yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456871550 @tgravescs thanks for looking at this! The shuffle block is stored like below: format is s"shuffle_$shu

[GitHub] yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-20 Thread GitBox
yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-455874346 @mridulm thanks for concerning this feature! I have updated the PR's description, could you take a look at? Any comm

[GitHub] yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-10 Thread GitBox
yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-453375449 Thanks @cloud-fan 's help, we discussed a new solution to make both client and server can work with the previous ver

[GitHub] yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2018-12-18 Thread GitBox
yucai commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-448228162 @cloud-fan thanks for so thoughtful review, I will update them asap! ---