[GitHub] [spark] attilapiros commented on a change in pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-16 Thread GitBox
attilapiros commented on a change in pull request #28618: URL: https://github.com/apache/spark/pull/28618#discussion_r440799753 ## File path: core/src/main/java/org/apache/spark/shuffle/sort/UnsafeShuffleWriter.java ## @@ -273,19 +280,24 @@ void forceSorterToSpill() throws IOE

[GitHub] [spark] attilapiros commented on a change in pull request #28618: [SPARK-31801][WIP][API][SHUFFLE] Register map output metadata

2020-06-15 Thread GitBox
attilapiros commented on a change in pull request #28618: URL: https://github.com/apache/spark/pull/28618#discussion_r440411508 ## File path: core/src/main/java/org/apache/spark/shuffle/sort/BypassMergeSortShuffleWriter.java ## @@ -130,9 +132,13 @@ public void write(Iterator>