Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/19266#discussion_r139580567
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java ---
@@ -39,7 +39,7 @@
private final long length;
public LongArray(MemoryBlock memory) {
- assert memory.size() < (long) Integer.MAX_VALUE * 8: "Array size > 4
billion elements";
+ assert memory.size() < (long) Integer.MAX_VALUE * 8: "Array size > 2.1
billion elements";
--- End diff --
ISTM `memory.size() < (long) Integer.MAX_VALUE * 8` is correct? see:
https://github.com/apache/spark/blob/c66d64b3df9d9ffba0b16a62015680f6f876fc68/common/unsafe/src/main/java/org/apache/spark/unsafe/memory/MemoryBlock.java#L54
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
