GitHub user ala opened a pull request:
https://github.com/apache/spark/pull/21227
[SPARK-24133][SQL] Check for integer overflows when resizing
WritableColumnVectors
`ColumnVector`s store string data in one big byte array. Since the array
size is capped at just under Integer.MAX_VAL
Github user adrian-wang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21227#discussion_r185768453
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/WritableColumnVector.java
---
@@ -81,7 +81,9 @@ public void close() {