Bowen Liang created SPARK-46328:
-----------------------------------
Summary: Allocate enough capacity for assembling array list of
TColumns in TRowSet generation
Key: SPARK-46328
URL: https://issues.apache.org/jira/browse/SPARK-46328
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.5.0
Reporter: Bowen Liang
Background:
ArrayList is created for TColumn value collections in RowSetUtils for TRowSet
generation. Currently, they are created with Java's default capacity of 16,
rather than by the number of columns, which could cause array copying in
assembling each TColumn collections when the column number exceeds the default
capacity.
Suggested solution:
Allocate enough capacity by columns size for assembling array list of TColumns
in TRowSet generation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
