[
https://issues.apache.org/jira/browse/SPARK-39202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39202:
------------------------------------
Assignee: (was: Apache Spark)
> Introduce a `putByteArrays` method to `WritableColumnVector` to support
> setting multiple duplicate `byte[]`
> -----------------------------------------------------------------------------------------------------------
>
> Key: SPARK-39202
> URL: https://issues.apache.org/jira/browse/SPARK-39202
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Yang Jie
> Priority: Minor
>
> Add a `putByteArrays` method to `WritableColumnVector`
>
> {code:java}
> int putByteArrays(int rowId, int total, byte[] value) {code}
>
>
> this method used to support setting multiple duplicate `byte[]` to
> `WritableColumnVector`.
> Since `byte[] value` is fixed length, memory can allocated at one time
> without calling `
> reserve(int requiredCapacity)` method many times.
>
> This method is applicable to `ColumnVectorUtils.populate` method with
> `StringType` and partial `DecimalType` scenario, this corresponds to the
> Vectorized Partition Column filling of Parquet and Orc
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
