[
https://issues.apache.org/jira/browse/SPARK-37274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hao updated SPARK-37274:
------------------------
Summary: When the value of this parameter is greater than the maximum value
of int type, the value will be thrown out of bounds. The document description
of this parameter should remind the user of this risk point (was: These
parameters should be of type long, not int)
> When the value of this parameter is greater than the maximum value of int
> type, the value will be thrown out of bounds. The document description of
> this parameter should remind the user of this risk point
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-37274
> URL: https://issues.apache.org/jira/browse/SPARK-37274
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.2.0
> Reporter: hao
> Priority: Major
>
> These parameters [spark.sql.orc.columnarReaderBatchSize],
> [spark.sql.inMemoryColumnarStorage.batchSize],
> [spark.sql.parquet.columnarReaderBatchSize] should be of type long, not of
> type int. when the user sets the value to be greater than the maximum value
> of type int, an error will be thrown
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
