[
https://issues.apache.org/jira/browse/SPARK-53678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-53678:
-------------------------------
Description: Iceberg's
[ConstantColumnVector|https://github.com/apache/iceberg/blob/main/spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/ConstantColumnVector.java#L41],
subclass of Spark's ColumnVector, could be created with null DataType. It
throws NPE after [https://github.com/apache/spark/pull/51349,] which can be
proved by failed tests in integrating Spark 4.1.0-preview1 in Iceberg,
[https://github.com/apache/iceberg/pull/14155] (was: Iceberg's
ConstantColumnVector, subclass of Spark's ColumnVector, could be created with
null DataType. It throws NPE after
[https://github.com/apache/spark/pull/51349,] which can be proved by failed
tests in integrating Spark 4.1.0-preview1 in Iceberg,
[https://github.com/apache/iceberg/pull/14155])
> NPE when subclass of ColumnVector is created with null DataType
> ---------------------------------------------------------------
>
> Key: SPARK-53678
> URL: https://issues.apache.org/jira/browse/SPARK-53678
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 4.1.0
> Reporter: Manu Zhang
> Priority: Major
>
> Iceberg's
> [ConstantColumnVector|https://github.com/apache/iceberg/blob/main/spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/data/vectorized/ConstantColumnVector.java#L41],
> subclass of Spark's ColumnVector, could be created with null DataType. It
> throws NPE after [https://github.com/apache/spark/pull/51349,] which can be
> proved by failed tests in integrating Spark 4.1.0-preview1 in Iceberg,
> [https://github.com/apache/iceberg/pull/14155]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
