[
https://issues.apache.org/jira/browse/SPARK-46535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-46535.
---------------------------------
> NPE when describe extended a column without col stats
> -----------------------------------------------------
>
> Key: SPARK-46535
> URL: https://issues.apache.org/jira/browse/SPARK-46535
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.5.0
> Reporter: Xinyu Zou
> Assignee: Xinyu Zou
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.5.1, 3.4.4, 4.0.0
>
>
> Currently executing DESCRIBE TABLE EXTENDED a column without col stats with
> v2 table will throw a null pointer exception.
> {code:java}
> Cannot invoke
> "org.apache.spark.sql.connector.read.colstats.ColumnStatistics.min()" because
> the return value of "scala.Option.get()" is null
> java.lang.NullPointerException: Cannot invoke
> "org.apache.spark.sql.connector.read.colstats.ColumnStatistics.min()" because
> the return value of "scala.Option.get()" is null
> at
> org.apache.spark.sql.execution.datasources.v2.DescribeColumnExec.run(DescribeColumnExec.scala:63)
> at
> org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result$lzycompute(V2CommandExec.scala:43)
> at
> org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result(V2CommandExec.scala:43)
> at
> org.apache.spark.sql.execution.datasources.v2.V2CommandExec.executeCollect(V2CommandExec.scala:49)
> at
> org.apache.spark.sql.execution.QueryExecution$$anonfun$eagerlyExecuteCommands$1.$anonfun$applyOrElse$1(QueryExecution.scala:118)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId0$6(SQLExecution.scala:150)
> at
> org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:241)
> at
> org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId0$1(SQLExecution.scala:116)
> at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:918){code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
