[ https://issues.apache.org/jira/browse/SPARK-34725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300168#comment-17300168 ]
Apache Spark commented on SPARK-34725: -------------------------------------- User 'ulysses-you' has created a pull request for this issue: https://github.com/apache/spark/pull/31817 > Do not show Statistics(sizeInBytes=8.0 EiB) if we don't have valid stats > ------------------------------------------------------------------------ > > Key: SPARK-34725 > URL: https://issues.apache.org/jira/browse/SPARK-34725 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.2.0 > Reporter: ulysses you > Priority: Minor > > In cast explian mode, we might get such explain string if the table is > external and we have not stats. > > {code:java} > == Optimized Logical Plan == > GlobalLimit 21, Statistics(sizeInBytes=1008.0 B, rowCount=21) > +- LocalLimit 21, Statistics(sizeInBytes=12.0 EiB) > +- Project [cast(c1#52 as string) AS c1#259, pt#53], > Statistics(sizeInBytes=12.0 EiB) > +- Relation default.pt1[c1#52,pt#53] parquet, Statistics(sizeInBytes=8.0 EiB) > {code} > > The reason is we use the `Long.MaxValue` as the stats with conf > `spark.sql.defaultSizeInBytes`. It would be better to hide the default stat. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org