ulysses you created SPARK-34725: ----------------------------------- Summary: Do not show Statistics(sizeInBytes=8.0 EiB) if we don't have valid stats Key: SPARK-34725 URL: https://issues.apache.org/jira/browse/SPARK-34725 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.2.0 Reporter: ulysses you
In cast explian mode, we might get such explain string if the table is external and we have not stats. {code:java} == Optimized Logical Plan == GlobalLimit 21, Statistics(sizeInBytes=1008.0 B, rowCount=21) +- LocalLimit 21, Statistics(sizeInBytes=12.0 EiB) +- Project [cast(c1#52 as string) AS c1#259, pt#53], Statistics(sizeInBytes=12.0 EiB) +- Relation default.pt1[c1#52,pt#53] parquet, Statistics(sizeInBytes=8.0 EiB) {code} The reason is we use the `Long.MaxValue` as the stats with conf `spark.sql.defaultSizeInBytes`. It would be better to hide the default stat. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org