[ https://issues.apache.org/jira/browse/SPARK-36604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17695869#comment-17695869 ]
Ritika Maheshwari commented on SPARK-36604: ------------------------------------------- Seems to be working correctly in Spark 3.3.0 spark-sql> insert into a values(cast('2021-08-15 15:30:01' as timestamp) > ); 23/03/02 11:04:11 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException Time taken: 3.278 seconds spark-sql> select * from a; 2021-08-15 15:30:01 Time taken: 0.782 seconds, Fetched 1 row(s) spark-sql> analyze table a compute statistics for columns a; Time taken: 1.882 seconds spark-sql> desc formatted a a; col_name a data_type timestamp comment NULL min 2021-08-15 15:30:01.000000 -0700 max 2021-08-15 15:30:01.000000 -0700 num_nulls 0 distinct_count 1 avg_col_len 8 max_col_len 8 histogram NULL Time taken: 0.095 seconds, Fetched 10 row(s) spark-sql> desc a; a timestamp Time taken: 0.059 seconds, Fetched 1 row(s) spark-sql> > timestamp type column analyze result is wrong > --------------------------------------------- > > Key: SPARK-36604 > URL: https://issues.apache.org/jira/browse/SPARK-36604 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.1.1, 3.1.2 > Environment: Spark 3.1.1 > Reporter: YuanGuanhu > Priority: Major > > when we create table with timestamp column type, the min and max data of the > analyze result for the timestamp column is wrong > eg: > {code} > > select * from a; > {code} > {code} > 2021-08-15 15:30:01 > Time taken: 2.789 seconds, Fetched 1 row(s) > spark-sql> desc formatted a a; > col_name a > data_type timestamp > comment NULL > min 2021-08-15 07:30:01.000000 > max 2021-08-15 07:30:01.000000 > num_nulls 0 > distinct_count 1 > avg_col_len 8 > max_col_len 8 > histogram NULL > Time taken: 0.278 seconds, Fetched 10 row(s) > spark-sql> desc a; > a timestamp NULL > Time taken: 1.432 seconds, Fetched 1 row(s) > {code} > > reproduce step: > {code} > create table a(a timestamp); > insert into a select '2021-08-15 15:30:01'; > analyze table a compute statistics for columns a; > desc formatted a a; > select * from a; > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org