kasakrisz commented on code in PR #6600:
URL: https://github.com/apache/hive/pull/6600#discussion_r3757706445
##########
iceberg/iceberg-handler/src/test/results/positive/llap/iceberg_bucket_map_join_3.q.out:
##########
@@ -210,16 +210,16 @@ Stage-0
PartitionCols:_col0
Select Operator [SEL_27] (rows=238 width=4)
Output:["_col0"]
- Filter Operator [FIL_26] (rows=238 width=89)
+ Filter Operator [FIL_26] (rows=238 width=188)
predicate:((part = '1') and key is not null)
- TableScan [TS_3] (rows=238 width=89)
+ TableScan [TS_3] (rows=238 width=188)
default@srcbucket_mapjoin_part_2_n4,b,Tbl:COMPLETE,Col:COMPLETE,Output:["key","part"]
<-Select Operator [SEL_30] (rows=238 width=4)
Output:["_col0"]
- Filter Operator [FIL_29] (rows=238 width=89)
+ Filter Operator [FIL_29] (rows=238 width=188)
predicate:((part = '1') and key is not null)
- TableScan [TS_0] (rows=238 width=89)
-
default@srcbucket_mapjoin_part_1_n1,a,Tbl:COMPLETE,Col:COMPLETE,Grouping Num
Buckets:2,Grouping Partition Columns:["key"],Output:["key","part"]
+ TableScan [TS_0] (rows=238 width=188)
+
default@srcbucket_mapjoin_part_1_n1,a,Tbl:COMPLETE,Col:PARTIAL,Grouping Num
Buckets:2,Grouping Partition Columns:["key"],Output:["key","part"]
Review Comment:
I revisited this case and found that only the partition column is projected
from this table. In such cases, Hive doesn't store any column stats, but
calculates them from the partition metadata:
https://github.com/apache/hive/blob/1d0bf6981788fe2e7de44aaf44cce84c2f7a964e/ql/src/java/org/apache/hadoop/hive/ql/stats/StatsUtils.java#L623-L701
Since we end up with column stats for all of the projected columns, I
changed the code to set the column stats status to COMPLETE.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
