[
https://issues.apache.org/jira/browse/HUDI-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Geser Dugarov reassigned HUDI-7952:
---
Assignee: (was: Geser Dugarov)
> Incorrect partition pruning when TimestampBasedKeyGenerator is used in
> partition column
> ---
>
> Key: HUDI-7952
> URL: https://issues.apache.org/jira/browse/HUDI-7952
> Project: Apache Hudi
> Issue Type: Bug
>Reporter: Geser Dugarov
>Priority: Major
>
> Fix of ClassCastException in https://issues.apache.org/jira/browse/HUDI-7709
> with nulls as partition columns values could lead to an empty query results.
> HoodieFileIndex.listFiles() would return Seq of
> {color:#00}PartitionDirectory with null values.{color}
>
> {color:#00}But there is another problem with range filters on partition
> column.{color}
> {color:#00}For instance, we have UNIX_TIMESTAMP in column ts.{color}
> And the table is also partitioned by ts with
> hoodie.keygen.timebased.output.dateformat = "-MM-dd HH"
> {color:#00}For execution of query like:{color}
> SELECT ... WHERE ts BETWEEN 1078016000 and 1718953003 ...
> it's not possible to filter rows properly.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
