[ https://issues.apache.org/jira/browse/HUDI-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yue Zhang updated HUDI-5989: ---------------------------- Fix Version/s: 0.13.1 (was: 0.14.0) > Fix the date conversion issue when lazy fetching partition path & file slice > for HoodieFileIndex is used > -------------------------------------------------------------------------------------------------------- > > Key: HUDI-5989 > URL: https://issues.apache.org/jira/browse/HUDI-5989 > Project: Apache Hudi > Issue Type: Bug > Reporter: voon > Assignee: voon > Priority: Major > Labels: pull-request-available > Fix For: 0.13.1 > > > For partition filter like date column, spark internally will convert it to > day numbers after timestamp 0, but hudi lazy fetching doesn't respect this > behavior, this pr tries to fix it. > > {code:java} > INFO DataSourceStrategy: Pruning directories with: isnotnull(country#80), > isnotnull(par_date#81),(country#80 = ID),(par_date#81=19415) > ... > INFO AbstractTableFileSystemView: Building file system view for partition > (country=ID/par_date=19415) > {code} > > This will fix the partition pruning bug introduced in: > [https://github.com/apache/hudi/pull/6680] > h3. -- This message was sent by Atlassian Jira (v8.20.10#820010)