[GitHub] [hudi] nsivabalan commented on issue #8572: [SUPPORT] Getting java.io.FileNotFoundException when reading MOR table.
nsivabalan commented on issue #8572: URL: https://github.com/apache/hudi/issues/8572#issuecomment-1538995505 you are using some internal apis. so getCommitsTimeline will give you cleaned up and noncleaned commits. right one to use is ``` timeline=metaClient.getActiveTimeline().getCleanerTimeline().filterCompletedInstants() ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #8572: [SUPPORT] Getting java.io.FileNotFoundException when reading MOR table.
nsivabalan commented on issue #8572: URL: https://github.com/apache/hudi/issues/8572#issuecomment-1523538698 Generally incremental query will work only if cleaner has not run. for eg, if you have 100 commits in your timeline and cleaner has cleaned up the data pertaining to first 25 commits for eg. incremental query is bound to fail if we try to query using the first 25 commits. But if the incremental query the latest 75 commits, you should not see any FileNotFound issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org