[GitHub] [hudi] nsivabalan commented on issue #8572: [SUPPORT] Getting java.io.FileNotFoundException when reading MOR table.

2023-05-08 Thread via GitHub


nsivabalan commented on issue #8572:
URL: https://github.com/apache/hudi/issues/8572#issuecomment-1538995505

   you are using some internal apis. so getCommitsTimeline will give you 
cleaned up and noncleaned commits. 
   right one to use is 
   ```
   
timeline=metaClient.getActiveTimeline().getCleanerTimeline().filterCompletedInstants()
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [hudi] nsivabalan commented on issue #8572: [SUPPORT] Getting java.io.FileNotFoundException when reading MOR table.

2023-04-26 Thread via GitHub


nsivabalan commented on issue #8572:
URL: https://github.com/apache/hudi/issues/8572#issuecomment-1523538698

   Generally incremental query will work only if cleaner has not run. 
   for eg, if you have 100 commits in your timeline and cleaner has cleaned up 
the data pertaining to first 25 commits for eg. incremental query is bound to 
fail if we try to query using the first 25 commits. But if the incremental 
query the latest 75 commits, you should not see any FileNotFound issue. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org