wangyinsheng commented on issue #19360: URL: https://github.com/apache/hudi/issues/19360#issuecomment-5067420361
> there might be some space for optimization for the fs view loading on server, we did try to omit some actions like clean for the timeline comparision before sync and cause data loss: [#6179](https://github.com/apache/hudi/pull/6179), might need to think through the strategy to refresh the fs view. In our case, compaction scheduling has already blocked the streaming writer, so no new instant is generated after that point. The client's timeline is therefore behind the server's. The intent of isLocalViewBehind — as it is used here — is to indicate whether the server-side view is behind (i.e. whether the server needs to reload its timeline). Under this condition, however, it keeps returning true, driving the server to reload its timeline over and over, and every one of those reloads returns exactly the same state — they are effectively no-ops. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
