hudi-bot opened a new issue, #14481: URL: https://github.com/apache/hudi/issues/14481
This is another comment that stemmed from Timeline Server code-review. Notes from PR comments: '''RandomAccessFile is not threadsafe. Hence, we would have to create separate RandomAccessFileObjects for concurrent access. Agree, the current approach of opening a new file per get() call is slow. I have made changes to use ThreadLocal objects. This should reduce the open() calls greatly but for a long running timeline service, there could be open handles getting accumulated per thread. A better approach would be to use Resource Pool but needs to be config tuned and tested. There is another place (ThreadLocal where we might require similar treatment. Will open a ticket to address it. If current perf testing points to the direction of Resource pool, will address it as part of this PR. Otherwise, we can take this in subsequent PR''' ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-104 - Type: Improvement --- ## Comments 06/Sep/19 13:50;taherk77;Hi [~vbalaji] I am not very much aware of what really the issue is in-depth. However from what I saw from the above comments. How about using at BalancedPool of PersistentActor? That will give a lot of isolation and will get your rid of all the synchronisation.;;; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
