Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-26 Thread via GitHub
chenboat merged PR #13503: URL: https://github.com/apache/pinot/pull/13503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-24 Thread via GitHub
itschrispeck commented on code in PR #13503: URL: https://github.com/apache/pinot/pull/13503#discussion_r1690224690 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/realtime/impl/invertedindex/RealtimeLuceneIndexRefreshManager.java: ## @@ -0,0 +1,268 @@ +/**

Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-24 Thread via GitHub
chenboat commented on code in PR #13503: URL: https://github.com/apache/pinot/pull/13503#discussion_r1690197552 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/realtime/impl/invertedindex/RealtimeLuceneIndexRefreshManager.java: ## @@ -0,0 +1,268 @@ +/** + *

Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-19 Thread via GitHub
chenboat commented on code in PR #13503: URL: https://github.com/apache/pinot/pull/13503#discussion_r1685164385 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/realtime/impl/invertedindex/RealtimeLuceneIndexRefreshManager.java: ## @@ -0,0 +1,268 @@ +/** + *

Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-19 Thread via GitHub
chenboat commented on code in PR #13503: URL: https://github.com/apache/pinot/pull/13503#discussion_r1685163993 ## pinot-segment-local/src/main/java/org/apache/pinot/segment/local/realtime/impl/invertedindex/LuceneNRTCachingMergePolicy.java: ## @@ -0,0 +1,60 @@ +/** + *

Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-05 Thread via GitHub
itschrispeck commented on PR #13503: URL: https://github.com/apache/pinot/pull/13503#issuecomment-2211467078 > Is it possible to share some numbers on how this improvement has helped with freshness and at the same time the corresponding impact on CPU / mem / IO utilization / GC etc >

Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-05 Thread via GitHub
siddharthteotia commented on PR #13503: URL: https://github.com/apache/pinot/pull/13503#issuecomment-2211332833 Is it possible to share some numbers on how this improvement has helped with freshness and at the same time the corresponding impact on CPU / mem / IO utilization. I