anuragrai16 opened a new pull request, #17884: URL: https://github.com/apache/pinot/pull/17884
Prospective fix for https://github.com/apache/pinot/issues/17877 **Summary** Fix missing CPU/memory tracking for realtime Lucene and HNSW index searcher threads Enable OOM killer to properly terminate TEXT_MATCH and VECTOR_SIMILARITY queries **Changes** `RealtimeLuceneTextIndex`: Propagate QueryThreadContext to async searcher threads for resource tracking `MultiColumnRealtimeLuceneTextIndex`: Same fix for multi-column text index variant `MutableVectorIndex`: Convert synchronous Lucene search to async pattern using RealtimeLuceneTextIndexSearcherPool, preventing FSDirectory corruption on thread interrupt while enabling proper resource tracking `LuceneDocIdCollector`/`HnswDocIdCollector`: Add periodic checkTerminationAndSampleUsagePeriodically() calls in collectors to detect OOM termination during document collection **Tests** RealtimeLuceneTextIndexResourceTrackingTest: Unit tests verifying context propagation, thread registration, and termination handling TextMatchOomKillingIntegrationTest: Integration test validating OOM killing for TEXT_MATCH queries -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
