Praveenkumar76 commented on issue #25135: URL: https://github.com/apache/pulsar/issues/25135#issuecomment-4430119814
I’d like to take this up! The OutOfMemoryError is clearly due to the lack of backpressure in the internal queues. I plan to: Replace the unbounded LinkedBlockingQueue instances with bounded versions. Update FileSourceConfig to allow users to configure the queue capacity (with a sensible default). Ensure the FileListingThread correctly blocks/pauses when the queues are full. I'll submit a PR for this shortly -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
