bruno-hypervolt opened a new issue, #17567: URL: https://github.com/apache/pinot/issues/17567
Hi, This task isn't distributed across minions, and worse, is single threaded. Unless I missed something big, it makes it unusable in any real life scenarios. To clarify, assuming you're streaming from a topic with 50 partitions, and that 5 minions are at your disposal. You'd expect this task to be split so that 5 subsets of 10 partitions are distributed to those 5 minions, and on each minion, up to 10 threads process those 10 partitions. What I'm seeing instead is 1 minion processing 50 partitions at a time, on 1 thread. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
