npawar commented on issue #10147: URL: https://github.com/apache/pinot/issues/10147#issuecomment-1404528969
Thanks for starting this @sajjad-moradi ! Looking forward to this. Couple of questions: 1. `Server Query Executor sends the incoming query to the main segment as well as the temporary segment if there is one` - Could you elaborate on this? How will we send the query to temporary segment, if there's no record of it in ideal state/external view, given the EV is what drives all the routing logic? I'm wondering if that would end up looking like a lot of if-else in the query execution at consuming segment level, as we won't have any info about this segment in the planner/executor etc. 2. What Jackie suggested, was also what came to my mind instantly when I read the problem statement. It does seema. lot more natural and a clean extension, and will reduce the number of special cases we'd have to think about. We can still set it up to consume 20% of the main segment size if that's what is deemed best, and update it when we have that definitive number. Or we go with the previous segment's size, and make rows adjustments with 1 segment delay. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
