alamb commented on PR #24486: URL: https://github.com/apache/datafusion/pull/24486#issuecomment-5400532264
> For the major use case of PartialReduce aggregation—reducing data locally before shuffle (https://github.com/datafusion-contrib/datafusion-distributed/issues/360) think early emission may actually be the intended behavior. I agree this is the intended behavior -- and I think it would be better behavior to avoid errors entirely, and instead dump the hash table we have accumulated so far, and start aggregating again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
