NGA-TRAN commented on PR #25692: URL: https://github.com/apache/datafusion/pull/25692#issuecomment-5856653213
Thanks a lot @alamb for letting us know. > For example, if your data is ORDER BY time and your query is ORDER BY datebin(time, ..) this change will force the entire dataset to be resorted. Similiarly if the query is GROUP BY date_bin(time, ...) this change will force the entire dataset to be hashed (rather than streamed) These are the behaviors we are trying very hard to avoid. We do want to keep data (implicitly) sorted by `date_bin(time)` and no repartition/hash added in the way. We want to keep data streaming. Is there a flag to turnon/off this change? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
