littlelittlewhite09 commented on issue #11540: URL: https://github.com/apache/gluten/issues/11540#issuecomment-5617067735
> Window doesn't support spill. the sort before window support. So if a window partition is very large, like lots of rows with the same window key, it fails with OOM. Thank you for your reply. And, I am confused that Why not make window support spill? In vanilla spark, the sql statement can run successfully, but Gluten not. So if a window partition is very large, how can I resolve it in a graceful way? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
