comphead commented on issue #4837:
URL:
https://github.com/apache/datafusion-comet/issues/4837#issuecomment-4917475519
This operator is a new TopK operator introduced in Spark 3.5
Before Spark 3.5
```
Catalyst rewrote this to something like Limit(3, Window(Sort(t))), which
combined with TakeOrderedAndProjectExec gave you the classic heap-based top-K
over a single stream. But this only worked when there
was no PARTITION BY — the moment you added one, you fell back to the naive
full-sort-full-window plan.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
