It's just an immediate place holder to update the query plan in each
micro-batch.
On Sat, May 15, 2021 at 10:29 PM Jacek Laskowski wrote:
> Hi,
>
> Just stumbled upon OffsetHolder [1] and am curious why it's a LeafNode?
> What logical plan could it be part of?
>
> [1]
>
Hi,
Just stumbled upon OffsetHolder [1] and am curious why it's a LeafNode?
What logical plan could it be part of?
[1]
https://github.com/apache/spark/blob/1a6708918b32e821bff26a00d2d8b7236b29515f/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala#L633