Igosuki commented on issue #1544: URL: https://github.com/apache/arrow-datafusion/issues/1544#issuecomment-1013542427
There is prior art, the simplest of which is Kafka streams, but you can also look at materialize. As for the issue here, I don't understand the issue ? If you want to communicate between async tasks, use channels. Streaming operations are typically of a different kind, all common operations require a specific implementation to be able to be distributed and partitioned according to a topology Aggregation operations accumulate data until a trigger sends the new value downstream. Join operations wait for a left or right value and send the combination downstream when a new one arrives, for instance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
