Re: Integrating multiple streaming sources

2020-12-22 Thread Artemis User
Hmm, looks like Spark 2.3+ does support stream-to-stream join. But the online doc doesn't provide any examples.  If anyone could provide some concrete reference, I'd really appreciate.  Thanks! -- ND On 12/22/20 9:57 AM, Artemis User wrote: Is there anyway to integrate/fuse multiple streaming

Integrating multiple streaming sources

2020-12-22 Thread Artemis User
Is there anyway to integrate/fuse multiple streaming sources into a single stream process?  In other words, the current structured streaming API dictates a single a streaming source and sink.  We'd like to have a stream process that interfaces with multiple stream sources, perform a join and