I think I can connect the broadcast streams to the single keyed stream (as in 2 connects ) and access the 2 or n broadcast states through the key in the Broadcast Map in processBroadcastElement , using a single instance of the Processor function. In essence I need to merge the results of the 2 rules careying broadcast stream in a single keyed brooadcast function .....
On Tue, Sep 18, 2018, 8:59 AM Vishal Santoshi <[email protected]> wrote: > I have 2 broadcast streams that carry rules to be applied to a third > keyed stream. The connect method of the keyed stream only takes a single > broadcast stream. How do I connect the 2 broadcast stream to that single > keyed stream. > > Do I have 2 connects and thus 2 instances of BroadcastConnextedStream, > union them and then apply process through a single > SingleOutpitStreamOperator ? The issue I see there are 2 keyBy calls and an > additional shuffle before connect is called. > > To be precise, is there a simple example of applying 2 dissimilar rules > through 2 broadcast streams, thus 2 different MapStateDiscriptors, to a > single keyed stream without any unnecessary overhead... > > > >
