Hi,

Trying something simple here: Global view of all GroupByKey values

. Looking to get a cumulative GroupBy of a field and I like my Window
trigger to fire with all the values seen so far. However what I get is seem
to be new values. Basically almost feels like what I should expect from
discardingFiredPanes. Am I missing something?

PCollection<KV<String,Double>> pubSubMessages = pipeline
        .apply("ReadFromPubSub", PubsubIO.readStrings().fromTopic("xxxxxxx"))
        .apply("TransformToEvent", ParDo.of(new EmitEvent()))
        .apply("GetV1",ParDo.of(new ExtractV1Field()))
        .apply("Window",Window.<KV<String,Double>>into(new GlobalWindows())

.triggering(Repeatedly.forever(AfterProcessingTime.pastFirstElementInPane()))

.accumulatingFiredPanes().withAllowedLateness(Duration.standardDays(30)))
        .apply("SUM",Sum.doublesPerKey());


Thanks,

Parviz

Reply via email to