[
https://issues.apache.org/jira/browse/BEAM-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16339835#comment-16339835
]
Eugene Kirpichov commented on BEAM-3152:
----------------------------------------
Does this issue affect Beam 2.2 or at HEAD? The WriteFiles transform had a
windowing bug that has since been fixed.
> AfterProcessingTime trigger doesn't create any file panes
> ---------------------------------------------------------
>
> Key: BEAM-3152
> URL: https://issues.apache.org/jira/browse/BEAM-3152
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core
> Affects Versions: 2.0.0
> Reporter: Pawel Bartoszek
> Assignee: Eugene Kirpichov
> Priority: Major
>
> Scenario:
> I want to count how many events A and B I am getting for given 30 window. I
> require that every pane has all events types (A and B) with corresponding
> counters - this is why I am using Combine.globally.
> The calculation logic works fine the problem is with writing files. The files
> are not written.
> For debugging purposes I created some transformations (Simulate
> ApplyShardLabel, Simulate GroupIntoShards etc) that mimics that logic
> implemented by WriteFiles.
> If you push string "A" and "B" to kinesis stream I am seeing the following
> system.out from the job:
> {code:java}
> AFTER COMBINE: {A=1, B=1}
> {code}
> According to my test transformations I should also see:
> {code:java}
> AFTER COMBINE: {A=1, B=1}
> Simulating ApplyShardLabel
> Simulating finalizing writer: KV{null, [KV{0, [{A=1, B=1}]}]}
> {code}
> Using DirectRunner and Beam 2.0.0. When I switch to Beam 2.1.0 I see the
> expected debug output and files being written out.
> I think that there is some issue with AfterSynchronizedProcessingTime trigger
> support.
> I cannot replicate the issue when using `TestStream`
> The test code can be found at
> [https://gist.github.com/pbartoszek/9dd58c4fcfc5171eafba3520cb3040fa|https://gist.github.com/pbartoszek/9dd58c4fcfc5171eafba3520cb3040fa]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
