[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-21 Thread AJ (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262089#comment-16262089 ] AJ commented on BEAM-3200: -- Here's a bigger stack trace {noformat} org.apache.beam.sdk.ut

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-21 Thread AJ (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260986#comment-16260986 ] AJ commented on BEAM-3200: -- Yes, all belong to the same dataset. > Streaming Pipeline throws Runt

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-21 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260429#comment-16260429 ] Reuven Lax commented on BEAM-3200: -- Are the tables all belonging to the same dataset?

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-21 Thread AJ (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260415#comment-16260415 ] AJ commented on BEAM-3200: -- This is the stack trace I get for the above exception: {noformat}

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-20 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260176#comment-16260176 ] Reuven Lax commented on BEAM-3200: -- Is it possible that your exception is originating in W

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-20 Thread AJ (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260166#comment-16260166 ] AJ commented on BEAM-3200: -- I am assuming you are asking about load size per trigger. It might be

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-18 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258287#comment-16258287 ] Reuven Lax commented on BEAM-3200: -- I do see a potential bug that can trigger if any of th

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-18 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258285#comment-16258285 ] Reuven Lax commented on BEAM-3200: -- Yes, however the root cause of this bug is likely more

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-17 Thread AJ (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257978#comment-16257978 ] AJ commented on BEAM-3200: -- Thanks for looking into this. From your explanation it sounds like thi

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-17 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257862#comment-16257862 ] Reuven Lax commented on BEAM-3200: -- We shuffle with Destination as they key before calling

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

2017-11-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257715#comment-16257715 ] Eugene Kirpichov commented on BEAM-3200: Hmm, I'd expect that the code you linked w