[ 
https://issues.apache.org/jira/browse/FLINK-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024658#comment-15024658
 ] 

ASF GitHub Bot commented on FLINK-2837:
---------------------------------------

Github user mxm commented on a diff in the pull request:

    https://github.com/apache/flink/pull/1398#discussion_r45747566
  
    --- Diff: 
flink-contrib/flink-storm/src/test/java/org/apache/flink/storm/wrappers/WrapperSetupHelperTest.java
 ---
    @@ -180,8 +178,6 @@ public void testCreateTopologyContext() {
                builder.setBolt("bolt2", (IRichBolt) operators.get("bolt2"), 
dops.get("bolt2")).allGrouping("spout2");
                builder.setBolt("sink", (IRichBolt) operators.get("sink"), 
dops.get("sink"))
                                .shuffleGrouping("bolt1", 
TestDummyBolt.groupingStreamId)
    -                           .shuffleGrouping("bolt1", 
TestDummyBolt.shuffleStreamId)
    -                           .shuffleGrouping("bolt2", 
TestDummyBolt.groupingStreamId)
                                .shuffleGrouping("bolt2", 
TestDummyBolt.shuffleStreamId);
    --- End diff --
    
    I was actually not specifically trying to address JIRA issues but just 
fixed everything I discovered on the way while trying out the compatibility 
layer. Only after fixing I realized there are open JIRA issues. One is assigned 
to me (FLINK-2837] and the other one (FLINK-2721) is open since two months. I 
think it would be a shame not to merge this pull request soon. It provides a 
good foundation to address any further issues. Splitting this PR should not be 
trivial with all the changes.
    
    I already accommodated you with the API changes. Also, I would like to 
address most of your comments but I'm not too inclined to split up this PR (if 
it is even possible). Could you base your work on this pull request and do a 
follow-up? 


> FlinkTopologyBuilder cannot handle multiple input streams
> ---------------------------------------------------------
>
>                 Key: FLINK-2837
>                 URL: https://issues.apache.org/jira/browse/FLINK-2837
>             Project: Flink
>          Issue Type: Bug
>          Components: Storm Compatibility
>            Reporter: Matthias J. Sax
>            Assignee: Maximilian Michels
>
> FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead 
> of union the incoming streams, it replicates the consuming bolt and each 
> (logical) instance processes one of the input streams.
> For example:
> {noformat}
> final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();
> builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
> builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
> builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));
> builder.setBolt(boltId, new MergerBolt())
>       .shuffleGrouping(spoutId1)
>       .shuffleGrouping(spoutId2)
>       .shuffleGrouping(spoutId3);
> builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
>       .shuffleGrouping(boltId);
> {noformat}
> will only print the data from a single source instead of all sources.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to