[ https://issues.apache.org/jira/browse/BEAM-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898281#comment-15898281 ]
Xu Mingmin commented on BEAM-1631: ---------------------------------- Do I understand correctly? I can submit a job with Flink runner on YARN, either directly on YARN, or by creating a virtual cluster on YARN. Flink version 1.2.0 YARN: 2.6/2.7 Beam: 0.6.0-SNAPSHOT > Flink runner: submit job to a Flink-on-YARN cluster > --------------------------------------------------- > > Key: BEAM-1631 > URL: https://issues.apache.org/jira/browse/BEAM-1631 > Project: Beam > Issue Type: New Feature > Components: runner-flink > Reporter: Davor Bonaci > Assignee: Aljoscha Krettek > > As far as I understand, running Beam pipelines on a Flink cluster can be done > in two ways: > * Run directly with a Flink runner, and specifying {{--flinkMaster}} pipeline > option via, say, {{mvn exec}}. > * Produce a bundled JAR, and use {{bin/flink}} to submit the same pipeline. > These two ways are equivalent, and work well on a standalone Flink cluster. > Submitting to a Flink-on-YARN is more complicated. You can still produce a > bundled JAR, and use {{bin/flink -yid <applicationid>}} to submit such a job. > However, that seems impossible with a Flink runner directly. > If so, we should add the ability to the Flink runner to submit a job to a > Flink-on-YARN cluster directly. -- This message was sent by Atlassian JIRA (v6.3.15#6346)