[
https://issues.apache.org/jira/browse/FLINK-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123718#comment-15123718
]
ASF GitHub Bot commented on FLINK-3161:
---------------------------------------
Github user greghogan commented on the pull request:
https://github.com/apache/flink/pull/1523#issuecomment-176853645
New commit that passes FLINK_SSH_OPTS to pdsh.
64 x c4.large
0m4.210s 0m4.181s
0m4.203s 0m4.283s
0m4.262s 0m4.196s
0m13.969s 0m12.533s
0m13.906s 0m13.169s
0m14.122s 0m12.343s
16 x c4.large
0m1.270s 0m1.267s
0m1.277s 0m1.164s
0m1.470s 0m1.180s
0m3.961s 0m2.985s
0m3.638s 0m3.014s
0m3.410s 0m3.159s
1 x c4.large
0m0.543s 0m0.449s
0m0.547s 0m1.300s
0m0.542s 0m0.452s
0m0.439s 0m1.247s
0m0.448s 0m1.439s
0m0.439s 0m0.827s
> Externalize cluster start-up and tear-down when available
> ---------------------------------------------------------
>
> Key: FLINK-3161
> URL: https://issues.apache.org/jira/browse/FLINK-3161
> Project: Flink
> Issue Type: Improvement
> Components: Start-Stop Scripts
> Affects Versions: 1.0.0
> Reporter: Greg Hogan
> Assignee: Greg Hogan
> Priority: Minor
>
> I have been using pdsh, pdcp, and rpdcp to both distribute compiled Flink and
> to start and stop the TaskManagers. The current shell script initializes
> TaskManagers one-at-a-time. This is trivial to background but would be
> unthrottled.
> From pdsh's archived homepage: "uses a sliding window of threads to execute
> remote commands, conserving socket resources while allowing some connections
> to timeout if needed".
> What other tools could be supported when available?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
