[jira] [Comment Edited] (FLINK-2373) Add configuration parameter to createRemoteEnvironment method
[ https://issues.apache.org/jira/browse/FLINK-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708693#comment-14708693 ] Andreas Kunft edited comment on FLINK-2373 at 8/24/15 2:29 AM: --- Hey, i was just going to open a PR which had basically also another method for the remote environment with the extra configuration parameter, just like yours. So I guess, the PR is now obsolete. As far as I see it, there is a difference in the configuration provided for the remote environment and the local one, as the remote config is only used for def. parallelism and the akka config for the job client and not for configuration of the cluster itself. The config for the local execution covers all the configuration. I think it should be stated clearly in the java doc, that the config is only for the jobclient and def. parallelism in case of the remote environment. was (Author: akunft): Hey, i was just going to open a PR which had basically also another method for the remote environment with the extra configuration parameter, just like yours. So I guess, the PR is now obsolete. As far as I see it, there is a difference for the configuration provided for the remote environment and the local one, as the remote config is only used for def. parallelism and the akka config for the job client and not for configuration of the cluster itself, as the config for the local execution covers all the configuration. I think it should be stated clearly in the java doc, that the config is only for the jobclient and def. parallelism in case of the remote environment. > Add configuration parameter to createRemoteEnvironment method > - > > Key: FLINK-2373 > URL: https://issues.apache.org/jira/browse/FLINK-2373 > Project: Flink > Issue Type: Bug > Components: other >Reporter: Andreas Kunft >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > Currently there is no way to provide a custom configuration upon creation of > a remote environment (via ExecutionEnvironment.createRemoteEnvironment(...)). > This leads to errors when the submitted job exceeds the default value for the > max. payload size in Akka, as we can not increase the configuration value > (akka.remote.OversizedPayloadException: Discarding oversized payload...) > Providing an overloaded method with a configuration parameter for the remote > environment fixes that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (FLINK-2373) Add configuration parameter to createRemoteEnvironment method
[ https://issues.apache.org/jira/browse/FLINK-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708693#comment-14708693 ] Andreas Kunft edited comment on FLINK-2373 at 8/24/15 2:39 AM: --- Hey, i was just going to open a PR which had basically also another method for the remote environment with the extra configuration parameter, just like yours. So I guess, the PR is now obsolete (you can see my changes here: https://github.com/akunft/flink/commit/60240632ed71c072ecf880a586f12fd966412d67). As far as I see it, there is a difference in the configuration provided for the remote environment and the local one, as the remote config is only used for def. parallelism and the akka config for the job client and not for configuration of the cluster itself. The config for the local execution covers all the configuration. I think it should be stated clearly in the java doc, that the config is only for the jobclient and def. parallelism in case of the remote environment. was (Author: akunft): Hey, i was just going to open a PR which had basically also another method for the remote environment with the extra configuration parameter, just like yours. So I guess, the PR is now obsolete. As far as I see it, there is a difference in the configuration provided for the remote environment and the local one, as the remote config is only used for def. parallelism and the akka config for the job client and not for configuration of the cluster itself. The config for the local execution covers all the configuration. I think it should be stated clearly in the java doc, that the config is only for the jobclient and def. parallelism in case of the remote environment. > Add configuration parameter to createRemoteEnvironment method > - > > Key: FLINK-2373 > URL: https://issues.apache.org/jira/browse/FLINK-2373 > Project: Flink > Issue Type: Bug > Components: other >Reporter: Andreas Kunft >Priority: Minor > Original Estimate: 24h > Remaining Estimate: 24h > > Currently there is no way to provide a custom configuration upon creation of > a remote environment (via ExecutionEnvironment.createRemoteEnvironment(...)). > This leads to errors when the submitted job exceeds the default value for the > max. payload size in Akka, as we can not increase the configuration value > (akka.remote.OversizedPayloadException: Discarding oversized payload...) > Providing an overloaded method with a configuration parameter for the remote > environment fixes that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
