[
https://issues.apache.org/jira/browse/BEAM-6058?focusedWorklogId=170060&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-170060
]
ASF GitHub Bot logged work on BEAM-6058:
----------------------------------------
Author: ASF GitHub Bot
Created on: 27/Nov/18 23:53
Start Date: 27/Nov/18 23:53
Worklog Time Spent: 10m
Work Description: angoenka commented on a change in pull request #7031:
[BEAM-6058] Adding option for flink configuration directory and setting config
in exectution environment
URL: https://github.com/apache/beam/pull/7031#discussion_r236893769
##########
File path:
runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkJobServerDriver.java
##########
@@ -94,6 +95,18 @@ String getFlinkMasterUrl() {
Long getSdkWorkerParallelism() {
return this.sdkWorkerParallelism;
}
+
+ @Option(
+ name = "--flink-conf-dir",
+ usage =
+ "Directory containing Flink YAML configuration files. These
properties will be set to all jobs submitted to Flink."
Review comment:
Updated
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 170060)
Time Spent: 8.5h (was: 8h 20m)
> Support flink config directory for flink runner.
> ------------------------------------------------
>
> Key: BEAM-6058
> URL: https://issues.apache.org/jira/browse/BEAM-6058
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Ankur Goenka
> Assignee: Ankur Goenka
> Priority: Major
> Time Spent: 8.5h
> Remaining Estimate: 0h
>
> Give user option to use flink configuration from a config directory.
> Earlier we only used jars to submit flink jobs which by default picks the
> cluster flink properties.
> Portability uses remote environment to submit flink job. In Remote
> execution, flink uses the client config instead of the cluster config. This
> require us to submit the custom flink properties via flink client.
> Suggestion is to read the flink config from a flink configuration folder and
> set them to the environment.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
