[
https://issues.apache.org/jira/browse/BEAM-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629502#comment-16629502
]
Thomas Weise commented on BEAM-5516:
------------------------------------
Command:
{code:java}
python -m apache_beam.examples.wordcount --input=/etc/profile
--output=/tmp/tw-py-wordcount-direct --experiments=beam_fn_api
--runner=PortableRunner --sdk_location=container
--job_endpoint=localhost:8099 --parallelism=2 --flink_master=localhost:18080
--streaming{code}
SDK side:
{code:java}
...
fields {
key: "beam:option:flink_master:v1"
value {
string_value: "localhost:18080"
}
}
...
fields {
key: "beam:option:parallelism:v1"
value {
number_value: 2.0
}
}
...{code}
Runner:
{code:java}
[flink-runner-job-server] INFO
org.apache.beam.runners.flink.FlinkExecutionEnvironments - pipelineOptions:
Current Settings:
appName: null
dataflowEndpoint: "https://dataflow.googleapis.com";
directRunnerUseStackedBundle: true
dryRun: false
experiments: ["beam_fn_api"]
flinkMaster: "[auto]"
jobEndpoint: "localhost:8099"
jobName: "BeamApp-tweise-0926225626-1bc0799b"
noAuth: false
optionsId: 1
parallelism: 2.0
pipelineTypeCheck: true
profileCpu: false
profileMemory: false
region: "us-central1"
runner: null
runtimeTypeCheck: false
saveMainSession: true
sdkLocation: "container"
streaming: true
typeCheckStrictness: "DEFAULT_TO_ANY"{code}
> Flink master option from Python SDK not honored by Flink runner
> ---------------------------------------------------------------
>
> Key: BEAM-5516
> URL: https://issues.apache.org/jira/browse/BEAM-5516
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Thomas Weise
> Assignee: Maximilian Michels
> Priority: Major
> Labels: portability-flink
>
> The option is sent by the Python SDK but dropped by the job server.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
