[
https://issues.apache.org/jira/browse/FLINK-33943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800669#comment-17800669
]
Vijay commented on FLINK-33943:
-------------------------------
The issue can be reproduced by enabling high-availability.type: zookeeper (with
above config's specified on the issue) and in the flink client code try to call
env.executeAsync() for multiple instance of job for the same application. Now
open Dashboard and check the number of jobs running(same can be tried via REST
api call too), then you will find only one job running. When you disable HA
(high-availability.type: NONE), then you can see multiple jobs running (same
can be seen via REST api call too).
REST api: http://<IP_ADDRESS>:8081/v1/jobs
> Apache flink: Issues after configuring HA (using zookeeper setting)
> -------------------------------------------------------------------
>
> Key: FLINK-33943
> URL: https://issues.apache.org/jira/browse/FLINK-33943
> Project: Flink
> Issue Type: Bug
> Components: Build System
> Affects Versions: 1.18.0
> Environment: Flink version: 1.18
> Zookeeper version: 3.7.2
> Env: Custom flink docker image (with embedded application class) deployed
> over kubernetes (v1.26.11).
>
> Reporter: Vijay
> Priority: Major
>
> Hi Team,
> Note: Not sure whether I have picked the right component while raising the
> issue.
> Good Day. I am using Flink (1.18) version and zookeeper (3.7.2) for our flink
> cluster. Job manager has been deployed on "Application mode" and when HA is
> disabled (high-availability.type: NONE) we are able to start multiple jobs
> (using env.executeAsyn()) for a single application. But when I setup the
> Zookeeper as the HA type (high-availability.type: zookeeper), we are only
> seeing only one job is getting executed on the Flink dashboard. Following are
> the parameters setup for the Zookeeper based HA setup on the flink-conf.yaml.
> Please let us know if anyone has experienced similar issues and have any
> suggestions. Thanks in advance for your assistance.
> Note: We are using a Streaming application and following are the
> flink-config.yaml configurations.
> # high-availability.storageDir: /opt/flink/data
> # high-availability.cluster-id: test
> # high-availability.zookeeper.quorum: localhost:2181
> # high-availability.type: zookeeper
> # high-availability.zookeeper.path.root: /dp/configs/flinkha
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
