感谢感谢,可以看的,我添加到附件给您发过去
| | lishiyuan0506 | | lishiyuan0...@163.com | ---- Replied Message ---- | From | JasonLee<17610775...@163.com> | | Date | 07/14/2022 16:15 | | To | user-zh@flink.apache.org<user-zh@flink.apache.org> | | Subject | Re: Retrying connect to server: 0.0.0.0/0.0.0.0:8030 | Hi 可以用 yarn logs -applicationId xxx 看下日志吗? Best JasonLee ---- Replied Message ---- | From | lishiyuan0506<lishiyuan0...@163.com> | | Date | 07/14/2022 15:43 | | To | user-zh@flink.apache.org<user-zh@flink.apache.org> | | Subject | Re: Retrying connect to server: 0.0.0.0/0.0.0.0:8030 | hello,根据您的思路,我查看了所有的yarn-site.xml,没有发现配置出错的地方,Spark和MR的运行都正常,感觉不是yarn的问题 | | lishiyuan0506 | | lishiyuan0...@163.com | ---- Replied Message ---- | From | Biao Geng<biaoge...@gmail.com> | | Date | 07/14/2022 15:37 | | To | <user-zh@flink.apache.org> | | Subject | Re: Retrying connect to server: 0.0.0.0/0.0.0.0:8030 | hi 根据你发的描述,是Flink的job manager在非RM所在机器上启动时,由于尝试连接0.0.0.0:8030 端口去向YARN申请资源时连接不通,导致失败。你可以检查下集群内worker节点的hadoop配置,看看yarn.resourcemanager.hostname等配置是否设置正确。 Best, Biao Geng lishiyuan0506 <lishiyuan0...@163.com> 于2022年7月14日周四 15:17写道: 您好,我之前做了一些尝试: 1. 测试Spark、MR任务正常 2. 将生产环境的Flink和官网干净的Flink安装后测试example,出现同样的问题 3. 尝试在`/opt/flink-1.13.3/bin/config.sh`中配置`DEFAULT_YARN_CONF_DIR="/opt/hadoop-3.1.4/etc/hadoop/"`,测试example出现同样的问题,说明Flink已经成功加载了`yarn-site.xml` 4.尝试在`/opt/flink-1.13.3/bin/config.sh`中配置`export HADOOP_CONF_DIR=/opt/hadoop-3.1.4/etc/hadoop`,`export HADOOP_CLASSPATH=`hadoop classpath`测试example出现同样的问题 目前无论是yarn还是flink都找不出来出现了什么问题,手足无措了 | | lishiyuan0506 | | lishiyuan0...@163.com | ---- Replied Message ---- | From | Biao Geng<biaoge...@gmail.com> | | Date | 07/14/2022 14:31 | | To | <user-zh@flink.apache.org> | | Subject | Re: Retrying connect to server: 0.0.0.0/0.0.0.0:8030 | hi, 你提到跑wordcount.jar时,当作业被调度到RM所在的机器上可以正常运行,调度到非RM所在的机器上就失败。flink环境干净的话,那大概率还是hadoop的环境设置有问题。 有几个可以检查的地方: 1. 运行flink run之前或者在flink的bin/config.sh里是否有正确设置hadoop环境变量,例如 export HADOOP_CLASSPATH=`hadoop classpath` 2. 集群内机器(比如非RM所在机器)的HADOOP_CONF_DIR是否设置正确,其指向的目录里的yarn-site.xml的yarn.resourcemanager.hostname等配置是否设置正确 Best, Biao Geng Biao Geng <biaoge...@gmail.com> 于2022年7月14日周四 11:32写道: hi, 你有试过提交flink example(比如wordcount作业)吗?如果报了一样的错误的话,可以检查一下你的flink/lib目录下是否有放多余的YARN配置(比如运行grep -irn "0.0.0.0" $FLINK_HOME);如果example可以成功提交,可以看看是不是你的作业jar里打进了错误的YARN配置。 Best, Biao Geng lishiyuan0506 <lishiyuan0...@163.com> 于2022年7月14日周四 11:06写道: 您好,环境变量里面有,而且flink的conf.sh也设置了 lishiyuan0506 lishiyuan0...@163.com < https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=lishiyuan0506&uid=lishiyuan0506%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22lishiyuan0506%40163.com%22%5D ---- Replied Message ---- From Yang Wang<danrtsey...@gmail.com> <danrtsey...@gmail.com> Date 07/14/2022 11:00 To user-zh<user-zh@flink.apache.org> <user-zh@flink.apache.org> Subject Re: Retrying connect to server: 0.0.0.0/0.0.0.0:8030 确认一下你是否正确设置了HADOOP_CONF_DIR环境变量 Best, Yang lishiyuan0506 <lishiyuan0...@163.com> 于2022年7月14日周四 09:41写道: 打扰大家一下,请问一下各位在yarn提交flink的时候,有没有遇到过Retrying connect to server: 0.0.0.0/0.0.0.0:8030这个异常 hadoop的classpath没问题,Spark和MR在Yarn上跑也没问题,就flink有这样的问题 | | lishiyuan0506 | | lishiyuan0...@163.com |
Log Type: jobmanager.log Log Upload Time: Thu Jul 14 15:11:43 +0800 2022 Log Length: 52944 2022-07-14 15:10:45,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2022-07-14 15:10:45,904 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting YarnJobClusterEntrypoint (Version: 1.13.3, Scala: 2.12, Rev:a4700e3, Date:2021-10-11T23:52:36+02:00) 2022-07-14 15:10:45,904 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: root 2022-07-14 15:10:46,041 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2022-07-14 15:10:46,106 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: root 2022-07-14 15:10:46,106 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.212-b10 2022-07-14 15:10:46,107 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 429 MiBytes 2022-07-14 15:10:46,107 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /opt/jdk1.8.0_212 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 3.1.4 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options: 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx469762048 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms469762048 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/data/hadoop/yarn/logs/application_1657291086243_0014/container_e88_1657291086243_0014_01_000001/jobmanager.log 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:log4j.properties 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:log4j.properties 2022-07-14 15:10:46,109 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments: 2022-07-14 15:10:46,110 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=469762048b 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b 2022-07-14 15:10:46,111 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: :WordCount.jar:lib/flink-csv-1.13.3.jar:lib/flink-json-1.13.3.jar:lib/flink-shaded-zookeeper-3.4.14.jar:lib/flink-table-blink_2.12-1.13.3.jar:lib/flink-table_2.12-1.13.3.jar:lib/log4j-1.2-api-2.12.1.jar:lib/log4j-api-2.12.1.jar:lib/log4j-core-2.12.1.jar:lib/log4j-slf4j-impl-2.12.1.jar:flink-dist_2.12-1.13.3.jar:job.graph:flink-conf.yaml::/opt/hadoop-3.1.4/etc/hadoop/*:/opt/hadoop-3.1.4/share/hadoop/common/hadoop-common-3.1.4-tests.jar:/opt/hadoop-3.1.4/share/hadoop/common/hadoop-common-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/hadoop-kms-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/hadoop-nfs-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/accessors-smart-1.2.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/nimbus-jose-jwt-7.9.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/asm-5.0.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jersey-json-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jsr305-3.0.2.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/checker-qual-2.5.2.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-codec-1.11.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jersey-core-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-compress-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jersey-server-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/re2j-1.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-io-2.5.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-lang3-3.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/commons-net-3.6.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/curator-client-2.13.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/curator-framework-2.13.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/curator-recipes-2.13.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jersey-servlet-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/error_prone_annotations-2.2.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/failureaccess-1.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/snappy-java-1.0.5.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/stax2-api-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/hadoop-annotations-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/hadoop-auth-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/token-provider-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/httpclient-4.5.2.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/httpcore-4.4.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-io-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jackson-annotations-2.9.10.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jackson-core-2.9.10.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-http-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jackson-databind-2.9.10.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-webapp-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/zookeeper-3.4.13.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/netty-3.10.6.Final.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-security-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-server-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jsch-0.1.55.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-servlet-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/json-smart-2.3.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/jetty-util-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-3.1.4-tests.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-client-3.1.4-tests.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-client-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.4-tests.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-native-client-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-nfs-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.4-tests.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/hadoop-hdfs-rbf-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jsch-0.1.55.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/asm-5.0.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/netty-all-4.1.48.Final.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/avro-1.7.7.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/json-smart-2.3.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/nimbus-jose-jwt-7.9.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-compress-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-io-2.5.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/okio-1.6.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-lang3-3.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/paranamer-2.3.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/commons-net-3.6.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/curator-client-2.13.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/curator-framework-2.13.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/curator-recipes-2.13.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/error_prone_annotations-2.2.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/gson-2.2.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/re2j-1.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/guava-27.0-jre.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/hadoop-annotations-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/hadoop-auth-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/httpclient-4.5.2.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/httpcore-4.4.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-util-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jackson-annotations-2.9.10.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jackson-core-2.9.10.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jettison-1.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jackson-databind-2.9.10.4.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-http-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-io-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-util-ajax-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-security-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-webapp-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-server-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-xml-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/jetty-servlet-9.4.20.v20190813.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/opt/hadoop-3.1.4/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.4-tests.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop-3.1.4/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-api-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-client-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-common-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-registry-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-common-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-router-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-tests-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-services-api-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/hadoop-yarn-services-core-3.1.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/dnsjava-2.1.7.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/fst-2.50.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/guice-4.0.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/jackson-jaxrs-base-2.9.10.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.9.10.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/java-util-1.9.0.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/jersey-client-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/json-io-2.5.1.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/objenesis-1.0.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/opt/hadoop-3.1.4/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar 2022-07-14 15:10:46,113 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2022-07-14 15:10:46,114 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT] 2022-07-14 15:10:46,117 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - YARN daemon is running as: root Yarn client user obtainer: root 2022-07-14 15:10:46,127 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 2048mb 2022-07-14 15:10:46,127 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.jobgraph-path, job.graph 2022-07-14 15:10:46,127 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: classloader.check-leaked-classloader, false 2022-07-14 15:10:46,127 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region 2022-07-14 15:10:46,127 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1657291086243_0014 2022-07-14 15:10:46,127 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-per-job 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1024mb 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, file:/opt/flink-1.13.3/examples/streaming/WordCount.jar 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1 2022-07-14 15:10:46,128 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2022-07-14 15:10:46,128 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /data/hadoop/yarn/local/usercache/root/appcache/application_1657291086243_0014/container_e88_1657291086243_0014_01_000001/flink-conf.yaml:17: "pipeline.classpaths: " 2022-07-14 15:10:46,129 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.application.name, test_wordcount 2022-07-14 15:10:46,129 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.deployment.config-dir, /opt/flink-1.13.3/conf 2022-07-14 15:10:46,129 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /opt/flink-1.13.3/conf/log4j.properties 2022-07-14 15:10:46,146 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.bind-port' 2022-07-14 15:10:46,160 INFO org.apache.flink.runtime.clusterframework.BootstrapTools [] - Setting directories for temporary files to: /data/hadoop/yarn/local/usercache/root/appcache/application_1657291086243_0014 2022-07-14 15:10:46,165 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting YarnJobClusterEntrypoint. 2022-07-14 15:10:46,202 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem. 2022-07-14 15:10:46,241 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context. 2022-07-14 15:10:46,279 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user set to root (auth:SIMPLE) 2022-07-14 15:10:46,286 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /data/hadoop/yarn/local/usercache/root/appcache/application_1657291086243_0014/jaas-3432267796054915626.conf. 2022-07-14 15:10:46,298 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services. 2022-07-14 15:10:46,316 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address gtcq-cosmo-dip-hadoop-04:0, bind address 0.0.0.0:0. 2022-07-14 15:10:47,079 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started 2022-07-14 15:10:47,108 INFO akka.remote.Remoting [] - Starting remoting 2022-07-14 15:10:47,242 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189] 2022-07-14 15:10:47,351 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189 2022-07-14 15:10:47,374 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.port' 2022-07-14 15:10:47,381 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /data/hadoop/yarn/local/usercache/root/appcache/application_1657291086243_0014/blobStore-5b8c5cb7-99e4-4a74-a0a0-fa84c93168f6 2022-07-14 15:10:47,384 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:22488 - max concurrent requests: 50 - max backlog: 1000 2022-07-14 15:10:47,393 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported. 2022-07-14 15:10:47,396 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address gtcq-cosmo-dip-hadoop-04:0, bind address 0.0.0.0:0. 2022-07-14 15:10:47,410 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started 2022-07-14 15:10:47,414 INFO akka.remote.Remoting [] - Starting remoting 2022-07-14 15:10:47,423 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@gtcq-cosmo-dip-hadoop-04:34151] 2022-07-14 15:10:47,485 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@gtcq-cosmo-dip-hadoop-04:34151 2022-07-14 15:10:47,499 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService . 2022-07-14 15:10:47,535 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.bind-port' 2022-07-14 15:10:47,537 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-45e96d13-2a66-48fb-b8fc-340f35c4d8c2/flink-web-upload does not exist. 2022-07-14 15:10:47,537 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-45e96d13-2a66-48fb-b8fc-340f35c4d8c2/flink-web-upload for file uploads. 2022-07-14 15:10:47,550 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint. 2022-07-14 15:10:47,769 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /data/hadoop/yarn/logs/application_1657291086243_0014/container_e88_1657291086243_0014_01_000001/jobmanager.log 2022-07-14 15:10:47,770 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /data/hadoop/yarn/logs/application_1657291086243_0014/container_e88_1657291086243_0014_01_000001/jobmanager.out 2022-07-14 15:10:47,899 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at gtcq-cosmo-dip-hadoop-04:28418 2022-07-14 15:10:47,900 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://gtcq-cosmo-dip-hadoop-04:28418 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000 2022-07-14 15:10:47,901 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://gtcq-cosmo-dip-hadoop-04:28418. 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 2048mb 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.jobgraph-path, job.graph 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: classloader.check-leaked-classloader, false 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1657291086243_0014 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-per-job 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1024mb 2022-07-14 15:10:47,941 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, file:/opt/flink-1.13.3/examples/streaming/WordCount.jar 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2022-07-14 15:10:47,942 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /data/hadoop/yarn/local/usercache/root/appcache/application_1657291086243_0014/container_e88_1657291086243_0014_01_000001/flink-conf.yaml:17: "pipeline.classpaths: " 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.application.name, test_wordcount 2022-07-14 15:10:47,942 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.deployment.config-dir, /opt/flink-1.13.3/conf 2022-07-14 15:10:47,943 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /opt/flink-1.13.3/conf/log4j.properties 2022-07-14 15:10:47,979 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_0 . 2022-07-14 15:10:48,039 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess. 2022-07-14 15:10:48,042 INFO org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcess [] - Start JobDispatcherLeaderProcess. 2022-07-14 15:10:48,048 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.MiniDispatcher at akka://flink/user/rpc/dispatcher_1 . 2022-07-14 15:10:48,056 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Starting the resource manager. 2022-07-14 15:10:48,088 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 . 2022-07-14 15:10:48,095 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job Streaming WordCount (f7cc0964071502a77a909b67daf942be). 2022-07-14 15:10:48,109 INFO org.apache.hadoop.yarn.client.RMProxy [] - Connecting to ResourceManager at /0.0.0.0:8030 2022-07-14 15:10:48,124 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for Streaming WordCount (f7cc0964071502a77a909b67daf942be). 2022-07-14 15:10:48,161 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Streaming WordCount (f7cc0964071502a77a909b67daf942be). 2022-07-14 15:10:48,161 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2022-07-14 15:10:48,179 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 pipelined regions in 2 ms 2022-07-14 15:10:48,193 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2046c6e8 2022-07-14 15:10:48,194 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Checkpoint storage is set to 'jobmanager' 2022-07-14 15:10:48,210 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2022-07-14 15:10:48,215 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@4087827a for Streaming WordCount (f7cc0964071502a77a909b67daf942be). 2022-07-14 15:10:48,230 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job Streaming WordCount (f7cc0964071502a77a909b67daf942be) under job master id 00000000000000000000000000000000. 2022-07-14 15:10:48,232 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 2022-07-14 15:10:48,232 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Streaming WordCount (f7cc0964071502a77a909b67daf942be) switched from state CREATED to RUNNING. 2022-07-14 15:10:48,235 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: Collection Source -> Flat Map (1/1) (7b3c3ef1ed0826d24598fd4f71e1626f) switched from CREATED to SCHEDULED. 2022-07-14 15:10:48,236 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1) (5f2f5f3dda9f785d1a3d9e75123f9430) switched from CREATED to SCHEDULED. 2022-07-14 15:10:48,252 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/resourcemanager_*(00000000000000000000000000000000) 2022-07-14 15:10:49,251 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:50,251 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:51,252 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:52,254 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:53,254 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:54,255 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:55,256 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:56,257 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:57,258 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:58,258 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:10:58,266 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Could not resolve ResourceManager address akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/resourcemanager_*. 2022-07-14 15:10:59,266 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:00,266 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:01,267 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:02,268 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:03,269 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:04,269 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:05,270 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:06,271 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:07,272 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:08,273 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:08,274 INFO org.apache.hadoop.io.retry.RetryInvocationHandler [] - java.net.ConnectException: Your endpoint configuration is wrong; For more details see: http://wiki.apache.org/hadoop/UnsetHostnameOrPort, while invoking ApplicationMasterProtocolPBClientImpl.registerApplicationMaster over null after 1 failover attempts. Trying to failover after sleeping for 31786ms. 2022-07-14 15:11:18,306 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Could not resolve ResourceManager address akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/resourcemanager_*. 2022-07-14 15:11:38,346 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Could not resolve ResourceManager address akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/resourcemanager_*. 2022-07-14 15:11:41,061 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:42,062 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:43,063 INFO org.apache.hadoop.ipc.Client [] - Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-07-14 15:11:43,378 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down as requested. 2022-07-14 15:11:43,381 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting YarnJobClusterEntrypoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally.. 2022-07-14 15:11:43,381 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shutting down rest endpoint. 2022-07-14 15:11:43,383 INFO org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB server at 0.0.0.0:22488 2022-07-14 15:11:43,395 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Removing cache directory /tmp/flink-web-45e96d13-2a66-48fb-b8fc-340f35c4d8c2/flink-web-ui 2022-07-14 15:11:43,395 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://gtcq-cosmo-dip-hadoop-04:28418 lost leadership 2022-07-14 15:11:43,395 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Shut down complete. 2022-07-14 15:11:43,395 INFO org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent [] - Closing components. 2022-07-14 15:11:43,396 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was revoked the leadership with leader id 00000000-0000-0000-0000-000000000000. Stopping the DispatcherLeaderProcess. 2022-07-14 15:11:43,396 INFO org.apache.flink.runtime.dispatcher.runner.JobDispatcherLeaderProcess [] - Stopping JobDispatcherLeaderProcess. 2022-07-14 15:11:43,396 INFO org.apache.flink.runtime.dispatcher.MiniDispatcher [] - Stopping dispatcher akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/dispatcher_1. 2022-07-14 15:11:43,396 INFO org.apache.flink.runtime.dispatcher.MiniDispatcher [] - Stopping all currently running jobs of dispatcher akka.tcp://flink@gtcq-cosmo-dip-hadoop-04:26189/user/rpc/dispatcher_1. 2022-07-14 15:11:43,398 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Stopping the JobMaster for job Streaming WordCount(f7cc0964071502a77a909b67daf942be). 2022-07-14 15:11:43,399 INFO org.apache.flink.runtime.dispatcher.MiniDispatcher [] - Job f7cc0964071502a77a909b67daf942be reached terminal state SUSPENDED. 2022-07-14 15:11:43,401 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Streaming WordCount (f7cc0964071502a77a909b67daf942be) switched from state RUNNING to SUSPENDED. org.apache.flink.util.FlinkException: Scheduler is being stopped. at org.apache.flink.runtime.scheduler.SchedulerBase.closeAsync(SchedulerBase.java:607) ~[flink-dist_2.12-1.13.3.jar:1.13.3] at org.apache.flink.runtime.jobmaster.JobMaster.stopScheduling(JobMaster.java:962) ~[flink-dist_2.12-1.13.3.jar:1.13.3] at org.apache.flink.runtime.jobmaster.JobMaster.stopJobExecution(JobMaster.java:926) ~[flink-dist_2.12-1.13.3.jar:1.13.3] at org.apache.flink.runtime.jobmaster.JobMaster.onStop(JobMaster.java:398) ~[flink-dist_2.12-1.13.3.jar:1.13.3] at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStop(RpcEndpoint.java:214) ~[flink-dist_2.12-1.13.3.jar:1.13.3] at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StartedState.terminate(AkkaRpcActor.java:563) ~[flink-dist_2.12-1.13.3.jar:1.13.3] at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:186) ~[flink-dist_2.12-1.13.3.jar:1.13.3] at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) [flink-dist_2.12-1.13.3.jar:1.13.3] at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-dist_2.12-1.13.3.jar:1.13.3] at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) [flink-dist_2.12-1.13.3.jar:1.13.3] at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-dist_2.12-1.13.3.jar:1.13.3] at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.actor.Actor.aroundReceive(Actor.scala:517) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.actor.Actor.aroundReceive$(Actor.scala:515) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.actor.ActorCell.invoke(ActorCell.scala:561) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.dispatch.Mailbox.run(Mailbox.scala:225) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.3.jar:1.13.3] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.3.jar:1.13.3] 2022-07-14 15:11:43,410 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: Collection Source -> Flat Map (1/1) (7b3c3ef1ed0826d24598fd4f71e1626f) switched from SCHEDULED to CANCELING. 2022-07-14 15:11:43,410 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: Collection Source -> Flat Map (1/1) (7b3c3ef1ed0826d24598fd4f71e1626f) switched from CANCELING to CANCELED. 2022-07-14 15:11:43,410 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding the results produced by task execution 7b3c3ef1ed0826d24598fd4f71e1626f. 2022-07-14 15:11:43,411 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1) (5f2f5f3dda9f785d1a3d9e75123f9430) switched from SCHEDULED to CANCELING. 2022-07-14 15:11:43,411 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Keyed Aggregation -> Sink: Print to Std. Out (1/1) (5f2f5f3dda9f785d1a3d9e75123f9430) switched from CANCELING to CANCELED. 2022-07-14 15:11:43,411 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding the results produced by task execution 5f2f5f3dda9f785d1a3d9e75123f9430. 2022-07-14 15:11:43,412 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping checkpoint coordinator for job f7cc0964071502a77a909b67daf942be. 2022-07-14 15:11:43,414 INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore [] - Shutting down 2022-07-14 15:11:43,414 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job f7cc0964071502a77a909b67daf942be has been suspended.