Dmitry Kravchuk created ZEPPELIN-6154:
-----------------------------------------
Summary: Flink interpreter can't connect to ResourceManager using
yarn-application execution mode
Key: ZEPPELIN-6154
URL: https://issues.apache.org/jira/browse/ZEPPELIN-6154
Project: Zeppelin
Issue Type: Bug
Components: flink, zeppelin-interpreter
Affects Versions: 0.11.0
Environment: * Flink 1.17.2
* Zeppelin 0.11.0
Reporter: Dmitry Kravchuk
Fix For: 0.12.0
Hello there.
Have anybody been face problem with flink interpreter in yarn-appicaiton
execution mode? Any session from zeppelin can't connect to ResourceManager and
first using correct hostname address but then switching to 0.0.0.0.
There are flink interpreter settings and logs yarn [^Zeppelin Flink App
logs.txt]
!image-2024-11-27-14-24-50-445.png!
{code:shell}
2024-11-27 14:02:48,811 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2024-11-27 14:02:48,815 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
YarnApplicationClusterEntryPoint (Version: 1.17.2, Scala: 2.12, Rev:c0027e5,
Date:2023-11-09T13:24:38+01:00)
2024-11-27 14:02:48,815 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current
user: yarn
2024-11-27 14:02:48,977 WARN org.apache.hadoop.util.NativeCodeLoader
[] - Unable to load native-hadoop library for your platform... using
builtin-java classes where applicable
2024-11-27 14:02:49,002 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current
Hadoop/Kerberos user: zeppelin
2024-11-27 14:02:49,002 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK
64-Bit Server VM - Red Hat, Inc. - 1.8/25.402-b06
2024-11-27 14:02:49,002 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Arch: amd64
2024-11-27 14:02:49,003 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap
size: 1399 MiBytes
2024-11-27 14:02:49,003 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME:
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.402.b06-1.el7_9.x86_64
2024-11-27 14:02:49,004 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop
version: 3.3.6
2024-11-27 14:02:49,006 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xmx1530082096
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xms1530082096
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:MaxMetaspaceSize=268435456
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog.file=/var/log/hadoop-yarn/userlogs/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/jobmanager.log
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configuration=file:log4j.properties
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configurationFile=file:log4j.properties
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program
Arguments:
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.off-heap.size=134217728b
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.min=214748368b
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2024-11-27 14:02:49,007 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-metaspace.size=268435456b
2024-11-27 14:02:49,008 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2024-11-27 14:02:49,008 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.heap.size=1530082096b
2024-11-27 14:02:49,008 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2024-11-27 14:02:49,008 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.max=214748368b
2024-11-27 14:02:49,008 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath:
:lib/flink-cep-1.17.2.jar:lib/flink-connector-files-1.17.2.jar:lib/flink-csv-1.17.2.jar:lib/flink-json-1.17.2.jar:lib/flink-python-1.17.2.jar:lib/flink-scala_2.12-1.17.2.jar:lib/flink-sql-client-1.17.2.jar:lib/flink-table-api-java-uber-1.17.2.jar:lib/flink-table-api-scala-bridge_2.12-1.17.2.jar:lib/flink-table-api-scala_2.12-1.17.2.jar:lib/flink-table-planner-loader-1.17.2.jar:lib/flink-table-runtime-1.17.2.jar:lib/log4j-1.2-api-2.17.1.jar:lib/log4j-api-2.17.1.jar:lib/log4j-core-2.17.1.jar:lib/log4j-slf4j-impl-2.17.1.jar:zeppelin-flink-0.11.0-2.12.jar:flink-dist-1.17.2.jar:flink-conf.yaml::/etc/hadoop/conf/*:/usr/lib/hadoop/hadoop-annotations.jar:/usr/lib/hadoop/hadoop-auth.jar:/usr/lib/hadoop/hadoop-common.jar:/usr/lib/hadoop/hadoop-kms.jar:/usr/lib/hadoop/hadoop-nfs.jar:/usr/lib/hadoop/hadoop-annotations-3.3.6.jar:/usr/lib/hadoop/hadoop-auth-3.3.6.jar:/usr/lib/hadoop/hadoop-common-3.3.6-tests.jar:/usr/lib/hadoop/hadoop-common-3.3.6.jar:/usr/lib/hadoop/hadoop-kms-3.3.6.jar:/usr/lib/hadoop/hadoop-nfs-3.3.6.jar:/usr/lib/hadoop/hadoop-registry-3.3.6.jar:/usr/lib/hadoop/hadoop-registry.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop/lib/hadoop-annotations-3.3.6.jar:/usr/lib/hadoop/lib/stax2-api.jar:/usr/lib/hadoop/lib/curator-client-5.4.0.jar:/usr/lib/hadoop/lib/token-provider-1.0.1.jar:/usr/lib/hadoop/lib/avro-1.7.7.jar:/usr/lib/hadoop/lib/audience-annotations-0.12.0.jar:/usr/lib/hadoop/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-aarch_64.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/curator-framework-5.4.0.jar:/usr/lib/hadoop/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop/lib/ranger-plugin-classloader.jar:/usr/lib/hadoop/lib/commons-codec-1.15.jar:/usr/lib/hadoop/lib/curator-recipes-5.4.0.jar:/usr/lib/hadoop/lib/woodstox-core.jar:/usr/lib/hadoop/lib/jersey-servlet-1.19.4.jar:/usr/lib/hadoop/lib/jsr311-api-1.1.1.jar:/usr/lib/hadoop/lib/ranger-yarn-plugin-shim.jar:/usr/lib/hadoop/lib/commons-configuration2-2.8.0.jar:/usr/lib/hadoop/lib/hadoop-auth-3.3.6.jar:/usr/lib/hadoop/lib/kerb-server-1.0.1.jar:/usr/lib/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/lib/hadoop/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop/lib/jettison-1.5.4.jar:/usr/lib/hadoop/lib/kerby-config-1.0.1.jar:/usr/lib/hadoop/lib/failureaccess-1.0.1.jar:/usr/lib/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/lib/hadoop/lib/reload4j-1.2.22.jar:/usr/lib/hadoop/lib/commons-lang3-3.12.0.jar:/usr/lib/hadoop/lib/hadoop-shaded-guava-1.1.1.jar:/usr/lib/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/lib/hadoop/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/usr/lib/hadoop/lib/commons-beanutils-1.9.4.jar:/usr/lib/hadoop/lib/j2objc-annotations-2.8.jar:/usr/lib/hadoop/lib/commons-net-3.9.0.jar:/usr/lib/hadoop/lib/jackson-annotations-2.12.7.jar:/usr/lib/hadoop/lib/kerby-util-1.0.1.jar:/usr/lib/hadoop/lib/guava-32.0.1-jre.jar:/usr/lib/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop/lib/commons-logging-1.2.jar:/usr/lib/hadoop/lib/jackson-core-2.12.7.jar:/usr/lib/hadoop/lib/metrics-core-3.2.4.jar:/usr/lib/hadoop/lib/kerb-identity-1.0.1.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/lib/hadoop/lib/jackson-databind-2.12.7.1.jar:/usr/lib/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/lib/hadoop/lib/commons-io-2.8.0.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.11.jar:/usr/lib/hadoop/lib/jakarta.activation-api-1.2.1.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/lib/hadoop/lib/re2j-1.1.jar:/usr/lib/hadoop/lib/jersey-core-1.19.4.jar:/usr/lib/hadoop/lib/jersey-json-1.20.jar:/usr/lib/hadoop/lib/commons-compress-1.21.jar:/usr/lib/hadoop/lib/checker-qual-3.33.0.jar:/usr/lib/hadoop/lib/commons-text-1.10.0.jar:/usr/lib/hadoop/lib/kerb-admin-1.0.1.jar:/usr/lib/hadoop/lib/kerb-client-1.0.1.jar:/usr/lib/hadoop/lib/jersey-server-1.19.4.jar:/usr/lib/hadoop/lib/kerb-common-1.0.1.jar:/usr/lib/hadoop/lib/kerb-core-1.0.1.jar:/usr/lib/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/lib/hadoop/lib/kerb-util-1.0.1.jar:/usr/lib/hadoop/lib/dnsjava-2.1.7.jar:/usr/lib/hadoop/lib/netty-codec-mqtt-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-transport-4.1.89.Final.jar:/usr/lib/hadoop/lib/gson-2.9.0.jar:/usr/lib/hadoop/lib/netty-transport-udt-4.1.89.Final.jar:/usr/lib/hadoop/lib/httpclient-4.5.13.jar:/usr/lib/hadoop/lib/httpcore-4.4.13.jar:/usr/lib/hadoop/lib/slf4j-reload4j-1.7.36.jar:/usr/lib/hadoop/lib/netty-codec-redis-4.1.89.Final.jar:/usr/lib/hadoop/lib/slf4j-api-1.7.36.jar:/usr/lib/hadoop/lib/netty-codec-smtp-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-socks-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-stomp-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-xml-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-common-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-handler-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-handler-proxy-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-handler-ssl-ocsp-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-memcache-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-resolver-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-resolver-dns-4.1.89.Final.jar:/usr/lib/hadoop/lib/jsch-0.1.55.jar:/usr/lib/hadoop/lib/snappy-java-1.1.8.2.jar:/usr/lib/hadoop/lib/jsr305-3.0.2.jar:/usr/lib/hadoop/lib/zookeeper-jute-3.8.4.jar:/usr/lib/hadoop/lib/netty-codec-http-4.1.89.Final.jar:/usr/lib/hadoop/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/usr/lib/hadoop/lib/woodstox-core-5.4.0.jar:/usr/lib/hadoop/lib/zookeeper-3.8.4.jar:/usr/lib/hadoop/lib/nimbus-jose-jwt-9.8.1.jar:/usr/lib/hadoop/lib/netty-transport-rxtx-4.1.89.Final.jar:/usr/lib/hadoop/lib/stax2-api-4.2.1.jar:/usr/lib/hadoop/lib/jetty-http-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-io-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-security-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-server-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-servlet-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-util-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-util-ajax-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-webapp-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jetty-xml-9.4.51.v20230217.jar:/usr/lib/hadoop/lib/jul-to-slf4j-1.7.36.jar:/usr/lib/hadoop/lib/netty-all-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-buffer-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-dns-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-haproxy-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-codec-http2-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-resolver-dns-classes-macos-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-x86_64.jar:/usr/lib/hadoop/lib/netty-transport-classes-epoll-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-transport-classes-kqueue-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-transport-native-epoll-4.1.89.Final-linux-aarch_64.jar:/usr/lib/hadoop/lib/netty-transport-native-epoll-4.1.89.Final-linux-x86_64.jar:/usr/lib/hadoop/lib/netty-transport-native-epoll-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-transport-native-kqueue-4.1.89.Final-osx-aarch_64.jar:/usr/lib/hadoop/lib/netty-transport-native-kqueue-4.1.89.Final-osx-x86_64.jar:/usr/lib/hadoop/lib/netty-transport-native-unix-common-4.1.89.Final.jar:/usr/lib/hadoop/lib/netty-transport-sctp-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-rbf-3.3.6-tests.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-rbf-3.3.6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-client.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-httpfs.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-nfs.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-rbf.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-3.3.6-tests.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-3.3.6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-client-3.3.6-tests.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-client-3.3.6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-httpfs-3.3.6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client-3.3.6-tests.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-native-client-3.3.6.jar:/usr/lib/hadoop-hdfs/hadoop-hdfs-nfs-3.3.6.jar:/usr/lib/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.15.jar:/usr/lib/hadoop-hdfs/lib/j2objc-annotations-2.8.jar:/usr/lib/hadoop-hdfs/lib/curator-recipes-5.4.0.jar:/usr/lib/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/lib/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/commons-configuration2-2.8.0.jar:/usr/lib/hadoop-hdfs/lib/jettison-1.5.4.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/failureaccess-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/lib/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/audience-annotations-0.12.0.jar:/usr/lib/hadoop-hdfs/lib/guava-32.0.1-jre.jar:/usr/lib/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/lib/hadoop-hdfs/lib/commons-net-3.9.0.jar:/usr/lib/hadoop-hdfs/lib/okhttp-4.9.3.jar:/usr/lib/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/kotlin-stdlib-1.4.10.jar:/usr/lib/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/jackson-annotations-2.12.7.jar:/usr/lib/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/lib/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/hadoop-annotations-3.3.6.jar:/usr/lib/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/okio-2.8.0.jar:/usr/lib/hadoop-hdfs/lib/commons-beanutils-1.9.4.jar:/usr/lib/hadoop-hdfs/lib/commons-lang3-3.12.0.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-2.12.7.jar:/usr/lib/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/jackson-databind-2.12.7.1.jar:/usr/lib/hadoop-hdfs/lib/commons-compress-1.21.jar:/usr/lib/hadoop-hdfs/lib/reload4j-1.2.22.jar:/usr/lib/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/curator-client-5.4.0.jar:/usr/lib/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/hadoop-auth-3.3.6.jar:/usr/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/lib/hadoop-hdfs/lib/HikariCP-java7-2.4.12.jar:/usr/lib/hadoop-hdfs/lib/jersey-json-1.20.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.19.4.jar:/usr/lib/hadoop-hdfs/lib/hadoop-shaded-guava-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/lib/hadoop-hdfs/lib/jakarta.activation-api-1.2.1.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.19.4.jar:/usr/lib/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.8.0.jar:/usr/lib/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/lib/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/lib/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/lib/hadoop-hdfs/lib/re2j-1.1.jar:/usr/lib/hadoop-hdfs/lib/jersey-servlet-1.19.4.jar:/usr/lib/hadoop-hdfs/lib/checker-qual-3.33.0.jar:/usr/lib/hadoop-hdfs/lib/curator-framework-5.4.0.jar:/usr/lib/hadoop-hdfs/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/commons-text-1.10.0.jar:/usr/lib/hadoop-hdfs/lib/zookeeper-3.8.4.jar:/usr/lib/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.2.jar:/usr/lib/hadoop-hdfs/lib/jetty-http-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/dnsjava-2.1.7.jar:/usr/lib/hadoop-hdfs/lib/gson-2.9.0.jar:/usr/lib/hadoop-hdfs/lib/httpclient-4.5.13.jar:/usr/lib/hadoop-hdfs/lib/httpcore-4.4.13.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-smtp-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-socks-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jsch-0.1.55.jar:/usr/lib/hadoop-hdfs/lib/zookeeper-jute-3.8.4.jar:/usr/lib/hadoop-hdfs/lib/jsr305-3.0.2.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-memcache-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/usr/lib/hadoop-hdfs/lib/netty-3.10.6.Final.jar:/usr/lib/hadoop-hdfs/lib/nimbus-jose-jwt-9.8.1.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-stomp-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/stax2-api-4.2.1.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-xml-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-io-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-common-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-security-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-handler-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-server-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-handler-proxy-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-servlet-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-handler-ssl-ocsp-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-resolver-dns-classes-macos-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-ajax-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-resolver-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-webapp-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-resolver-dns-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/jetty-xml-9.4.51.v20230217.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-sctp-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/kotlin-stdlib-common-1.4.10.jar:/usr/lib/hadoop-hdfs/lib/metrics-core-3.2.4.jar:/usr/lib/hadoop-hdfs/lib/netty-all-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-buffer-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-rxtx-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-udt-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-dns-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-redis-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-haproxy-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-http-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/snappy-java-1.1.8.2.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-http2-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/woodstox-core-5.4.0.jar:/usr/lib/hadoop-hdfs/lib/netty-codec-mqtt-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-aarch_64.jar:/usr/lib/hadoop-hdfs/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-x86_64.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-classes-epoll-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-classes-kqueue-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-native-epoll-4.1.89.Final-linux-aarch_64.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-native-epoll-4.1.89.Final-linux-x86_64.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-native-epoll-4.1.89.Final.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-native-kqueue-4.1.89.Final-osx-aarch_64.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-native-kqueue-4.1.89.Final-osx-x86_64.jar:/usr/lib/hadoop-hdfs/lib/netty-transport-native-unix-common-4.1.89.Final.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-mawo-core.jar:/usr/lib/hadoop-yarn/hadoop-yarn-api.jar:/usr/lib/hadoop-yarn/hadoop-yarn-services-core.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-router-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-sharedcachemanager-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-tests-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-client.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-common.jar:/usr/lib/hadoop-yarn/hadoop-yarn-registry-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-registry.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-mawo-core-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-common.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-nodemanager.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-common-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-router.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-sharedcachemanager.jar:/usr/lib/hadoop-yarn/hadoop-yarn-api-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-client-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-services-api-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-tests.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-timeline-pluginstorage.jar:/usr/lib/hadoop-yarn/hadoop-yarn-common-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-web-proxy.jar:/usr/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-3.3.6.jar:/usr/lib/hadoop-yarn/hadoop-yarn-services-api.jar:/usr/lib/hadoop-yarn/hadoop-yarn-services-core-3.3.6.jar:/usr/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/lib/hadoop-yarn/lib/jetty-client-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/jna-5.2.0.jar:/usr/lib/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/lib/hadoop-yarn/lib/fst-2.50.jar:/usr/lib/hadoop-yarn/lib/objenesis-2.6.jar:/usr/lib/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/lib/hadoop-yarn/lib/guice-4.0.jar:/usr/lib/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/lib/hadoop-yarn/lib/javax.websocket-api-1.0.jar:/usr/lib/hadoop-yarn/lib/jersey-client-1.19.4.jar:/usr/lib/hadoop-yarn/lib/snakeyaml-2.0.jar:/usr/lib/hadoop-yarn/lib/jetty-annotations-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/jetty-plus-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/lib/hadoop-yarn/lib/javax.inject-1.jar:/usr/lib/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/lib/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/lib/hadoop-yarn/lib/jline-3.9.0.jar:/usr/lib/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/lib/hadoop-yarn/lib/websocket-api-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/jakarta.xml.bind-api-2.3.2.jar:/usr/lib/hadoop-yarn/lib/asm-commons-9.4.jar:/usr/lib/hadoop-yarn/lib/asm-tree-9.4.jar:/usr/lib/hadoop-yarn/lib/bcpkix-jdk15on-1.68.jar:/usr/lib/hadoop-yarn/lib/bcprov-jdk15on-1.68.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-base-2.12.7.jar:/usr/lib/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.12.7.jar:/usr/lib/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.12.7.jar:/usr/lib/hadoop-yarn/lib/websocket-servlet-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/javax-websocket-client-impl-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/javax-websocket-server-impl-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/javax.websocket-client-api-1.0.jar:/usr/lib/hadoop-yarn/lib/jersey-guice-1.19.4.jar:/usr/lib/hadoop-yarn/lib/jetty-jndi-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/websocket-client-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/websocket-common-9.4.51.v20230217.jar:/usr/lib/hadoop-yarn/lib/websocket-server-9.4.51.v20230217.jar:/usr/lib/hadoop-mapreduce/hadoop-streaming.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar:/usr/lib/hadoop-mapreduce/azure-storage-7.0.1.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-3.3.6.jar:/usr/lib/hadoop-mapreduce/azure-keyvault-core-1.0.0.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-distcp-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-minicluster-3.3.6.jar:/usr/lib/hadoop-mapreduce/aliyun-sdk-oss-3.13.0.jar:/usr/lib/hadoop-mapreduce/hadoop-aliyun.jar:/usr/lib/hadoop-mapreduce/hadoop-aliyun-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-client-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-archive-logs.jar:/usr/lib/hadoop-mapreduce/hadoop-dynamometer-blockgen-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-archives.jar:/usr/lib/hadoop-mapreduce/hadoop-fs2img-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-rumen-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-aws.jar:/usr/lib/hadoop-mapreduce/hadoop-dynamometer-blockgen.jar:/usr/lib/hadoop-mapreduce/hadoop-sls-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-resourceestimator.jar:/usr/lib/hadoop-mapreduce/hadoop-client.jar:/usr/lib/hadoop-mapreduce/hadoop-gridmix-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-streaming-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-azure-datalake.jar:/usr/lib/hadoop-mapreduce/hadoop-azure.jar:/usr/lib/hadoop-mapreduce/hadoop-dynamometer-infra-3.3.6.jar:/usr/lib/hadoop-mapreduce/hamcrest-core-1.3.jar:/usr/lib/hadoop-mapreduce/hadoop-datajoin.jar:/usr/lib/hadoop-mapreduce/hadoop-dynamometer-infra.jar:/usr/lib/hadoop-mapreduce/wildfly-openssl-1.1.3.Final.jar:/usr/lib/hadoop-mapreduce/hadoop-distcp.jar:/usr/lib/hadoop-mapreduce/hadoop-dynamometer-workload-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-extras.jar:/usr/lib/hadoop-mapreduce/ojalgo-43.0.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-nativetask-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-fs2img.jar:/usr/lib/hadoop-mapreduce/aliyun-java-sdk-core-4.5.10.jar:/usr/lib/hadoop-mapreduce/jdk.tools-1.8.jar:/usr/lib/hadoop-mapreduce/hadoop-gridmix.jar:/usr/lib/hadoop-mapreduce/aliyun-java-sdk-kms-2.11.0.jar:/usr/lib/hadoop-mapreduce/junit-4.13.2.jar:/usr/lib/hadoop-mapreduce/hadoop-kafka.jar:/usr/lib/hadoop-mapreduce/hadoop-minicluster.jar:/usr/lib/hadoop-mapreduce/hadoop-aws-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-datajoin-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-app.jar:/usr/lib/hadoop-mapreduce/hadoop-azure-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-kafka-3.3.6.jar:/usr/lib/hadoop-mapreduce/kafka-clients-2.8.2.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-common.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar:/usr/lib/hadoop-mapreduce/hadoop-azure-datalake-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-3.3.6.jar:/usr/lib/hadoop-mapreduce/aws-java-sdk-bundle-1.12.367.jar:/usr/lib/hadoop-mapreduce/hadoop-archive-logs-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-dynamometer-workload.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-uploader.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins.jar:/usr/lib/hadoop-mapreduce/hadoop-sls.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-nativetask.jar:/usr/lib/hadoop-mapreduce/azure-data-lake-store-sdk-2.3.9.jar:/usr/lib/hadoop-mapreduce/hadoop-archives-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-extras-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-resourceestimator-3.3.6.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar:/usr/lib/hadoop-mapreduce/hadoop-rumen.jar:/usr/lib/hadoop-mapreduce/aliyun-java-sdk-ram-3.1.0.jar:/usr/lib/hadoop-mapreduce/ini4j-0.5.4.jar:/usr/lib/hadoop-mapreduce/jdom2-2.0.6.jar:/usr/lib/hadoop-mapreduce/lz4-java-1.7.1.jar:/usr/lib/hadoop-mapreduce/opentracing-api-0.33.0.jar:/usr/lib/hadoop-mapreduce/opentracing-noop-0.33.0.jar:/usr/lib/hadoop-mapreduce/opentracing-util-0.33.0.jar:/usr/lib/hadoop-mapreduce/org.jacoco.agent-0.8.5-runtime.jar:/usr/lib/hadoop-mapreduce/zstd-jni-1.4.9-1.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-3.3.6-tests.jar:/usr/lib/hadoop-mapreduce/hadoop-mapreduce-client-uploader-3.3.6.jar:/usr/lib/hadoop-mapreduce/lib/*
2024-11-27 14:02:49,008 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2024-11-27 14:02:49,009 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered
UNIX signal handlers for [TERM, HUP, INT]
2024-11-27 14:02:49,012 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - YARN daemon
is running as: zeppelin Yarn client user obtainer: zeppelin
2024-11-27 14:02:49,019 WARN
org.apache.flink.configuration.GlobalConfiguration [] - Error while
trying to split key and value in configuration file
/hadoop/hdfs/data07/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/flink-conf.yaml:11:
Line is not a key-value pair (missing space after ':'?)
2024-11-27 14:02:49,021 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.threads.max, 500
2024-11-27 14:02:49,021 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.cluster-id, default
2024-11-27 14:02:49,021 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.endpoint.rest.port, 8083
2024-11-27 14:02:49,021 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-metaspace.size, 256m
2024-11-27 14:02:49,021 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.task.off-heap.size, 256m
2024-11-27 14:02:49,021 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.hive.version, 3.1.3
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.zookeeper.path.root, /flink
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.scheduler.address,
host03master1.corp.company.com:8030
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.printREPLOutput, true
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 1
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.threads.min, 5
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zookeeper.sasl.disable, True
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.concurrentStreamSql.max, 10
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.keystore-password, ******
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.dir,
hdfs:///flink/completed-jobs/
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.heap.size, 2048m
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.max-num, 1000000
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 2048m
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.run.asLoginUser, true
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.connection.poolsize, 100
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.module.enableHive, false
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.refresh-interval, 10000
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.uiWebUrl, http://host03master2:8083
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.idle-timeout, 10 min
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.address,
host03master1.corp.company.com:8032
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: logging_level, INFO
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: local.number-taskmanager, 1
2024-11-27 14:02:49,022 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.check-interval, 1 min
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.execution.mode, yarn-application
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.deployment.config-dir, /opt/flink-1.17.2/conf
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.yarn.log-config-file,
/opt/flink-1.17.2/conf/log4j.properties
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.address, host03master2
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.port, 8084
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.job.check_interval, 1000
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.cpu.cores, 1
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.interpreter.close.shutdown_cluster, true
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.scala.color, true
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.network.bind-policy, name
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.kerberos.login.use-ticket-cache, False
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-overhead.min, 256m
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.output.limit, 102400
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.framework.off-heap.size, 256m
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint.ignore-unclaimed-state, false
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.enableHive, false
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.application.program-args,
10.9.14.168;13719;flink-shared_process;:
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.task.heap.size, 256m
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 2
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.truststore-password, ******
2024-11-27 14:02:49,023 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-overhead.max, 256m
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.concurrentBatchSql.max, 10
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.key-password, ******
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.hostname,
host03master1.corp.company.com
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.application.main,
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.archive.fs.dir, hdfs:///flink/completed-jobs/
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.close.cancel_job, true
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.truststore,
/etc/pki/java/adh/truststore.jks
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint-restore-mode, NO_CLAIM
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.keystore,
/etc/pki/java/adh/keystore.jks
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.network.min, 256m
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: FLINK_HOME, /opt/flink-1.17.2
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.protocol, TLSv1.2
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.target, yarn-application
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.containers.vcores, 1
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.pyflink.python, python3
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.enabled, False
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.maxResult, 10000
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.network.max, 256m
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.attached, true
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: internal.cluster.execution-mode, NORMAL
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.application.classpath,
/etc/hadoop/conf/*:/usr/lib/hadoop/*:/usr/lib/hadoop/lib/*:/usr/lib/hadoop-hdfs/*:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-yarn/*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-mapreduce/*:/usr/lib/hadoop-mapreduce/lib/*
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability, NONE
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.framework.heap.size, 256m
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.managed.size, 256m
2024-11-27 14:02:49,024 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.shutdown-on-attached-exit, false
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: pipeline.jars,
file:/opt/zeppelin-0.11.0/interpreter/flink/zeppelin-flink-0.11.0-2.12.jar
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.keepalive-time, 5 min
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.localRepo,
/opt/zeppelin-0.11.0/local-repo/flink
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.heap.size, 2048m
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
dynamic configuration property: jobmanager.memory.off-heap.size, 134217728b
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
dynamic configuration property: jobmanager.memory.jvm-overhead.min, 214748368b
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
dynamic configuration property: jobmanager.memory.jvm-metaspace.size, 268435456b
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
dynamic configuration property: jobmanager.memory.heap.size, 1530082096b
2024-11-27 14:02:49,025 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
dynamic configuration property: jobmanager.memory.jvm-overhead.max, 214748368b
2024-11-27 14:02:49,041 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key 'web.port' instead of
proper key 'rest.bind-port'
2024-11-27 14:02:49,050 INFO
org.apache.flink.runtime.clusterframework.BootstrapTools [] - Setting
directories for temporary files to:
/hadoop/hdfs/data01/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data02/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data03/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data04/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data05/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data06/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data07/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data08/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data09/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data10/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data11/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024,/hadoop/hdfs/data12/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024
2024-11-27 14:02:49,137 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
YarnApplicationClusterEntryPoint.
2024-11-27 14:02:49,148 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
default filesystem.
2024-11-27 14:02:49,229 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it: metrics-slf4j
2024-11-27 14:02:49,231 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it: metrics-statsd
2024-11-27 14:02:49,231 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it: metrics-prometheus
2024-11-27 14:02:49,231 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it:
external-resource-gpu
2024-11-27 14:02:49,231 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it: metrics-graphite
2024-11-27 14:02:49,231 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it: metrics-datadog
2024-11-27 14:02:49,231 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it: metrics-jmx
2024-11-27 14:02:49,231 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID not found, creating it: metrics-influx
2024-11-27 14:02:49,246 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
security context.
2024-11-27 14:02:49,273 INFO
org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user
set to zeppelin (auth:SIMPLE)
2024-11-27 14:02:49,274 INFO
org.apache.flink.runtime.security.modules.HadoopModule [] - Kerberos
security is disabled.
2024-11-27 14:02:49,277 INFO
org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file
will be created as
/hadoop/hdfs/data01/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/jaas-953405284671129976.conf.
2024-11-27 14:02:49,282 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing
cluster services.
2024-11-27 14:02:49,288 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Using working
directory:
WorkingDirectory(/hadoop/hdfs/data08/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/jm_2b3c1911ad8b0ea08e137c9d62ecece1).
2024-11-27 14:02:49,477 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address host03node3.corp.company.com:0, bind
address 0.0.0.0:0.
2024-11-27 14:02:50,040 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2024-11-27 14:02:50,067 INFO akka.remote.RemoteActorRefProvider
[] - Akka Cluster not in use - enabling unsafe features anyway
because `akka.remote.use-unsafe-remote-features-outside-cluster` has been
enabled.
2024-11-27 14:02:50,067 INFO akka.remote.Remoting
[] - Starting remoting
2024-11-27 14:02:50,271 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://[email protected]:34737]
2024-11-27 14:02:50,389 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://[email protected]:34737
2024-11-27 14:02:50,404 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Loading delegation token providers
2024-11-27 14:02:50,406 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Delegation token provider hadoopfs loaded and initialized
2024-11-27 14:02:50,408 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Delegation token provider hbase loaded and initialized
2024-11-27 14:02:50,408 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-slf4j
2024-11-27 14:02:50,409 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-statsd
2024-11-27 14:02:50,409 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-prometheus
2024-11-27 14:02:50,409 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: external-resource-gpu
2024-11-27 14:02:50,409 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-graphite
2024-11-27 14:02:50,409 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-datadog
2024-11-27 14:02:50,409 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-jmx
2024-11-27 14:02:50,409 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-influx
2024-11-27 14:02:50,409 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Delegation token providers loaded successfully
2024-11-27 14:02:50,409 INFO
org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] -
Loading delegation token receivers
2024-11-27 14:02:50,410 INFO
org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] -
Delegation token receiver hadoopfs loaded and initialized
2024-11-27 14:02:50,411 INFO
org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] -
Delegation token receiver hbase loaded and initialized
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-slf4j
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-statsd
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-prometheus
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: external-resource-gpu
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-graphite
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-datadog
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-jmx
2024-11-27 14:02:50,411 INFO org.apache.flink.core.plugin.DefaultPluginManager
[] - Plugin loader with ID found, reusing it: metrics-influx
2024-11-27 14:02:50,411 INFO
org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] -
Delegation token receivers loaded successfully
2024-11-27 14:02:50,411 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Checking provider and receiver instances consistency
2024-11-27 14:02:50,411 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Provider and receiver instances are consistent
2024-11-27 14:02:50,411 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Obtaining delegation tokens
2024-11-27 14:02:50,413 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Delegation tokens obtained successfully
2024-11-27 14:02:50,413 WARN
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - No
tokens obtained so skipping notifications
2024-11-27 14:02:50,415 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key 'high-availability'
instead of proper key 'high-availability.type'
2024-11-27 14:02:50,421 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key 'web.port' instead of
proper key 'rest.port'
2024-11-27 14:02:50,428 INFO org.apache.flink.runtime.blob.BlobServer
[] - Created BLOB server storage directory
/hadoop/hdfs/data08/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/jm_2b3c1911ad8b0ea08e137c9d62ecece1/blobStorage
2024-11-27 14:02:50,430 INFO org.apache.flink.runtime.blob.BlobServer
[] - Started BLOB server at 0.0.0.0:24127 - max concurrent requests:
50 - max backlog: 1000
2024-11-27 14:02:50,438 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics
reporter configured, no metrics will be exposed/reported.
2024-11-27 14:02:50,441 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address host03node3.corp.company.com:0, bind
address 0.0.0.0:0.
2024-11-27 14:02:50,453 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2024-11-27 14:02:50,457 INFO akka.remote.RemoteActorRefProvider
[] - Akka Cluster not in use - enabling unsafe features anyway
because `akka.remote.use-unsafe-remote-features-outside-cluster` has been
enabled.
2024-11-27 14:02:50,457 INFO akka.remote.Remoting
[] - Starting remoting
2024-11-27 14:02:50,471 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://[email protected]:28180]
2024-11-27 14:02:50,481 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://[email protected]:28180
2024-11-27 14:02:50,494 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService .
2024-11-27 14:02:50,550 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key 'web.port' instead of
proper key 'rest.bind-port'
2024-11-27 14:02:50,573 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload
directory /tmp/flink-web-1f53644c-2600-44c2-a0ae-66f63fa8e1c0/flink-web-upload
does not exist.
2024-11-27 14:02:50,574 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created
directory /tmp/flink-web-1f53644c-2600-44c2-a0ae-66f63fa8e1c0/flink-web-upload
for file uploads.
2024-11-27 14:02:50,577 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting
rest endpoint.
2024-11-27 14:02:50,795 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component log file:
/var/log/hadoop-yarn/userlogs/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/jobmanager.log
2024-11-27 14:02:50,796 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component stdout file:
/var/log/hadoop-yarn/userlogs/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/jobmanager.out
2024-11-27 14:02:50,918 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest
endpoint listening at 10.9.14.34:15725
2024-11-27 14:02:50,919 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] -
http://10.9.14.34:15725 was granted leadership with
leaderSessionID=00000000-0000-0000-0000-000000000000
2024-11-27 14:02:50,920 INFO
org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend
listening at http://10.9.14.34:15725.
2024-11-27 14:02:50,933 INFO
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived
from fraction network memory (142.222mb (149130811 bytes)) is less than its min
value 256.000mb (268435456 bytes), min value will be used instead
2024-11-27 14:02:50,947 INFO
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] -
DefaultDispatcherRunner was granted leadership with leader id
00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess.
2024-11-27 14:02:50,951 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Start SessionDispatcherLeaderProcess.
2024-11-27 14:02:50,953 INFO
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] -
Starting resource manager service.
2024-11-27 14:02:50,953 INFO
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] -
Resource manager service is granted leadership with session id
00000000-0000-0000-0000-000000000000.
2024-11-27 14:02:50,958 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Recover all persisted job graphs that are not finished, yet.
2024-11-27 14:02:50,958 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Successfully recovered 0 persisted job graphs.
2024-11-27 14:02:50,978 WARN
org.apache.flink.configuration.GlobalConfiguration [] - Error while
trying to split key and value in configuration file
/hadoop/hdfs/data07/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/flink-conf.yaml:11:
Line is not a key-value pair (missing space after ':'?)
2024-11-27 14:02:50,978 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.threads.max, 500
2024-11-27 14:02:50,978 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.cluster-id, default
2024-11-27 14:02:50,978 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.endpoint.rest.port, 8083
2024-11-27 14:02:50,978 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-metaspace.size, 256m
2024-11-27 14:02:50,978 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.task.off-heap.size, 256m
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.hive.version, 3.1.3
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.zookeeper.path.root, /flink
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.scheduler.address,
host03master1.corp.company.com:8030
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.printREPLOutput, true
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 1
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.threads.min, 5
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zookeeper.sasl.disable, True
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.concurrentStreamSql.max, 10
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.keystore-password, ******
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.dir,
hdfs:///flink/completed-jobs/
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.heap.size, 2048m
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.max-num, 1000000
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 2048m
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.run.asLoginUser, true
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.connection.poolsize, 100
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.module.enableHive, false
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.refresh-interval, 10000
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.uiWebUrl, http://host03master2:8083
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.idle-timeout, 10 min
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.address,
host03master1.corp.company.com:8032
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: logging_level, INFO
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: local.number-taskmanager, 1
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.check-interval, 1 min
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.execution.mode, yarn-application
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.deployment.config-dir, /opt/flink-1.17.2/conf
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.yarn.log-config-file,
/opt/flink-1.17.2/conf/log4j.properties
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.address, host03master2
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.port, 8084
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.job.check_interval, 1000
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.cpu.cores, 1
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.interpreter.close.shutdown_cluster, true
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.scala.color, true
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.network.bind-policy, name
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.kerberos.login.use-ticket-cache, False
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-overhead.min, 256m
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.output.limit, 102400
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.framework.off-heap.size, 256m
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint.ignore-unclaimed-state, false
2024-11-27 14:02:50,979 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.enableHive, false
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.application.program-args,
10.9.14.168;13719;flink-shared_process;:
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.task.heap.size, 256m
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 2
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.truststore-password, ******
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-overhead.max, 256m
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.concurrentBatchSql.max, 10
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.key-password, ******
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.hostname,
host03master1.corp.company.com
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.application.main,
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.archive.fs.dir, hdfs:///flink/completed-jobs/
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.close.cancel_job, true
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.truststore,
/etc/pki/java/adh/truststore.jks
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint-restore-mode, NO_CLAIM
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.keystore,
/etc/pki/java/adh/keystore.jks
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.network.min, 256m
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: FLINK_HOME, /opt/flink-1.17.2
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.protocol, TLSv1.2
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.target, yarn-application
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.containers.vcores, 1
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.pyflink.python, python3
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.enabled, False
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.maxResult, 10000
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.network.max, 256m
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.attached, true
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: internal.cluster.execution-mode, NORMAL
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.application.classpath,
/etc/hadoop/conf/*:/usr/lib/hadoop/*:/usr/lib/hadoop/lib/*:/usr/lib/hadoop-hdfs/*:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-yarn/*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-mapreduce/*:/usr/lib/hadoop-mapreduce/lib/*
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability, NONE
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.framework.heap.size, 256m
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.managed.size, 256m
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.shutdown-on-attached-exit, false
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: pipeline.jars,
file:/opt/zeppelin-0.11.0/interpreter/flink/zeppelin-flink-0.11.0-2.12.jar
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.keepalive-time, 5 min
2024-11-27 14:02:50,980 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.localRepo,
/opt/zeppelin-0.11.0/local-repo/flink
2024-11-27 14:02:50,981 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.heap.size, 2048m
2024-11-27 14:02:50,981 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/rpc/dispatcher_0 .
2024-11-27 14:02:51,009 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key 'high-availability'
instead of proper key 'high-availability.type'
2024-11-27 14:02:51,013 INFO org.apache.flink.client.ClientUtils
[] - Starting program (detached: false)
2024-11-27 14:02:51,041 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at
akka://flink/user/rpc/resourcemanager_1 .
2024-11-27 14:02:51,051 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Starting the resource manager.
2024-11-27 14:02:51,069 INFO
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Starting tokens update task
2024-11-27 14:02:51,069 WARN
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - No
tokens obtained so skipping notifications
2024-11-27 14:02:51,069 WARN
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] -
Tokens update task not started because either no tokens obtained or none of the
tokens specified its renewal date
2024-11-27 14:02:51,083 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Launching
ThriftServer at 10.9.14.34:21862
2024-11-27 14:02:51,083 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Start
registration
2024-11-27 14:02:51,097 INFO
org.apache.hadoop.yarn.client.DefaultNoHARMFailoverProxyProvider [] -
Connecting to ResourceManager at host03master1.corp.company.com/10.9.14.167:8030
2024-11-27 14:02:51,106 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Registering
interpreter process
2024-11-27 14:02:51,122 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Registered
interpreter process
2024-11-27 14:02:51,122 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] -
Registration finished
2024-11-27 14:02:51,211 WARN org.apache.zeppelin.conf.ZeppelinConfiguration
[] - Failed to load XML configuration, proceeding with a default,for
a stacktrace activate the debug log
2024-11-27 14:02:51,214 INFO org.apache.zeppelin.conf.ZeppelinConfiguration
[] - Server Host: 127.0.0.1
2024-11-27 14:02:51,214 INFO org.apache.zeppelin.conf.ZeppelinConfiguration
[] - Server Port: 8080
2024-11-27 14:02:51,214 INFO org.apache.zeppelin.conf.ZeppelinConfiguration
[] - Context Path: /
2024-11-27 14:02:51,215 INFO org.apache.zeppelin.conf.ZeppelinConfiguration
[] - Zeppelin Version: 0.11.0
2024-11-27 14:02:51,215 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Creating
interpreter lifecycle manager:
org.apache.zeppelin.interpreter.lifecycle.NullLifecycleManager
2024-11-27 14:02:51,215 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Creating
RemoteInterpreterEventClient with connection pool size: 100
2024-11-27 14:02:51,292 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Instantiate
interpreter org.apache.zeppelin.flink.FlinkInterpreter, isForceShutdown: true
2024-11-27 14:02:51,294 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Instantiate
interpreter org.apache.zeppelin.flink.FlinkBatchSqlInterpreter,
isForceShutdown: true
2024-11-27 14:02:51,294 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Instantiate
interpreter org.apache.zeppelin.flink.FlinkStreamSqlInterpreter,
isForceShutdown: true
2024-11-27 14:02:51,296 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Instantiate
interpreter org.apache.zeppelin.flink.PyFlinkInterpreter, isForceShutdown: true
2024-11-27 14:02:51,299 INFO
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer [] - Instantiate
interpreter org.apache.zeppelin.flink.IPyFlinkInterpreter, isForceShutdown: true
2024-11-27 14:02:51,309 INFO org.apache.flink.yarn.YarnResourceManagerDriver
[] - Recovered 0 containers from previous attempts ([]).
2024-11-27 14:02:51,309 INFO
org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] -
Recovered 0 workers from previous attempt.
2024-11-27 14:02:51,328 INFO org.apache.zeppelin.scheduler.SchedulerFactory
[] - Scheduler Thread Pool Size: 100
2024-11-27 14:02:51,329 INFO org.apache.zeppelin.scheduler.SchedulerFactory
[] - Create FIFOScheduler: interpreter_1554936444
2024-11-27 14:02:51,332 INFO org.apache.zeppelin.scheduler.AbstractScheduler
[] - Job paragraph_1726831445123_1765442765 started by scheduler
interpreter_1554936444
2024-11-27 14:02:51,338 INFO org.apache.hadoop.conf.Configuration
[] - resource-types.xml not found
2024-11-27 14:02:51,338 INFO
org.apache.hadoop.yarn.util.resource.ResourceUtils [] - Unable to
find 'resource-types.xml'.
2024-11-27 14:02:51,375 INFO org.apache.zeppelin.flink.FlinkInterpreter
[] - Using Scala: version 2.12.7
2024-11-27 14:02:51,395 INFO
org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled
external resources: []
2024-11-27 14:02:51,496 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] - Using flink:
1.17.2
2024-11-27 14:02:51,497 INFO org.apache.zeppelin.flink.FlinkShims
[] - Initializing shims for Flink 1.17
2024-11-27 14:02:51,501 INFO
org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl [] - Upper bound
of the thread pool size is 500
2024-11-27 14:02:51,785 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] - FLINK_HOME:
/hadoop/hdfs/data07/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/.
2024-11-27 14:02:51,785 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] -
FLINK_CONF_DIR:
/hadoop/hdfs/data07/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/.
2024-11-27 14:02:51,785 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] -
HADOOP_CONF_DIR: /etc/hadoop/conf
2024-11-27 14:02:51,785 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] -
YARN_CONF_DIR:
2024-11-27 14:02:51,785 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] -
HIVE_CONF_DIR:
/hadoop/hdfs/data07/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/.
2024-11-27 14:02:51,785 WARN
org.apache.flink.configuration.GlobalConfiguration [] - Error while
trying to split key and value in configuration file
/hadoop/hdfs/data07/yarn/hadoop-yarn/nm-local/usercache/zeppelin/appcache/application_1732625148614_0024/container_e45_1732625148614_0024_01_000001/./flink-conf.yaml:11:
Line is not a key-value pair (missing space after ':'?)
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.threads.max, 500
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.cluster-id, default
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.endpoint.rest.port, 8083
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-metaspace.size, 256m
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.task.off-heap.size, 256m
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.hive.version, 3.1.3
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.zookeeper.path.root, /flink
2024-11-27 14:02:51,785 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.scheduler.address,
host03master1.corp.company.com:8030
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.printREPLOutput, true
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 1
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.threads.min, 5
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zookeeper.sasl.disable, True
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.concurrentStreamSql.max, 10
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.keystore-password, ******
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.dir,
hdfs:///flink/completed-jobs/
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.heap.size, 2048m
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.max-num, 1000000
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 2048m
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.run.asLoginUser, true
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.connection.poolsize, 100
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.module.enableHive, false
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.refresh-interval, 10000
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.uiWebUrl, http://host03master2:8083
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.idle-timeout, 10 min
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.address,
host03master1.corp.company.com:8032
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: logging_level, INFO
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: local.number-taskmanager, 1
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.session.check-interval, 1 min
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.execution.mode, yarn-application
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.deployment.config-dir, /opt/flink-1.17.2/conf
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.yarn.log-config-file,
/opt/flink-1.17.2/conf/log4j.properties
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.address, host03master2
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.port, 8084
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.job.check_interval, 1000
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.cpu.cores, 1
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.interpreter.close.shutdown_cluster, true
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.scala.color, true
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.network.bind-policy, name
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.kerberos.login.use-ticket-cache, False
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-overhead.min, 256m
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.output.limit, 102400
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.framework.off-heap.size, 256m
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint.ignore-unclaimed-state, false
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.enableHive, false
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.application.program-args,
10.9.14.168;13719;flink-shared_process;:
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.task.heap.size, 256m
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 2
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.truststore-password, ******
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.jvm-overhead.max, 256m
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.concurrentBatchSql.max, 10
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.key-password, ******
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.resourcemanager.hostname,
host03master1.corp.company.com
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: $internal.application.main,
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.archive.fs.dir, hdfs:///flink/completed-jobs/
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.close.cancel_job, true
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.truststore,
/etc/pki/java/adh/truststore.jks
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.savepoint-restore-mode, NO_CLAIM
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.keystore,
/etc/pki/java/adh/keystore.jks
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.network.min, 256m
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: FLINK_HOME, /opt/flink-1.17.2
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.protocol, TLSv1.2
2024-11-27 14:02:51,786 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.target, yarn-application
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.containers.vcores, 1
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.pyflink.python, python3
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: security.ssl.rest.enabled, False
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.flink.maxResult, 10000
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.network.max, 256m
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.attached, true
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: internal.cluster.execution-mode, NORMAL
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: flink.yarn.application.classpath,
/etc/hadoop/conf/*:/usr/lib/hadoop/*:/usr/lib/hadoop/lib/*:/usr/lib/hadoop-hdfs/*:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-yarn/*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-mapreduce/*:/usr/lib/hadoop-mapreduce/lib/*
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability, NONE
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.framework.heap.size, 256m
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.managed.size, 256m
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: execution.shutdown-on-attached-exit, false
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: pipeline.jars,
file:/opt/zeppelin-0.11.0/interpreter/flink/zeppelin-flink-0.11.0-2.12.jar
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: sql-gateway.worker.keepalive-time, 5 min
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: zeppelin.interpreter.localRepo,
/opt/zeppelin-0.11.0/local-repo/flink
2024-11-27 14:02:51,787 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.heap.size, 2048m
2024-11-27 14:02:51,807 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] - UserJars:
2024-11-27 14:02:51,808 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] - Config:
Config(None,None,Some([Ljava.lang.String;@73149c9),YARN_APPLICATION,Some(YarnConfig(Some(1024),Some(Zeppelin
Flink Session),Some(default),Some(2),Some(2048m))),None)
2024-11-27 14:02:51,813 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] - Default
Parallelism: 1
2024-11-27 14:02:51,813 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] - Default SQL
Parallelism: -1
2024-11-27 14:02:51,816 INFO
org.apache.zeppelin.flink.FlinkScala212Interpreter [] - Use
FlinkCluster in yarn application mode, appId: application_1732625148614_0024
2024-11-27 14:02:51,838 INFO
org.apache.hadoop.yarn.client.DefaultNoHARMFailoverProxyProvider [] -
Connecting to ResourceManager at /0.0.0.0:8032
2024-11-27 14:02:52,978 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:02:53,979 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:02:54,983 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:02:55,984 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:02:56,986 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:02:57,987 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:02:58,988 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:02:59,991 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:00,992 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:01,993 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:03,004 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:04,005 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:05,008 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:06,010 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:07,011 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:08,012 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:09,014 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:10,017 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:11,018 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:12,019 INFO org.apache.hadoop.ipc.Client
[] - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried
9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
sleepTime=1000 MILLISECONDS)
2024-11-27 14:03:12,020 INFO org.apache.hadoop.io.retry.RetryInvocationHandler
[] - java.net.ConnectException: Your endpoint configuration is
wrong; For more details see:
http://wiki.apache.org/hadoop/UnsetHostnameOrPort, while invoking
ApplicationClientProtocolPBClientImpl.getApplicationReport over null after 1
failover attempts. Trying to failover after sleeping for 36515ms. Current retry
count: 1.
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
