Hi

这个看上去是提交到 Yarn 了,具体的原因需要看下 JM log 是啥原因。另外是否是日志没有贴全,这里只看到本地 log,其他的就只有小部分
jobmanager.err 的 log。

Best,
Congxian


Zhou Zach <wander...@163.com> 于2020年7月9日周四 下午9:23写道:

> hi all,
> 原来用1.10使用per job模式,可以提交的作业,现在用1.11使用应用模式提交失败,看日志,也不清楚原因,
> yarn log:
> Log Type: jobmanager.err
>
>
> Log Upload Time: Thu Jul 09 21:02:48 +0800 2020
>
>
> Log Length: 785
>
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/yarn/nm/usercache/hdfs/appcache/application_1594271580406_0010/filecache/11/data-flow-1.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> log4j:WARN No appenders could be found for logger
> (org.apache.flink.runtime.entrypoint.ClusterEntrypoint).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
>
>
> Log Type: jobmanager.out
>
>
> Log Upload Time: Thu Jul 09 21:02:48 +0800 2020
>
>
> Log Length: 0
>
>
>
>
> Log Type: prelaunch.err
>
>
> Log Upload Time: Thu Jul 09 21:02:48 +0800 2020
>
>
> Log Length: 0
>
>
>
>
> Log Type: prelaunch.out
>
>
> Log Upload Time: Thu Jul 09 21:02:48 +0800 2020
>
>
> Log Length: 70
>
>
> Setting up env variables
> Setting up job resources
> Launching container
>
>
>
>
>
>
>
>
> 本地log:
> 2020-07-09 21:02:41,015 INFO  org.apache.flink.client.cli.CliFrontend
>                 [] -
> --------------------------------------------------------------------------------
> 2020-07-09 21:02:41,020 INFO
> org.apache.flink.configuration.GlobalConfiguration           [] - Loading
> configuration property: jobmanager.rpc.address, localhost
> 2020-07-09 21:02:41,020 INFO
> org.apache.flink.configuration.GlobalConfiguration           [] - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2020-07-09 21:02:41,021 INFO
> org.apache.flink.configuration.GlobalConfiguration           [] - Loading
> configuration property: jobmanager.memory.process.size, 1600m
> 2020-07-09 21:02:41,021 INFO
> org.apache.flink.configuration.GlobalConfiguration           [] - Loading
> configuration property: taskmanager.memory.process.size, 1728m
> 2020-07-09 21:02:41,021 INFO
> org.apache.flink.configuration.GlobalConfiguration           [] - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2020-07-09 21:02:41,021 INFO
> org.apache.flink.configuration.GlobalConfiguration           [] - Loading
> configuration property: parallelism.default, 1
> 2020-07-09 21:02:41,021 INFO
> org.apache.flink.configuration.GlobalConfiguration           [] - Loading
> configuration property: jobmanager.execution.failover-strategy, region
> 2020-07-09 21:02:41,164 INFO
> org.apache.flink.runtime.security.modules.HadoopModule       [] - Hadoop
> user set to hdfs (auth:SIMPLE)
> 2020-07-09 21:02:41,172 INFO
> org.apache.flink.runtime.security.modules.JaasModule         [] - Jaas file
> will be created as /tmp/jaas-2213111423022415421.conf.
> 2020-07-09 21:02:41,181 INFO  org.apache.flink.client.cli.CliFrontend
>                 [] - Running 'run-application' command.
> 2020-07-09 21:02:41,194 INFO
> org.apache.flink.client.deployment.application.cli.ApplicationClusterDeployer
> [] - Submitting application in 'Application Mode'.
> 2020-07-09 21:02:41,201 WARN
> org.apache.flink.yarn.configuration.YarnLogConfigUtil        [] - The
> configuration directory ('/opt/flink-1.11.0/conf') already contains a LOG4J
> config file.If you want to use logback, then please delete or rename the
> log configuration file.
> 2020-07-09 21:02:41,537 INFO  org.apache.flink.yarn.YarnClusterDescriptor
>                 [] - No path for the flink jar passed. Using the location
> of class org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
> 2020-07-09 21:02:41,665 INFO
> org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider [] -
> Failing over to rm220
> 2020-07-09 21:02:41,717 INFO  org.apache.hadoop.conf.Configuration
>                  [] - resource-types.xml not found
> 2020-07-09 21:02:41,718 INFO
> org.apache.hadoop.yarn.util.resource.ResourceUtils           [] - Unable to
> find 'resource-types.xml'.
> 2020-07-09 21:02:41,755 INFO  org.apache.flink.yarn.YarnClusterDescriptor
>                 [] - Cluster specification:
> ClusterSpecification{masterMemoryMB=2048, taskManagerMemoryMB=4096,
> slotsPerTaskManager=1}
> 2020-07-09 21:02:42,723 INFO  org.apache.flink.yarn.YarnClusterDescriptor
>                 [] - Submitting application master
> application_1594271580406_0010
> 2020-07-09 21:02:42,969 INFO
> org.apache.hadoop.yarn.client.api.impl.YarnClientImpl        [] - Submitted
> application application_1594271580406_0010
> 2020-07-09 21:02:42,969 INFO  org.apache.flink.yarn.YarnClusterDescriptor
>                 [] - Waiting for the cluster to be allocated
> 2020-07-09 21:02:42,971 INFO  org.apache.flink.yarn.YarnClusterDescriptor
>                 [] - Deploying cluster, current state ACCEPTED
> 2020-07-09 21:02:47,619 INFO  org.apache.flink.yarn.YarnClusterDescriptor
>                 [] - YARN application has been deployed successfully.
> 2020-07-09 21:02:47,620 INFO  org.apache.flink.yarn.YarnClusterDescriptor
>                 [] - Found Web Interface cdh003:38716 of application
> 'application_1594271580406_0010'

Reply via email to