您好,在使用flink on YARN的时候遇到了问题,寻求帮助,YARN集群搭建完成之后,运行flink命令如下:
./bin/flink run -t yarn-per-job --detached ./examples/batch/WordCount.jar
但是发现没有输出运行结果,日志如下
Executing WordCount example with default input data set.
Use --input to specify file input.
Printing result to stdout. Use --output to specify output path.
2021-05-08 21:53:46,561 WARN  
org.apache.flink.yarn.configuration.YarnLogConfigUtil        [] - The 
configuration directory ('/mnt/flink-1.12.3/conf') already contains a LOG4J 
config file.If you want to use logback, then please delete or rename the log 
configuration file.
2021-05-08 21:53:46,611 INFO  
org.apache.hadoop.yarn.client.DefaultNoHARMFailoverProxyProvider [] - 
Connecting to ResourceManager at node01/172.19.0.132:8032
2021-05-08 21:53:46,925 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - No path for the flink jar passed. Using the location of class 
org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
2021-05-08 21:53:47,159 INFO  org.apache.hadoop.conf.Configuration              
           [] - resource-types.xml not found
2021-05-08 21:53:47,160 INFO  
org.apache.hadoop.yarn.util.resource.ResourceUtils           [] - Unable to 
find 'resource-types.xml'.
2021-05-08 21:53:47,224 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - The configured JobManager memory is 1600 MB. YARN will allocate 
2048 MB to make up an integer multiple of its minimum allocation memory (1024 
MB, configured via 'yarn.scheduler.minimum-allocation-mb'). The extra 448 MB 
may not be used by Flink.
2021-05-08 21:53:47,224 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - The configured TaskManager memory is 1728 MB. YARN will 
allocate 2048 MB to make up an integer multiple of its minimum allocation 
memory (1024 MB, configured via 'yarn.scheduler.minimum-allocation-mb'). The 
extra 320 MB may not be used by Flink.
2021-05-08 21:53:47,225 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - Cluster specification: 
ClusterSpecification{masterMemoryMB=1600, taskManagerMemoryMB=1728, 
slotsPerTaskManager=1}
2021-05-08 21:53:53,360 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - Submitting application master application_1620481460888_0003
2021-05-08 21:53:53,425 INFO  
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl        [] - Submitted 
application application_1620481460888_0003
2021-05-08 21:53:53,425 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - Waiting for the cluster to be allocated
2021-05-08 21:53:53,427 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - Deploying cluster, current state ACCEPTED
2021-05-08 21:54:53,548 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2021-05-08 21:54:53,825 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2021-05-08 21:54:54,077 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
           [] - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster

代码里输出的内容正常打印,但是没有打印结果
flink版本  1.12.3   Hadoop版本3.3.0
    期望得到您的回复



wyinj...@126.com

回复