Re: flink1.10 yarn模式无法提交作业

Sun, 09 Feb 2020 05:10:56 -0800

我们遇到过因为jar包冲突导致task manager无法启动，从而一直处于accepted状态的情况。这种情况下可以使用yarn logs -applicationId <appId>查看一下日志，可以发现更多线索。 

Fei Han wrote on 2020/2/9 17:34:

@all:
    在Flink1.10中，用yarn模式无法提交作业。
   提示如下：
lease check if the requested resources are available in the YARN cluster
2020-02-09 17:22:26,318 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:26,570 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:26,822 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:27,074 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:27,326 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:27,578 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:27,831 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:28,083 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster
2020-02-09 17:22:28,336 INFO  org.apache.flink.yarn.YarnClusterDescriptor       
            - Deployment took more than 60 seconds. Please check if the 
requested resources are available in the YARN cluster


另外，我看了yarn资源足够。但就是提交不了。
我的作业提交命令如下：
  ./bin/flink run -m yarn-cluster  -yjm 1024  -ytm 2048  
/opt/flink-1.10/examples/batch/WordCount.jar  --input 
hdfs://192.168.xxx.xxx:9000/test/LICENSE  --output 
hdfs://192.168.xxx.xxx:9000/test/result.txt


--
Sent from Postbox <https://www.postbox-inc.com>

回复