Re: The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster.
Hi, Kaiqiang Flink run 的正确用法是[1], 通过-c 指定mainClass 需要放在 jar-file 之前。图中的报错是由于没有指定 main-class,同时在 manifest 中也找不到对应的配置,可以检查下最终 jar 包内容是否符合预期。 [1] flink run [OPTIONS] > 2022年3月26日 下午6:52,Kaiqiang XIE谢开强 写道: > > 同样的jar包 在webui 提交可以运行成功 > 但是用命令行就还是不行? > > > > > > > > > > > > > > > > > 在 2022-03-26 17:01:36,"Kaiqiang XIE谢开强" 写道: > > 不好意思,yarn的问题搞定了。 > 还想再请教一下:我用scala写的程序,在idea中正常运行,打jar包后用flink run 运行。 > 为什么会报找不到主类入口呢?报错截图 > 附件是我的pom文件 > > > > > > > > > > > > > > > > > > 在 2022-03-26 10:37:37,"Geng Biao" 写道: >> 放图的话,建议传到图床上,邮件里放链接。一般运行yarn top即可显示集群状态。 >> >> Best, >> Biao >> >> 获取 Outlook for iOS<https://aka.ms/o0ukef> >> ________________ >> 发件人: Kaiqiang XIE谢开强 >> 发送时间: Saturday, March 26, 2022 10:33:40 AM >> 收件人: user-zh@flink.apache.org >> 主题: Re:Re: The number of requested virtual cores for application master 1 >> exceeds the maximum number of virtual cores 0 available in the Yarn Cluster. >> >> >> >> >> >> yarn这是正常的吧? >> >> [cid:44f01b9d$1$17fc4121e18$Coremail$kqx0731$163.com] >> >> >> 在 2022-03-26 09:22:11,"胡伟华" 写道: >>> 报错是 YARN 集群可用资源不足了,可以检查下 YARN 集群是否正常 >>> >>>> 2022年3月26日 上午8:00,Kaiqiang XIE谢开强 写道: >>>> >>>> 各位好,再请教一个问题哈 >>>> mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster >>>> $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port >>>> 8882之后提示The number of requested virtual cores for application master 1 >>>> exceeds the maximum number of virtual cores 0 available in the Yarn >>>> Cluster. >>>> >>>> >>>> >>>> >>>> 这是什么问题呢? >> >> >> >> >> > > > > >
Re:Re:Re: The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster.
同样的jar包 在webui 提交可以运行成功 但是用命令行就还是不行? 在 2022-03-26 17:01:36,"Kaiqiang XIE谢开强" 写道: 不好意思,yarn的问题搞定了。 还想再请教一下:我用scala写的程序,在idea中正常运行,打jar包后用flink run 运行。 为什么会报找不到主类入口呢?报错截图 附件是我的pom文件 在 2022-03-26 10:37:37,"Geng Biao" 写道: >放图的话,建议传到图床上,邮件里放链接。一般运行yarn top即可显示集群状态。 > >Best, >Biao > >获取 Outlook for iOS<https://aka.ms/o0ukef> > >发件人: Kaiqiang XIE谢开强 >发送时间: Saturday, March 26, 2022 10:33:40 AM >收件人: user-zh@flink.apache.org >主题: Re:Re: The number of requested virtual cores for application master 1 >exceeds the maximum number of virtual cores 0 available in the Yarn Cluster. > > > > > >yarn这是正常的吧? > >[cid:44f01b9d$1$17fc4121e18$Coremail$kqx0731$163.com] > > >在 2022-03-26 09:22:11,"胡伟华" 写道: >>报错是 YARN 集群可用资源不足了,可以检查下 YARN 集群是否正常 >> >>> 2022年3月26日 上午8:00,Kaiqiang XIE谢开强 写道: >>> >>> 各位好,再请教一个问题哈 >>> mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster >>> $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port 8882之后提示The >>> number of requested virtual cores for application master 1 exceeds the >>> maximum number of virtual cores 0 available in the Yarn Cluster. >>> >>> >>> >>> >>> 这是什么问题呢? > > > > >
Re:Re: The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster.
不好意思,yarn的问题搞定了。 还想再请教一下:我用scala写的程序,在idea中正常运行,打jar包后用flink run 运行。 为什么会报找不到主类入口呢?报错截图 附件是我的pom文件 在 2022-03-26 10:37:37,"Geng Biao" 写道: >放图的话,建议传到图床上,邮件里放链接。一般运行yarn top即可显示集群状态。 > >Best, >Biao > >获取 Outlook for iOS<https://aka.ms/o0ukef> > >发件人: Kaiqiang XIE谢开强 >发送时间: Saturday, March 26, 2022 10:33:40 AM >收件人: user-zh@flink.apache.org >主题: Re:Re: The number of requested virtual cores for application master 1 >exceeds the maximum number of virtual cores 0 available in the Yarn Cluster. > > > > > >yarn这是正常的吧? > >[cid:44f01b9d$1$17fc4121e18$Coremail$kqx0731$163.com] > > >在 2022-03-26 09:22:11,"胡伟华" 写道: >>报错是 YARN 集群可用资源不足了,可以检查下 YARN 集群是否正常 >> >>> 2022年3月26日 上午8:00,Kaiqiang XIE谢开强 写道: >>> >>> 各位好,再请教一个问题哈 >>> mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster >>> $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port 8882之后提示The >>> number of requested virtual cores for application master 1 exceeds the >>> maximum number of virtual cores 0 available in the Yarn Cluster. >>> >>> >>> >>> >>> 这是什么问题呢? > > > > > http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> 4.0.0 com.shopee EntryTask 1.0-SNAPSHOT 8 8 1.13.6 2.12 3.1.0 org.apache.flink flink-scala_${scala.binary.version} ${flink.version} provided org.apache.flink flink-streaming-scala_${scala.binary.version} ${flink.version} provided org.apache.kafka kafka_${scala.binary.version} ${kafka.version} provided org.apache.flink flink-connector-kafka_${scala.binary.version} ${flink.version} provided org.apache.flink flink-clients_${scala.binary.version} ${flink.version} provided net.alchim31.maven scala-maven-plugin 4.4.0 compile-scala compile add-source compile test-compile-scala test-compile add-source testCompile org.apache.maven.plugins maven-assembly-plugin 3.3.0 com.shopp.KafkaProducer jar-with-dependencies make-assembly package single
Re: The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster.
放图的话,建议传到图床上,邮件里放链接。一般运行yarn top即可显示集群状态。 Best, Biao 获取 Outlook for iOS<https://aka.ms/o0ukef> 发件人: Kaiqiang XIE谢开强 发送时间: Saturday, March 26, 2022 10:33:40 AM 收件人: user-zh@flink.apache.org 主题: Re:Re: The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster. yarn这是正常的吧? [cid:44f01b9d$1$17fc4121e18$Coremail$kqx0731$163.com] 在 2022-03-26 09:22:11,"胡伟华" 写道: >报错是 YARN 集群可用资源不足了,可以检查下 YARN 集群是否正常 > >> 2022年3月26日 上午8:00,Kaiqiang XIE谢开强 写道: >> >> 各位好,再请教一个问题哈 >> mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster >> $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port 8882之后提示The >> number of requested virtual cores for application master 1 exceeds the >> maximum number of virtual cores 0 available in the Yarn Cluster. >> >> >> >> >> 这是什么问题呢?
Re:Re: The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster.
yarn这是正常的吧? 在 2022-03-26 09:22:11,"胡伟华" 写道: >报错是 YARN 集群可用资源不足了,可以检查下 YARN 集群是否正常 > >> 2022年3月26日 上午8:00,Kaiqiang XIE谢开强 写道: >> >> 各位好,再请教一个问题哈 >> mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster >> $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port 8882之后提示The >> number of requested virtual cores for application master 1 exceeds the >> maximum number of virtual cores 0 available in the Yarn Cluster. >> >> >> >> >> 这是什么问题呢?
Re: The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster.
报错是 YARN 集群可用资源不足了,可以检查下 YARN 集群是否正常 > 2022年3月26日 上午8:00,Kaiqiang XIE谢开强 写道: > > 各位好,再请教一个问题哈 > mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster > $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port 8882之后提示The > number of requested virtual cores for application master 1 exceeds the > maximum number of virtual cores 0 available in the Yarn Cluster. > > > > > 这是什么问题呢?
The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster.
各位好,再请教一个问题哈 mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port 8882之后提示The number of requested virtual cores for application master 1 exceeds the maximum number of virtual cores 0 available in the Yarn Cluster. 这是什么问题呢?