不好意思,yarn的问题搞定了。 还想再请教一下:我用scala写的程序,在idea中正常运行,打jar包后用flink run 运行。 为什么会报找不到主类入口呢?报错截图 附件是我的pom文件
在 2022-03-26 10:37:37,"Geng Biao" <biaoge...@gmail.com> 写道: >放图的话,建议传到图床上,邮件里放链接。一般运行yarn top即可显示集群状态。 > >Best, >Biao > >获取 Outlook for iOS<https://aka.ms/o0ukef> >________________________________ >发件人: Kaiqiang XIE谢开强 <kqx0...@163.com> >发送时间: Saturday, March 26, 2022 10:33:40 AM >收件人: user-zh@flink.apache.org <user-zh@flink.apache.org> >主题: Re:Re: The number of requested virtual cores for application master 1 >exceeds the maximum number of virtual cores 0 available in the Yarn Cluster. > > > > > >yarn这是正常的吧? > >[cid:44f01b9d$1$17fc4121e18$Coremail$kqx0731$163.com] > > >在 2022-03-26 09:22:11,"胡伟华" <huweihua....@gmail.com> 写道: >>报错是 YARN 集群可用资源不足了,可以检查下 YARN 集群是否正常 >> >>> 2022年3月26日 上午8:00,Kaiqiang XIE谢开强 <kqx0...@163.com> 写道: >>> >>> 各位好,再请教一个问题哈 >>> mac上部署flink standalone,在运行 bin/flink run -m yarn-cluster >>> $FLINK_HOME/examples/streaming/SocketWindowWordCount.jar --port 8882之后提示The >>> number of requested virtual cores for application master 1 exceeds the >>> maximum number of virtual cores 0 available in the Yarn Cluster. >>> >>> >>> >>> >>> 这是什么问题呢? > > > > >
<?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>com.shopee</groupId> <artifactId>EntryTask</artifactId> <version>1.0-SNAPSHOT</version> <properties> <maven.compiler.source>8</maven.compiler.source> <maven.compiler.target>8</maven.compiler.target> <flink.version>1.13.6</flink.version> <scala.binary.version>2.12</scala.binary.version> <kafka.version>3.1.0</kafka.version> </properties> <dependencies> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-scala_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-streaming-scala_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.kafka</groupId> <artifactId>kafka_${scala.binary.version}</artifactId> <version>${kafka.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-connector-kafka_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>provided</scope> </dependency> <dependency> <groupId>org.apache.flink</groupId> <artifactId>flink-clients_${scala.binary.version}</artifactId> <version>${flink.version}</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>net.alchim31.maven</groupId> <artifactId>scala-maven-plugin</artifactId> <version>4.4.0</version> <executions> <execution> <id>compile-scala</id> <phase>compile</phase> <goals> <goal>add-source</goal> <goal>compile</goal> </goals> </execution> <execution> <id>test-compile-scala</id> <phase>test-compile</phase> <goals> <goal>add-source</goal> <goal>testCompile</goal> </goals> </execution> </executions> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-assembly-plugin</artifactId> <version>3.3.0</version> <configuration> <archive> <manifest> <mainClass>com.shopp.KafkaProducer</mainClass> </manifest> </archive> <descriptorRefs> <descriptorRef>jar-with-dependencies</descriptorRef> </descriptorRefs> </configuration> <executions> <execution> <id>make-assembly</id> <phase>package</phase> <goals> <goal>single</goal> </goals> </execution> </executions> </plugin> </plugins> </build> </project>