The RC version failed to verify the state function
The output:
```
~/Downloads/release_2.11.1/apache-pulsar-2.11.1 » bin/pulsar-admin
functions status --tenant test --namespace test-namespace --name word_count
{
"numInstances" : 1,
"numRunning" : 1,
"instances" : [ {
"instanceId" : 0,
"status" : {
"running" : true,
"error" : "",
"numRestarts" : 0,
"numReceived" : 15,
"numSuccessfullyProcessed" : 0,
"numUserExceptions" : 15,
"latestUserExceptions" : [ {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731596735
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731596736
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731596737
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731596738
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731596738
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731656845
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731656845
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731656846
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731656847
}, {
"exceptionString" : "State test/test-namespace/word_count is not
enabled.",
"timestampMs" : 1681731656847
} ],
"numSystemExceptions" : 0,
"latestSystemExceptions" : [ ],
"averageLatency" : 0.14653653333333333,
"lastInvocationTime" : 1681731656847,
"workerId" : "c-standalone-fw-localhost-8080"
}
} ]
}
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/release_2.11.1/apache-pulsar-2.11.1 » bin/pulsar-admin
functions querystate --tenant test --namespace test-namespace --name
word_count -k hello -w
# key 'hello' doesn't exist.
# key 'hello' doesn't exist.
# key 'hello' doesn't exist
State storage client is not done initializing. Please try again in a little
while.
Reason: State storage client is not done initializing. Please try again in
a little while.
```
The logs from broker:
```
2023-04-17T19:42:55,447+0800 [pulsar-web-48-15] INFO
org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [17/Apr/2023:19:42:55
+0800] "GET /admin/v2/namespaces/test HTTP/1.1" 200 23 "-"
"Pulsar-Java-v2.11.1" 5
2023-04-17T19:42:55,450+0800 [pulsar-web-48-4] INFO
org.apache.pulsar.common.nar.NarUnpacker - Created directory
/var/folders/t4/w6thygwj0y596w0j5h_pzlw40000gn/T/pulsar-nar/functions4142072620718955215.tmp-unpacked
2023-04-17T19:42:55,451+0800 [pulsar-web-48-4] INFO
org.apache.pulsar.common.nar.NarUnpacker - Extracting
/var/folders/t4/w6thygwj0y596w0j5h_pzlw40000gn/T/functions4142072620718955215.tmp
to
/var/folders/t4/w6thygwj0y596w0j5h_pzlw40000gn/T/pulsar-nar/functions4142072620718955215.tmp-unpacked/3E3BMXidvkyl6VKTjb2b4Q
2023-04-17T19:42:55,452+0800 [pulsar-web-48-4] ERROR
org.apache.pulsar.common.nar.NarUnpacker - There was a problem extracting
the nar file. Deleting
/var/folders/t4/w6thygwj0y596w0j5h_pzlw40000gn/T/pulsar-nar/functions4142072620718955215.tmp-unpacked/3E3BMXidvkyl6VKTjb2b4Q
to clean up state.
java.io.FileNotFoundException:
/var/folders/t4/w6thygwj0y596w0j5h_pzlw40000gn/T/pulsar-nar/functions4142072620718955215.tmp-unpacked/3E3BMXidvkyl6VKTjb2b4Q/META-INF/MANIFEST.MF
(No such file or directory)
at java.io.FileOutputStream.open0(Native Method) ~[?:?]
at java.io.FileOutputStream.open(FileOutputStream.java:295) ~[?:?]
at java.io.FileOutputStream.<init>(FileOutputStream.java:236) ~[?:?]
at java.io.FileOutputStream.<init>(FileOutputStream.java:185) ~[?:?]
at org.apache.pulsar.common.nar.NarUnpacker.makeFile(NarUnpacker.java:143)
~[org.apache.pulsar-pulsar-common-2.11.1.jar:2.11.1]
at org.apache.pulsar.common.nar.NarUnpacker.unpack(NarUnpacker.java:126)
~[org.apache.pulsar-pulsar-common-2.11.1.jar:2.11.1]
at
org.apache.pulsar.common.nar.NarUnpacker.doUnpackNar(NarUnpacker.java:95)
~[org.apache.pulsar-pulsar-common-2.11.1.jar:2.11.1]
at org.apache.pulsar.common.nar.NarUnpacker.unpackNar(NarUnpacker.java:64)
~[org.apache.pulsar-pulsar-common-2.11.1.jar:2.11.1]
at
org.apache.pulsar.common.nar.NarClassLoader.getFromArchive(NarClassLoader.java:148)
~[org.apache.pulsar-pulsar-common-2.11.1.jar:2.11.1]
at
org.apache.pulsar.common.nar.NarClassLoaderBuilder.build(NarClassLoaderBuilder.java:72)
~[org.apache.pulsar-pulsar-common-2.11.1.jar:2.11.1]
at
org.apache.pulsar.functions.utils.FunctionCommon.extractNarClassLoader(FunctionCommon.java:287)
~[org.apache.pulsar-pulsar-functions-utils-2.11.1.jar:2.11.1]
at
org.apache.pulsar.functions.utils.FunctionCommon.getClassLoaderFromPackage(FunctionCommon.java:424)
~[org.apache.pulsar-pulsar-functions-utils-2.11.1.jar:2.11.1]
at
org.apache.pulsar.functions.worker.rest.api.ComponentImpl.getClassLoaderFromPackage(ComponentImpl.java:1770)
~[org.apache.pulsar-pulsar-functions-worker-2.11.1.jar:2.11.1]
at
org.apache.pulsar.functions.worker.rest.api.FunctionsImpl.validateUpdateRequestParams(FunctionsImpl.java:793)
~[org.apache.pulsar-pulsar-functions-worker-2.11.1.jar:2.11.1]
at
org.apache.pulsar.functions.worker.rest.api.FunctionsImpl.registerFunction(FunctionsImpl.java:170)
~[org.apache.pulsar-pulsar-functions-worker-2.11.1.jar:2.11.1]
at
org.apache.pulsar.broker.admin.impl.FunctionsBase.registerFunction(FunctionsBase.java:200)
~[org.apache.pulsar-pulsar-broker-2.11.1.jar:2.11.1]
at
jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
~[?:?]
at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
at
org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$VoidOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:159)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:475)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:397)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
~[org.glassfish.jersey.core-jersey-common-2.34.jar:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
~[org.glassfish.jersey.core-jersey-common-2.34.jar:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
~[org.glassfish.jersey.core-jersey-common-2.34.jar:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
~[org.glassfish.jersey.core-jersey-common-2.34.jar:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
~[org.glassfish.jersey.core-jersey-common-2.34.jar:?]
at
org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
~[org.glassfish.jersey.core-jersey-common-2.34.jar:?]
at
org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:234)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
~[org.glassfish.jersey.core-jersey-server-2.34.jar:?]
at
org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
~[org.glassfish.jersey.containers-jersey-container-servlet-core-2.34.jar:?]
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
~[org.glassfish.jersey.containers-jersey-container-servlet-core-2.34.jar:?]
at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)
~[org.glassfish.jersey.containers-jersey-container-servlet-core-2.34.jar:?]
at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)
~[org.glassfish.jersey.containers-jersey-container-servlet-core-2.34.jar:?]
at
org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
~[org.glassfish.jersey.containers-jersey-container-servlet-core-2.34.jar:?]
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.apache.pulsar.broker.web.ResponseHandlerFilter.doFilter(ResponseHandlerFilter.java:67)
~[org.apache.pulsar-pulsar-broker-2.11.1.jar:2.11.1]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.servlets.QoSFilter.doFilter(QoSFilter.java:202)
~[org.eclipse.jetty-jetty-servlets-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
~[org.eclipse.jetty-jetty-servlet-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.server.Server.handle(Server.java:516)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
~[org.eclipse.jetty-jetty-server-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
~[org.eclipse.jetty-jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
~[org.eclipse.jetty-jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
~[org.eclipse.jetty-jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
~[org.eclipse.jetty-jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
~[org.eclipse.jetty-jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
~[org.eclipse.jetty-jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
~[org.eclipse.jetty-jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
~[org.eclipse.jetty-jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
~[?:?]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
~[?:?]
at
io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
~[io.netty-netty-common-4.1.86.Final.jar:4.1.86.Final]
at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-04-17T19:42:55,484+0800 [pulsar-web-48-16] INFO
org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [17/Apr/2023:19:42:55
+0800] "POST /admin/v3/packages/function/test/test-namespace/word_count0/0
HTTP/1.1" 204 0 "-" "Pulsar-Java-v2.11.1" 9
```
Thanks,
Penghui
On Sat, Apr 15, 2023 at 6:30 PM Haiting Jiang <jianghait...@gmail.com>
wrote:
> +1 binding
>
> - Checksum and signatures
> - Built from sources using JDK 17 and maven 3.8.6
> - Run rat check and check-binary-license on source.
> - Run Pulsar standalone
> - Validate Pub/Sub and Java Functions
> - Validate Stateful Functions with `PULSAR_STANDALONE_USE_ZOOKEEPER=1`
> - Run simple performance checks, small improvements with the last version.
>
> Thanks
> Haiting
>
> On Sat, Apr 15, 2023 at 5:12 PM Haiting Jiang <jianghait...@gmail.com>
> wrote:
> >
> > HI Jiwei,
> >
> > > https://github.com/Technoboy-/pulsar/pull/31
> >
> > About this CI, we need to make some blank modification to pom files,
> > in order to trigger the "OWASP dependency check", this is easy to miss
> > with released branches.
> >
> > Thanks for driving this release.
> >
> > Thanks,
> > Haiting
> >
> > On Thu, Apr 13, 2023 at 1:17 PM guo jiwei <techno...@apache.org> wrote:
> > >
> > > This is the second release candidate for Apache Pulsar, version 2.11.1.
> > >
> > > This release contains 214 commits by 53 contributors.
> > > https://github.com/apache/pulsar/compare/v2.11.0...v2.11.1-candidate-2
> > >
> > > CI for this release candidate
> > > https://github.com/Technoboy-/pulsar/pull/31
> > >
> > > *** Please download, test and vote on this release. This vote will
> stay open
> > > for at least 72 hours ***
> > >
> > > Note that we are voting upon the source (tag), binaries are provided
> for
> > > convenience.
> > >
> > > Source and binary files:
> > >
> https://dist.apache.org/repos/dist/dev/pulsar/pulsar-2.11.1-candidate-2
> > >
> > > SHA-512 checksums:
> > >
> > >
> 98eddbc150ae4b832e0f37d7793ac62b3c1ac7fb98f7460292562d91c1dd580484e23786e02efdef6fb3f50ddcf5542e94ef1761dc0d943308bbba22b221c0dc
> > >
> > >
> > > ./apache-pulsar-2.11.1-bin.tar.gz
> > >
> > >
> > >
> 3dfe21d27c6668515ead3c55ef923a190df657ecabdbaa3451a060bd3670d6a709302e538c75b4b4f2e1d7b5289ee09ac3adba8b57ab59e98d13b4c0b57f8b83
> > >
> > >
> > > ./apache-pulsar-2.11.1-src.tar.gz
> > >
> > > Maven staging repo:
> > >
> https://repository.apache.org/content/repositories/orgapachepulsar-1224/
> > >
> > > The tag to be voted upon:
> > > v2.11.1-candidate-2 (500833ac01fddf660e5ff1afccce1c7271fccd4c)
> > > https://github.com/apache/pulsar/releases/tag/v2.11.1-candidate-2
> > >
> > > Pulsar's KEYS file containing PGP keys we use to sign the release:
> > > https://dist.apache.org/repos/dist/dev/pulsar/KEYS
> > >
> > >
> https://hub.docker.com/layers/mattison/pulsar-all/2.11.1-rc2/images/sha256-0a039a339f4ef5f44ed2d71b7684038d8d8bbe86375bd1421c55d83a6ae3d7b4
> > >
> > >
> https://hub.docker.com/layers/mattison/pulsar/2.11.1-rc2/images/sha256-cb8b9d860217145fa1c3ff197cf4c14f2470127fe714c609470137d1fa2f5951
> > >
> > > Please download the source package, and follow the
> > > release-candidate-validation doc to build
> > > and run the Pulsar standalone service.
> > > https://pulsar.apache.org/contribute/validate-release-candidate
> > >
> > > Since the metadata store is changed from ZK to RocksDB, the
> > > verification of the `stateful functions` needs to set the parameter
> > > "export PULSAR_STANDALONE_USE_ZOOKEEPER=1"
> > >
> > >
> > > Regards
> > > Jiwei Guo (Tboy)
>
