Once another bug fix https://github.com/apache/storm/pull/3123 <https://github.com/apache/storm/pull/3123> is merged, I think we can run another release candidate.
> On Aug 28, 2019, at 9:27 AM, Ethan Li <[email protected]> wrote: > > Thanks for finding the issue. > > I just uploaded my key to http://pgp.mit.edu/ <http://pgp.mit.edu/>. It’s a > good idea to link to https://www.apache.org/info/verification.html > <https://www.apache.org/info/verification.html> on download page. > >> On Aug 27, 2019, at 3:35 PM, Stig Rohde Døssing <[email protected] >> <mailto:[email protected]>> wrote: >> >> -1, I think this issue is a blocker. It's caused by >> https://github.com/apache/storm/pull/3093/files >> <https://github.com/apache/storm/pull/3093/files>, which prevents the >> localizer from deleting blobs that are deleted from Nimbus, even if those >> blobs are only scheduled for download. >> >> Have opened https://github.com/apache/storm/pull/3119 >> <https://github.com/apache/storm/pull/3119> >> >> Den tir. 27. aug. 2019 kl. 19.54 skrev Stig Rohde Døssing < >> [email protected] <mailto:[email protected]>>: >> >>> I think there may be an issue with topology cleanup >>> I ran WordCountTopology for a bit, then killed it. The supervisor seems to >>> keep trying to download the topology jar indefinitely. >>> >>> 2019-08-27 19:49:53.459 o.a.s.l.AsyncLocalizer AsyncLocalizer Executor - 1 >>> [WARN] Failed to download blob LOCAL TOPO BLOB TOPO_JAR >>> word-count-1-1566926844 will try again in 100 ms >>> org.apache.storm.generated.KeyNotFoundException: null >>> at >>> org.apache.storm.generated.Nimbus$getBlobMeta_result$getBlobMeta_resultStandardScheme.read(Nimbus.java:25919) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.generated.Nimbus$getBlobMeta_result$getBlobMeta_resultStandardScheme.read(Nimbus.java:25887) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.generated.Nimbus$getBlobMeta_result.read(Nimbus.java:25818) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.thrift.TServiceClient.receiveBase(TServiceClient.java:88) >>> ~[storm-shaded-deps-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.generated.Nimbus$Client.recv_getBlobMeta(Nimbus.java:794) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at org.apache.storm.generated.Nimbus$Client.getBlobMeta(Nimbus.java:781) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.blobstore.NimbusBlobStore.getBlobMeta(NimbusBlobStore.java:85) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.localizer.LocallyCachedTopologyBlob.getRemoteVersion(LocallyCachedTopologyBlob.java:127) >>> ~[storm-server-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.localizer.AsyncLocalizer.lambda$downloadOrUpdate$10(AsyncLocalizer.java:264) >>> ~[storm-server-2.1.0.jar:2.1.0] >>> at >>> java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1626) >>> [?:1.8.0_144] >>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>> [?:1.8.0_144] >>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_144] >>> at >>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) >>> [?:1.8.0_144] >>> at >>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) >>> [?:1.8.0_144] >>> at >>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) >>> [?:1.8.0_144] >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) >>> [?:1.8.0_144] >>> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_144] >>> >>> These repeat, intermittently broken up by >>> >>> Caused by: java.lang.RuntimeException: Could not download... >>> at >>> org.apache.storm.localizer.AsyncLocalizer.lambda$downloadOrUpdate$10(AsyncLocalizer.java:285) >>> ~[storm-server-2.1.0.jar:2.1.0] >>> at >>> java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1626) >>> ~[?:1.8.0_144] >>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>> ~[?:1.8.0_144] >>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_144] >>> at >>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) >>> ~[?:1.8.0_144] >>> at >>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) >>> ~[?:1.8.0_144] >>> ... 3 more >>> Caused by: org.apache.storm.generated.KeyNotFoundException >>> at >>> org.apache.storm.generated.Nimbus$getBlobMeta_result$getBlobMeta_resultStandardScheme.read(Nimbus.java:25919) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.generated.Nimbus$getBlobMeta_result$getBlobMeta_resultStandardScheme.read(Nimbus.java:25887) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.generated.Nimbus$getBlobMeta_result.read(Nimbus.java:25818) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.thrift.TServiceClient.receiveBase(TServiceClient.java:88) >>> ~[storm-shaded-deps-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.generated.Nimbus$Client.recv_getBlobMeta(Nimbus.java:794) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at org.apache.storm.generated.Nimbus$Client.getBlobMeta(Nimbus.java:781) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.blobstore.NimbusBlobStore.getBlobMeta(NimbusBlobStore.java:85) >>> ~[storm-client-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.localizer.LocallyCachedTopologyBlob.getRemoteVersion(LocallyCachedTopologyBlob.java:127) >>> ~[storm-server-2.1.0.jar:2.1.0] >>> at >>> org.apache.storm.localizer.AsyncLocalizer.lambda$downloadOrUpdate$10(AsyncLocalizer.java:264) >>> ~[storm-server-2.1.0.jar:2.1.0] >>> at >>> java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1626) >>> ~[?:1.8.0_144] >>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>> ~[?:1.8.0_144] >>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_144] >>> at >>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) >>> ~[?:1.8.0_144] >>> at >>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) >>> ~[?:1.8.0_144] >>> ... 3 more >>> >>> Restarting the supervisor seems to fix it. >>> >>> Here's what I did before hitting this issue >>> >>> Verified asc and sha512 files. >>> Built Storm from the zipped source. >>> Extracted zipped binary and started dev-zookeeper, nimbus, supervisor, >>> logviewer, ui. >>> Ran WordCountTopology for a while. >>> Checked rebalance, deactivate/activate, worker log viewing, kill from the >>> UI. >>> >>> Minor things we might want to handle: >>> It might be good to put your key up on a keyserver e.g. >>> http://pgp.mit.edu/ <http://pgp.mit.edu/>, as that is where the >>> https://www.apache.org/info/verification.html >>> <https://www.apache.org/info/verification.html> page suggests users go to >>> find keys. >>> We should add a note to the Storm downloads page that links to the >>> verification page. Currently users aren't informed how to check signatures >>> and checksums. >>> >>> Den tir. 20. aug. 2019 kl. 23.05 skrev Ethan Li <[email protected] >>> <mailto:[email protected]>>: >>> >>>> This is a call to vote on releasing Apache Storm 2.1.0 (rc3) >>>> >>>> Full list of changes in this release: >>>> >>>> >>>> https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.1.0-rc3/RELEASE_NOTES.html >>>> >>>> <https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.1.0-rc3/RELEASE_NOTES.html> >>>> >>>> The tag/commit to be voted upon is v2.1.0: >>>> >>>> >>>> https://gitbox.apache.org/repos/asf?p=storm.git;a=tree;h=4288646ef99b97f9737dd9c21b7b6b62c8b17afa;hb=6562d6ee438c2858d92a51bd30ca0a1f2f623c77 >>>> >>>> The source archive being voted upon can be found here: >>>> >>>> >>>> https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.1.0-rc3/apache-storm-2.1.0-src.tar.gz >>>> >>>> Other release files, signatures and digests can be found here: >>>> >>>> https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.1.0-rc3 >>>> >>>> The release artifacts are signed with the following key: >>>> >>>> https://www.apache.org/dist/storm/KEYS >>>> >>>> The Nexus staging repository for this release is: >>>> >>>> https://repository.apache.org/content/repositories/orgapachestorm-1087/ >>>> >>>> Please vote on releasing this package as Apache Storm 2.1.0. >>>> >>>> When voting, please list the actions taken to verify the release. >>>> >>>> This vote will be open for at least 72 hours. >>>> >>>> [ ] +1 Release this package as Apache Storm 2.1.0 >>>> [ ] 0 No opinion >>>> [ ] -1 Do not release this package because... >>>> >>>> Thanks to everyone who contributed to this release. >>>> >>>> Ethan >>>> >>> >
