Hello, Regarding my tests with Apache Storm 2.5.0 RC2 on a pre-production cluster at scale, with 10+ topologies, running on RockyLinux 8 with IBM Semeru 17.0.7 (based on OpenJ9 JVM) on Linux x64, I have detected no functional regression, not any noticeable performance changes.
On side node, our topologies's Java source code is still compiled with JDK11, and soon we will try compiling it with JDK17. (with Java 21 LTS coming soon - end of September this year, it's time to upgrade ;) I still need to test compiling Storm from sources, my previous attempt with RC1 was broken, and I have read some feedbacks that RC2 isn't perfect on this side, so if an RC3 is planned, then I'd like to know it so as to organize myself for Storm compiling tests. Kind regards, Alexandre Le mar. 1 août 2023 à 10:49, Julien Nioche <lists.digitalpeb...@gmail.com> a écrit : > > Hi, > > Have experienced the same problems as Derek when trying to build. This is > due to the dependency *pentaho-aggdesigner-algorithm *not being available. > This dependency is excluded in some places of the poms but not > systematically, I will open an issue and submit a PR shortly. > > Otherwise, I managed to run a StormCrawler topology with the 2.5 RC both in > local and deployed mode. > > It would be good to fix the build before releasing IMHO. > > Julien > > On Mon, 31 Jul 2023 at 16:35, Bipin Prasad <bipinpra...@apache.org> wrote: > > > Hello Derek, > > Looks like some shared libraries may be missing from the jdk11 > > install. Could be similar to this issue > > https://github.com/pytorch/serve/issues/1352 > > > > --Bipin > > > > On 2023/07/28 04:52:21 Derek Dagit wrote: > > > I downloaded the release files: > > > > > > ∴ wget -r -np ' > > https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.5.0-rc2/' > > > > > > I checked signatures: > > > > > > ∴ ls *.asc|xargs -n1 gpg --verify > > > gpg: assuming signed data in 'apache-storm-2.5.0.pom' > > > gpg: Signature made Tue 25 Jul 2023 09:33:30 AM CDT > > > gpg: using RSA key > > 51379DA8A7AE5B02674EF15C134716AF768D9B6E > > > gpg: Good signature from "Bipin Prasad (For Signing Apache Storm > > release) <bipinpra...@apache.org>" [full] > > > gpg: assuming signed data in 'apache-storm-2.5.0-src.tar.gz' > > > gpg: Signature made Tue 25 Jul 2023 09:34:52 AM CDT > > > gpg: using RSA key > > 51379DA8A7AE5B02674EF15C134716AF768D9B6E > > > gpg: Good signature from "Bipin Prasad (For Signing Apache Storm > > release) <bipinpra...@apache.org>" [full] > > > gpg: assuming signed data in 'apache-storm-2.5.0-src.zip' > > > gpg: Signature made Tue 25 Jul 2023 09:34:52 AM CDT > > > gpg: using RSA key > > 51379DA8A7AE5B02674EF15C134716AF768D9B6E > > > gpg: Good signature from "Bipin Prasad (For Signing Apache Storm > > release) <bipinpra...@apache.org>" [full] > > > gpg: assuming signed data in 'apache-storm-2.5.0.tar.gz' > > > gpg: Signature made Tue 25 Jul 2023 09:33:39 AM CDT > > > gpg: using RSA key > > 51379DA8A7AE5B02674EF15C134716AF768D9B6E > > > gpg: Good signature from "Bipin Prasad (For Signing Apache Storm > > release) <bipinpra...@apache.org>" [full] > > > gpg: assuming signed data in 'apache-storm-2.5.0.zip' > > > gpg: Signature made Tue 25 Jul 2023 09:33:39 AM CDT > > > gpg: using RSA key > > 51379DA8A7AE5B02674EF15C134716AF768D9B6E > > > gpg: Good signature from "Bipin Prasad (For Signing Apache Storm > > release) <bipinpra...@apache.org>" [full] > > > gpg: assuming signed data in 'RELEASE_NOTES.html' > > > gpg: Signature made Tue 25 Jul 2023 09:47:54 AM CDT > > > gpg: using RSA key > > 51379DA8A7AE5B02674EF15C134716AF768D9B6E > > > gpg: Good signature from "Bipin Prasad (For Signing Apache Storm > > release) <bipinpra...@apache.org>" [full] > > > > > > > > > > > > I checked checksums: > > > > > > ∴ ls *.sha512|while read f; do gpg --print-md SHA512 "${f%%.sha512}" | > > diff -s - "$f"; done > > > > > > Each one of these failed because the format does not match what results > > from > > > following the instructions at > > > > > https://github.com/apache/storm/blob/master/RELEASING.md#setting-up-a-vote > > . > > > > > > I retried this way: > > > > > > ∴ ls *.sha512|while read f; do sha512sum "${f%%.sha512}" | diff -s - > > "$f"; done > > > Files - and apache-storm-2.5.0.pom.asc.sha512 are identical > > > Files - and apache-storm-2.5.0.pom.sha512 are identical > > > Files - and apache-storm-2.5.0-src.tar.gz.asc.sha512 are identical > > > Files - and apache-storm-2.5.0-src.tar.gz.sha512 are identical > > > Files - and apache-storm-2.5.0-src.zip.asc.sha512 are identical > > > Files - and apache-storm-2.5.0-src.zip.sha512 are identical > > > Files - and apache-storm-2.5.0.tar.gz.asc.sha512 are identical > > > Files - and apache-storm-2.5.0.tar.gz.sha512 are identical > > > Files - and apache-storm-2.5.0.zip.asc.sha512 are identical > > > Files - and apache-storm-2.5.0.zip.sha512 are identical > > > Files - and RELEASE_NOTES.html.asc.sha512 are identical > > > Files - and RELEASE_NOTES.html.sha512 are identical > > > > > > Looks OK. > > > > > > > > > > > > Unzipped the source, built and ran tests with `mvn clean && mvn install` > > > > > > I needed to use the trick at https://stackoverflow.com/a/70673228 to > > avoid the "Blocked mirror for repositories" error maven throws when trying > > to download with plain HTTP. > > > > > > Eventually, the project failed to build because conjars.org was down: > > > > > > [ERROR] Failed to execute goal on project storm-autocreds: Could not > > resolve dependencies for project > > org.apache.storm:storm-autocreds:jar:2.5.0: Failed to collect dependencies > > at org.apache.hive.hcatalog:hive-webhcat-java-client:jar:2.3.9 -> > > org.apache.hive.hcatalog:hive-hcatalog-core:jar:2.3.9 -> > > org.apache.hive:hive-cli:jar:2.3.9 -> > > org.apache.hive:hive-service:jar:2.3.9 -> > > org.apache.hive:hive-exec:jar:2.3.9 -> > > org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Failed to read > > artifact descriptor for > > org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde: Could not > > transfer artifact org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde > > from/to conjars (http://conjars.org/repo): transfer failed for > > http://conjars.org/repo/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom: > > Connect to conjars.org:80 [conjars.org/54.235.127.59] failed: Connection > > timed out (Connection timed out) -> [Help 1] > > > > > > > > > I gave up and couldn't run the automated tests. > > > > > > > > > > > > Unzipped the distribution, started nimbus, supervisor, logviewer, ui, > > dev-zookeeper, and launched the WordCountTopology build from the source > > directory. > > > > > > This topology started OK, but none of the workers could launch. They > > failed with: > > > > > > 2023-07-27 23:43:38.720 o.a.s.u.Utils Thread-5 [INFO] Worker Process > > 5147794a-1d75-4384-9c01-db08cbceead2:Error: LinkageError occurred while > > loading main class org.apache.storm.LogWriter > > > 2023-07-27 23:43:38.721 o.a.s.u.Utils Thread-5 [INFO] Worker Process > > 5147794a-1d75-4384-9c01-db08cbceead2: java.lang.UnsatisfiedLinkError: > > /usr/lib/jvm/java-11-openjdk/lib/libnio.so: > > /usr/lib/jvm/java-11-openjdk/lib/libnio.so: undefined symbol: > > reuseport_available > > > > > > So I could not test a simple topology either. > > > > > > > > > I also noticed that the value on the UI under Topology Summary > > > > Assigned Generic Resources was "NaN". This seems unintentional. > > > > > > > > > Let me know what I might be missing. I am witholding my vote for now. > > > > > > > > > On Mon, Jun 26, 2023 at 04:15:20PM -0700, Bipin Prasad wrote: > > > > Storm Release candidate version 2.5.0 rc1 is here: > > > > https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.5.0-rc1 > > > > Please vote on this release. > > > > > > > > 1. How to vote is described here: > > > > > > https://github.com/apache/storm/blob/master/RELEASING.md#how-to-vote-on-a-release-candidate > > > > 2. Release notes are here: > > > > > > https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.5.0-rc1/RELEASE_NOTES.html > > > > . > > > > 3. The tag/commit to be voted upon is v2.5.0: > > > > 4. The source archive being votes upon is here: > > > > > > https://dist.apache.org/repos/dist/dev/storm/apache-storm-2.5.0-rc1/apache-storm-2.5.0-src.tar.gz > > > > 5. The release artifacts are signed with the following key: > > > > > > https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x134716af768d9b6e > > in > > > > this file https://www.apache.org/dist/storm/KEYS > > > > > > > > > > > > When voting, please list the actions taken to verify the release. > > > > This vote will be open for at least 72 hours. > > > > > > > > [ ] +1 Release this package as Apache Storm 2.5.0 > > > > [ ] 0 No opinion > > > > [ ] -1 Do not release this package because... > > > > > > > > Thanks to everyone who contributed to this release. > > > > > > > > --Bipin Prasad > > > > > > > > -- > > *Open Source Solutions for Text Engineering* > > http://www.digitalpebble.com > http://digitalpebble.blogspot.com/ > #digitalpebble <http://twitter.com/digitalpebble>
