[jira] [Commented] (NIFI-9527) nifi-hive-nar fails to load because of the old snappy-java jar
[
https://issues.apache.org/jira/browse/NIFI-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492875#comment-17492875
]
ASF subversion and git services commented on NIFI-9527:
---
Commit 7dfbf99d5f2ab0d05e4ee524718f1107a7bc7eda in nifi's branch
refs/heads/main from David Handermann
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=7dfbf99 ]
NIFI-9527 Upgraded snappy-java to 1.1.8.4
- Set managed version in root Maven configuration
Signed-off-by: Matthew Burgess
This closes #5760
> nifi-hive-nar fails to load because of the old snappy-java jar
> --
>
> Key: NIFI-9527
> URL: https://issues.apache.org/jira/browse/NIFI-9527
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
>Affects Versions: 1.15.0, 1.15.2
> Environment: Linux 3.10.0-1160.49.1.el7.x86_64 #1 SMP Tue Nov 9
> 16:09:48 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
>Reporter: Saurabh B
>Assignee: David Handermann
>Priority: Minor
> Fix For: 1.16.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> nifi-hive-nar has old version of snappy-java jar (snappy-java-1.0.5.jar)
> which fails to load. New version of snappy-java-1.1.8.4.jar works.
>
> {{2022-01-03 12:11:19,126 ERROR [main] org.apache.nifi.NiFi Failure to launch
> NiFi}}
> {{org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null}}
> {{ at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:239)}}
> {{ at org.xerial.snappy.Snappy.(Snappy.java:48)}}
> {{ at
> org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)}}
> {{ at java.base/java.lang.Class.forName0(Native Method)}}
> {{ at java.base/java.lang.Class.forName(Class.java:398)}}
> {{ at
> org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:330)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)}}
> {{ at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1139)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:170)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:82)}}
> {{ at org.apache.nifi.NiFi.main(NiFi.java:330)}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (NIFI-9527) nifi-hive-nar fails to load because of the old snappy-java jar
[
https://issues.apache.org/jira/browse/NIFI-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490631#comment-17490631
]
David Handermann commented on NIFI-9527:
I was not able to reproduce this issue on Azul Zulu Java 11.0.12 running on
macOS 12.2 with the current main branch of NiFi 1.16.0-SNAPSHOT.
However, running under Java 17.0.2 throws a similar exception on startup.
{noformat}
org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] Unable to make
protected final java.lang.Class
java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
throws java.lang.ClassFormatError accessible: module java.base does not "opens
java.lang" to unnamed module @7f5179be
at
org.xerial.snappy.SnappyLoader.injectSnappyNativeLoader(SnappyLoader.java:297)
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:227)
at org.xerial.snappy.Snappy.(Snappy.java:48)
at
org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:467)
at
org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:334)
at
org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)
at
org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1014)
at org.apache.nifi.NiFi.(NiFi.java:170)
at org.apache.nifi.NiFi.(NiFi.java:82)
at org.apache.nifi.NiFi.main(NiFi.java:330)
{noformat}
The error is certainly related an older version of snappy-java 1.0.5 packaged
in {{{}nifi-hive-nar{}}}. [Version
1.1.7.3|https://github.com/xerial/snappy-java/blob/master/Milestone.md]
introduced support for Java 9 modules. Version 1.1.7.6 set the minimum Java
version 8, but there do not appear to be any other notable changes.
Upgrading module references to a newer version of snappy-java looks like an
improvement to address multiple issues.
> nifi-hive-nar fails to load because of the old snappy-java jar
> --
>
> Key: NIFI-9527
> URL: https://issues.apache.org/jira/browse/NIFI-9527
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
>Affects Versions: 1.15.0, 1.15.2
> Environment: Linux 3.10.0-1160.49.1.el7.x86_64 #1 SMP Tue Nov 9
> 16:09:48 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
>Reporter: Saurabh B
>Assignee: David Handermann
>Priority: Minor
>
> nifi-hive-nar has old version of snappy-java jar (snappy-java-1.0.5.jar)
> which fails to load. New version of snappy-java-1.1.8.4.jar works.
>
> {{2022-01-03 12:11:19,126 ERROR [main] org.apache.nifi.NiFi Failure to launch
> NiFi}}
> {{org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null}}
> {{ at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:239)}}
> {{ at org.xerial.snappy.Snappy.(Snappy.java:48)}}
> {{ at
> org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)}}
> {{ at java.base/java.lang.Class.forName0(Native Method)}}
> {{ at java.base/java.lang.Class.forName(Class.java:398)}}
> {{ at
> org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:330)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)}}
> {{ at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1139)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:170)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:82)}}
> {{ at org.apache.nifi.NiFi.main(NiFi.java:330)}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (NIFI-9527) nifi-hive-nar fails to load because of the old snappy-java jar
[
https://issues.apache.org/jira/browse/NIFI-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480272#comment-17480272
]
Saurabh B commented on NIFI-9527:
-
This issue is not observed on upgrade 1.14.0 -> 1.15.3. I did not try upgrade
to 1.15.2, let me know if you want me to try.
> nifi-hive-nar fails to load because of the old snappy-java jar
> --
>
> Key: NIFI-9527
> URL: https://issues.apache.org/jira/browse/NIFI-9527
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
>Affects Versions: 1.15.0, 1.15.2
> Environment: Linux 3.10.0-1160.49.1.el7.x86_64 #1 SMP Tue Nov 9
> 16:09:48 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
>Reporter: Saurabh B
>Priority: Minor
>
> nifi-hive-nar has old version of snappy-java jar (snappy-java-1.0.5.jar)
> which fails to load. New version of snappy-java-1.1.8.4.jar works.
>
> {{2022-01-03 12:11:19,126 ERROR [main] org.apache.nifi.NiFi Failure to launch
> NiFi}}
> {{org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null}}
> {{ at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:239)}}
> {{ at org.xerial.snappy.Snappy.(Snappy.java:48)}}
> {{ at
> org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)}}
> {{ at java.base/java.lang.Class.forName0(Native Method)}}
> {{ at java.base/java.lang.Class.forName(Class.java:398)}}
> {{ at
> org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:330)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)}}
> {{ at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1139)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:170)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:82)}}
> {{ at org.apache.nifi.NiFi.main(NiFi.java:330)}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (NIFI-9527) nifi-hive-nar fails to load because of the old snappy-java jar
[
https://issues.apache.org/jira/browse/NIFI-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475053#comment-17475053
]
Saurabh B commented on NIFI-9527:
-
[~mattyb149] - I saw this behavior in 1.15.0 and 1.15.2. I have tested new jar
release, which worked, however applied the below fix in bootstrap.conf (as
found ->
https://community.cloudera.com/t5/Community-Articles/NiFi-org-xerial-snappy-SnappyError/ta-p/248734)
java.arg.snappy=-Dorg.xerial.snappy.tempdir=/usr/hdf/current/nifi/tmp
No change was done to which starts NiFi or the permission of the Java temp
folder.
The issue was observed in a new install of NiFi 1.15.x and upgrade from 1.12.1.
Next week I plan to upgrade 1.14.0 -> 1.15.2 and will update my findings
(1.14.0 was upgraded from 1.13.x without this issue with the same java version).
> nifi-hive-nar fails to load because of the old snappy-java jar
> --
>
> Key: NIFI-9527
> URL: https://issues.apache.org/jira/browse/NIFI-9527
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
>Affects Versions: 1.15.0, 1.15.2
> Environment: Linux 3.10.0-1160.49.1.el7.x86_64 #1 SMP Tue Nov 9
> 16:09:48 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
>Reporter: Saurabh B
>Priority: Minor
>
> nifi-hive-nar has old version of snappy-java jar (snappy-java-1.0.5.jar)
> which fails to load. New version of snappy-java-1.1.8.4.jar works.
>
> {{2022-01-03 12:11:19,126 ERROR [main] org.apache.nifi.NiFi Failure to launch
> NiFi}}
> {{org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null}}
> {{ at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:239)}}
> {{ at org.xerial.snappy.Snappy.(Snappy.java:48)}}
> {{ at
> org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)}}
> {{ at java.base/java.lang.Class.forName0(Native Method)}}
> {{ at java.base/java.lang.Class.forName(Class.java:398)}}
> {{ at
> org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:330)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)}}
> {{ at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1139)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:170)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:82)}}
> {{ at org.apache.nifi.NiFi.main(NiFi.java:330)}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (NIFI-9527) nifi-hive-nar fails to load because of the old snappy-java jar
[
https://issues.apache.org/jira/browse/NIFI-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475050#comment-17475050
]
Saurabh B commented on NIFI-9527:
-
The java version is
$ java -version
openjdk version "11.0.12" 2021-07-20 LTS
OpenJDK Runtime Environment 18.9 (build 11.0.12+7-LTS)
OpenJDK 64-Bit Server VM 18.9 (build 11.0.12+7-LTS, mixed mode)
> nifi-hive-nar fails to load because of the old snappy-java jar
> --
>
> Key: NIFI-9527
> URL: https://issues.apache.org/jira/browse/NIFI-9527
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
>Affects Versions: 1.15.0, 1.15.2
> Environment: Linux 3.10.0-1160.49.1.el7.x86_64 #1 SMP Tue Nov 9
> 16:09:48 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
>Reporter: Saurabh B
>Priority: Minor
>
> nifi-hive-nar has old version of snappy-java jar (snappy-java-1.0.5.jar)
> which fails to load. New version of snappy-java-1.1.8.4.jar works.
>
> {{2022-01-03 12:11:19,126 ERROR [main] org.apache.nifi.NiFi Failure to launch
> NiFi}}
> {{org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null}}
> {{ at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:239)}}
> {{ at org.xerial.snappy.Snappy.(Snappy.java:48)}}
> {{ at
> org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)}}
> {{ at java.base/java.lang.Class.forName0(Native Method)}}
> {{ at java.base/java.lang.Class.forName(Class.java:398)}}
> {{ at
> org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:330)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)}}
> {{ at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1139)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:170)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:82)}}
> {{ at org.apache.nifi.NiFi.main(NiFi.java:330)}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (NIFI-9527) nifi-hive-nar fails to load because of the old snappy-java jar
[
https://issues.apache.org/jira/browse/NIFI-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475009#comment-17475009
]
Joe Witt commented on NIFI-9527:
[~saurabhb]WHat version of Java are you running? We haven't been able to
reproduce this issue and it appears to happen on startup so it must be common.
We need more data on your setup so we can try to reproduce it.
> nifi-hive-nar fails to load because of the old snappy-java jar
> --
>
> Key: NIFI-9527
> URL: https://issues.apache.org/jira/browse/NIFI-9527
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
>Affects Versions: 1.15.0, 1.15.2
> Environment: Linux 3.10.0-1160.49.1.el7.x86_64 #1 SMP Tue Nov 9
> 16:09:48 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
>Reporter: Saurabh B
>Priority: Minor
>
> nifi-hive-nar has old version of snappy-java jar (snappy-java-1.0.5.jar)
> which fails to load. New version of snappy-java-1.1.8.4.jar works.
>
> {{2022-01-03 12:11:19,126 ERROR [main] org.apache.nifi.NiFi Failure to launch
> NiFi}}
> {{org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null}}
> {{ at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:239)}}
> {{ at org.xerial.snappy.Snappy.(Snappy.java:48)}}
> {{ at
> org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)}}
> {{ at java.base/java.lang.Class.forName0(Native Method)}}
> {{ at java.base/java.lang.Class.forName(Class.java:398)}}
> {{ at
> org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:330)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)}}
> {{ at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1139)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:170)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:82)}}
> {{ at org.apache.nifi.NiFi.main(NiFi.java:330)}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (NIFI-9527) nifi-hive-nar fails to load because of the old snappy-java jar
[
https://issues.apache.org/jira/browse/NIFI-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475006#comment-17475006
]
Matt Burgess commented on NIFI-9527:
>From the stack trace it looks like it would affect everyone but 1.15.x has
>been out long enough that i would've expected to hear about it sooner. Did you
>change the user that starts NiFi, or have more permissions been put on Java's
>temp folder?
> nifi-hive-nar fails to load because of the old snappy-java jar
> --
>
> Key: NIFI-9527
> URL: https://issues.apache.org/jira/browse/NIFI-9527
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
>Affects Versions: 1.15.0, 1.15.2
> Environment: Linux 3.10.0-1160.49.1.el7.x86_64 #1 SMP Tue Nov 9
> 16:09:48 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
>Reporter: Saurabh B
>Priority: Minor
>
> nifi-hive-nar has old version of snappy-java jar (snappy-java-1.0.5.jar)
> which fails to load. New version of snappy-java-1.1.8.4.jar works.
>
> {{2022-01-03 12:11:19,126 ERROR [main] org.apache.nifi.NiFi Failure to launch
> NiFi}}
> {{org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null}}
> {{ at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:239)}}
> {{ at org.xerial.snappy.Snappy.(Snappy.java:48)}}
> {{ at
> org.apache.nifi.processors.hive.PutHiveStreaming.(PutHiveStreaming.java:158)}}
> {{ at java.base/java.lang.Class.forName0(Native Method)}}
> {{ at java.base/java.lang.Class.forName(Class.java:398)}}
> {{ at
> org.apache.nifi.nar.StandardExtensionDiscoveringManager.getClass(StandardExtensionDiscoveringManager.java:330)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.documentConfigurableComponent(DocGenerator.java:100)}}
> {{ at
> org.apache.nifi.documentation.DocGenerator.generate(DocGenerator.java:65)}}
> {{ at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:1139)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:170)}}
> {{ at org.apache.nifi.NiFi.(NiFi.java:82)}}
> {{ at org.apache.nifi.NiFi.main(NiFi.java:330)}}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
