[jira] [Comment Edited] (ARROW-11135) Using Maven Central artifacts as dependencies produce runtime errors
[ https://issues.apache.org/jira/browse/ARROW-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320525#comment-17320525 ] Julian Hyde edited comment on ARROW-11135 at 4/13/21, 8:37 PM: --- This issue is going to be a blocker for getting CALCITE-2040 merged into master as a "beta" feature. For our purposes, the artifact(s) have to be in Maven central, and have to work on one OS (either macOS or Linux) preferably both. Currently the Maven central artifacts don't work for either. [~kou] and [~wesm], Any suggestions who we could nag to get this fixed for 4.0.0? I know contributors are volunteers, but it's a shame to have Calcite contributions languishing, and the Calcite adapter would be a great way to improve adoption of Arrow/Gandiva. If we can't find anyone, that's fine, but I want to be able to say we tried. was (Author: julianhyde): This issue is going to be a blocker for getting CALCITE-2040 merged into master as a "beta" feature. For our purposes, the artifact(s) have to be in Maven central, and have to work on one OS (either macOS or Linux) preferably both. Currently the Maven central artifacts don't work for either. [~kou] and [~wesm], Any suggestions who we could nag to get this fixed for 4.0.0? I know contributors are volunteers, but it's a shame to have Calcite contributions languishing. If we can't find anyone, that's fine, but I want to be able to say we tried. > Using Maven Central artifacts as dependencies produce runtime errors > > > Key: ARROW-11135 > URL: https://issues.apache.org/jira/browse/ARROW-11135 > Project: Apache Arrow > Issue Type: Bug > Components: Java >Affects Versions: 2.0.0, 3.0.0 >Reporter: Michael Mior >Priority: Major > > I'm working on connecting Arrow/Gandiva with Apache Calcite. Overall the > integration is working well, but I'm having issues . As [suggested on the > mailing > list|https://lists.apache.org/thread.html/r93a4fedb499c746917ab8d62cf5a8db8c93a7f24bc9fac81f90bedaa%40%3Cuser.arrow.apache.org%3E], > using Dremio's public artifacts solves the problem. Between two Apache > projects however, there would be strong preference to use Apache artifacts as > a dependency. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (ARROW-11135) Using Maven Central artifacts as dependencies produce runtime errors
[
https://issues.apache.org/jira/browse/ARROW-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318931#comment-17318931
]
Julian Hyde edited comment on ARROW-11135 at 4/11/21, 7:33 PM:
---
There are no missing packages. But the install instructions should probably say:
* The Gandiva library only works on macOS, and requires that you manually
install protobuf 2.5.
By the way, I compared which files are in the 3.0.0 release jar (which works on
macOS) and the 3.0.0-SNAPSHOT jar (which works on Linux).
{noformat}
$ diff -u <(tar tf ./arrow-gandiva-3.0.0-SNAPSHOT.jar | sort) <(tar tf
./arrow-gandiva-3.0.0.jar
| sort)
--- /dev/fd/63 2021-04-11 12:25:09.0 -0700
+++ /dev/fd/62 2021-04-11 12:25:09.0 -0700
@@ -11,7 +11,10 @@
META-INF/maven/org.apache.arrow.gandiva/arrow-gandiva/pom.xml
Types.proto
git.properties
-libgandiva_jni.so
+libgandiva_jni.300.0.0.dylib
+libgandiva_jni.300.dylib
+libgandiva_jni.a
+libgandiva_jni.dylib
org/
org/apache/
org/apache/arrow/
@@ -188,3 +191,8 @@
org/apache/arrow/gandiva/ipc/GandivaTypes$TreeNode.class
org/apache/arrow/gandiva/ipc/GandivaTypes$TreeNodeOrBuilder.class
org/apache/arrow/gandiva/ipc/GandivaTypes.class
+release/
+release/libgandiva_jni.300.0.0.dylib
+release/libgandiva_jni.300.dylib
+release/libgandiva_jni.a
+release/libgandiva_jni.dylib
{noformat}
It would be awesome if, in the next release, the jar contained ALL of those
files, and then I suppose it would work on both Linux and macOS.
was (Author: julianhyde):
There are no missing packages. But the install instructions should probably say:
* The Gandiva library only works on macOS, and requires that you manually
install protobuf 2.5.
By the way, I compared which files are in the 3.0.0 release jar (which works on
macOS) and the 3.0.0-SNAPSHOT jar (which works on Linux).
{noformat}
$ diff -u <(tar tvf ./arrow-gandiva-3.0.0-SNAPSHOT.jar |awk '{print $NF}'|sort)
<(tar tvf ./arrow-gandiva-3.0.0.jar |awk '{print $NF}'|sort)
--- /dev/fd/63 2021-04-11 12:25:09.0 -0700
+++ /dev/fd/62 2021-04-11 12:25:09.0 -0700
@@ -11,7 +11,10 @@
META-INF/maven/org.apache.arrow.gandiva/arrow-gandiva/pom.xml
Types.proto
git.properties
-libgandiva_jni.so
+libgandiva_jni.300.0.0.dylib
+libgandiva_jni.300.dylib
+libgandiva_jni.a
+libgandiva_jni.dylib
org/
org/apache/
org/apache/arrow/
@@ -188,3 +191,8 @@
org/apache/arrow/gandiva/ipc/GandivaTypes$TreeNode.class
org/apache/arrow/gandiva/ipc/GandivaTypes$TreeNodeOrBuilder.class
org/apache/arrow/gandiva/ipc/GandivaTypes.class
+release/
+release/libgandiva_jni.300.0.0.dylib
+release/libgandiva_jni.300.dylib
+release/libgandiva_jni.a
+release/libgandiva_jni.dylib
{noformat}
It would be awesome if, in the next release, the jar contained ALL of those
files, and then I suppose it would work on both Linux and macOS.
> Using Maven Central artifacts as dependencies produce runtime errors
>
>
> Key: ARROW-11135
> URL: https://issues.apache.org/jira/browse/ARROW-11135
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java
>Affects Versions: 2.0.0
>Reporter: Michael Mior
>Priority: Major
>
> I'm working on connecting Arrow/Gandiva with Apache Calcite. Overall the
> integration is working well, but I'm having issues . As [suggested on the
> mailing
> list|https://lists.apache.org/thread.html/r93a4fedb499c746917ab8d62cf5a8db8c93a7f24bc9fac81f90bedaa%40%3Cuser.arrow.apache.org%3E],
> using Dremio's public artifacts solves the problem. Between two Apache
> projects however, there would be strong preference to use Apache artifacts as
> a dependency.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (ARROW-11135) Using Maven Central artifacts as dependencies produce runtime errors
[
https://issues.apache.org/jira/browse/ARROW-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267509#comment-17267509
]
Kouhei Sutou edited comment on ARROW-11135 at 1/18/21, 8:57 PM:
My mistake. I missed that the JAR was macOS only. The tests pass and all is
fine on openJDK 11. However, on openJDK 8 and 15, I get the following error
after the tests complete which still causes the build to fail. However, I
assume this may be because I did not correctly close some Gandiva resources. I
have edited the code to try to properly free all resources, and I'll watch what
happens with this build.
{noformat}
pure virtual method called
terminate called without an active exception
{noformat}
was (Author: michaelmior):
My mistake. I missed that the JAR was macOS only. The tests pass and all is
fine on openJDK 11. However, on openJDK 8 and 15, I get the following error
after the tests complete which still causes the build to fail. However, I
assume this may be because I did not correctly close some Gandiva resources. I
have edited the code to try to properly free all resources, and I'll watch what
happens with this build.
{{pure virtual method called}}
{{ terminate called without an active exception}}
> Using Maven Central artifacts as dependencies produce runtime errors
>
>
> Key: ARROW-11135
> URL: https://issues.apache.org/jira/browse/ARROW-11135
> Project: Apache Arrow
> Issue Type: Bug
> Components: Java
>Affects Versions: 2.0.0
>Reporter: Michael Mior
>Priority: Major
>
> I'm working on connecting Arrow/Gandiva with Apache Calcite. Overall the
> integration is working well, but I'm having issues . As [suggested on the
> mailing
> list|https://lists.apache.org/thread.html/r93a4fedb499c746917ab8d62cf5a8db8c93a7f24bc9fac81f90bedaa%40%3Cuser.arrow.apache.org%3E],
> using Dremio's public artifacts solves the problem. Between two Apache
> projects however, there would be strong preference to use Apache artifacts as
> a dependency.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
