[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1614343923 OK, I found another work around to exlucde `org.apache.arrow:arrow-memory-netty` since it is a runtime dependency. @jamesnetherton I'm not familar with `google-bigquery` but it seems we have no any test for apache arrow memory? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1614310929 Thanks @zakkak - I've asked `apache-arrow` if they have a plan to backport the fix to `10.0.x` which is used by `com.google.cloud:google-cloud-bigquery`. Regards of substitution, I have no idea how to apply the fix. Any hint? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1614228261 @zakkak No, I don't fix it. The `UnresolvedElementException` only happens in `google-bigquery` extension. I think we have to wait the [fix](https://github.com/apache/arrow/commit/ea4f03ac166e3961b59f29f60dcd160fbed29894) in `apache -arrow`. Do you think is there any room to get it fixed in Quarkus? by some substitutions? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1614022399 @jamesnetherton I've applied this work around to `google-pubsub` and `google-storage` and both of them work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1613243632 Hmm, it dues to the apache-arrow. So we have to wait a new release which includes a [fix](https://github.com/apache/arrow/commit/ea4f03ac166e3961b59f29f60dcd160fbed29894). Or is there any way to do some substitutions? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1613195039 It might be something related to this [change](https://github.com/netty/netty/commit/9412424091eb89f9d55372e38fedbcfcc285dd94#diff-c24e989820523c812b36dea1eb81cbbde7822d060eac7bf136fa96be00956e3f) in netty 4.1.94.Final -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1613170644 @jamesnetherton the work around seems only work in application file such as `integration-tests/google-bigquery/src/main/resources/META-INF/native-image/native-image.properties` @zakkak now we upgrade to quarkus `3.2.0.Final`, it is failing with ``` [INFO] [io.quarkus.deployment.pkg.steps.NativeImageBuildStep] Running Quarkus native-image plugin on native-image 17.0.7 2023-04-18 OpenJDK Runtime Environment Mandrel-23.0.0.0-Final (build 17.0.7+7) OpenJDK 64-Bit Server VM Mandrel-23.0.0.0-Final (build 17.0.7+7, mixed mode) [INFO] [io.quarkus.deployment.pkg.steps.NativeImageBuildRunner] docker run --env LANG=C --rm --user 1000:1000 -v /home/zhfeng/work/zhfeng/camel-quarkus/integration-tests/google-bigquery/target/camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-native-image-source-jar:/project:z --name build-native-KDmxj quay.io/quarkus/ubi-quarkus-mandrel-builder-image:jdk-17 -J-Djava.util.logging.manager=org.jboss.logmanager.LogManager -J-Dsun.nio.ch.maxUpdateArraySize=100 -J-Dlogging.initial-configurator.min-level=500 -J-Dvertx.logger-delegate-factory-class-name=io.quarkus.vertx.core.runtime.VertxLogDelegateFactory -J-Dvertx.disableDnsResolver=true -J-Dio.netty.leakDetection.level=DISABLED -J-Dio.netty.allocator.maxOrder=3 -J-Duser.language=zh -J-Duser.country=CN -J-Dfile.encoding=UTF-8 --features=io.quarkus.runner.Feature,io.quarkus.runtime.graal.DisableLoggingFeature -J--add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED -J--add-opens=java.base/java.text=ALL-UNNAMED -J--ad d-opens=java.base/java.io=ALL-UNNAMED -J--add-opens=java.base/java.lang.invoke=ALL-UNNAMED -J--add-opens=java.base/java.util=ALL-UNNAMED -H:BuildOutputJSONFile=camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner-build-output-stats.json -H:+AllowFoldMethods -J-Djava.awt.headless=true --no-fallback --link-at-build-time -H:+ReportExceptionStackTraces -H:-AddAllCharsets --enable-url-protocols=http -H:-UseServiceLoaderFeature -H:+StackTrace -J--add-exports=org.graalvm.sdk/org.graalvm.nativeimage.impl=ALL-UNNAMED --exclude-config io\.netty\.netty-codec /META-INF/native-image/io\.netty/netty-codec/generated/handlers/reflect-config\.json --exclude-config io\.netty\.netty-handler /META-INF/native-image/io\.netty/netty-handler/generated/handlers/reflect-config\.json camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner -jar camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner.jar GraalVM Native Image: Generating 'camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner' (executable)... [1/8] Initializing... (7.3s @ 0.35GB) Java version: 17.0.7+7, vendor version: Mandrel-23.0.0.0-Final Graal compiler: optimization level: 2, target machine: x86-64-v3 C compiler: gcc (redhat, x86_64, 8.5.0) Garbage collector: Serial GC (max heap size: 80% of RAM) 8 user-specific feature(s) - com.google.api.gax.grpc.nativeimage.GrpcNettyFeature - com.google.api.gax.grpc.nativeimage.ProtobufMessageFeature - com.google.api.gax.nativeimage.GoogleJsonClientFeature - com.google.api.gax.nativeimage.OpenCensusFeature - com.oracle.svm.thirdparty.gson.GsonFeature - io.quarkus.runner.Feature: Auto-generated class by Quarkus from the existing extensions - io.quarkus.runtime.graal.DisableLoggingFeature: Disables INFO logging during the analysis phase - org.eclipse.angus.activation.nativeimage.AngusActivationFeature Warning: RecomputeFieldValue.FieldOffset automatic substitution failed. The automatic substitution registration was attempted because a call to sun.misc.Unsafe.objectFieldOffset(Field) was detected in the static initializer of com.google.protobuf.UnsafeUtil. Detailed failure reason(s): The argument of sun.misc.Unsafe.objectFieldOffset(java.lang.reflect.Field) is not a constant value or a field load that can be constant-folded., Could not determine the field where the value produced by the call to sun.misc.Unsafe.objectFieldOffset(Field) for the field offset computation is stored. The call is not directly followed by a field store or by a sign extend node followed directly by a field store. [2/8] Performing analysis... [] (24.1s @ 6.07GB) 15,321 (79.61%) of 19,245 types reachable 21,672 (57.86%) of 37,454 fields reachable 74,150 (52.75%) of 140,577 methods reachable 5,378 types, 1,668 fields, and 11,565 methods registered
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1613049608 OK, thanks for clarifying and I'll prepare for a PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1612575045 Yeah, I added `-H:+RunReachabilityHandlersConcurrently` in `integration-tests/google-bigquery/pom.xml` The output is like ``` [INFO] [io.quarkus.deployment.pkg.steps.NativeImageBuildStep] Running Quarkus native-image plugin on native-image 17.0.7 2023-04-18 OpenJDK Runtime Environment Mandrel-23.0.0.0-Final (build 17.0.7+7) OpenJDK 64-Bit Server VM Mandrel-23.0.0.0-Final (build 17.0.7+7, mixed mode) [INFO] [io.quarkus.deployment.pkg.steps.NativeImageBuildRunner] docker run --env LANG=C --rm --user 1000:1000 -v /home/zhfeng/work/zhfeng/camel-quarkus/integration-tests/google-bigquery/target/camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-native-image-source-jar:/project:z --name build-native-ueGYN quay.io/quarkus/ubi-quarkus-mandrel-builder-image:jdk-17 -J-Dsun.nio.ch.maxUpdateArraySize=100 -J-Djava.util.logging.manager=org.jboss.logmanager.LogManager -J-Dlogging.initial-configurator.min-level=500 -J-Dvertx.logger-delegate-factory-class-name=io.quarkus.vertx.core.runtime.VertxLogDelegateFactory -J-Dvertx.disableDnsResolver=true -J-Dio.netty.leakDetection.level=DISABLED -J-Dio.netty.allocator.maxOrder=3 -J-Duser.language=zh -J-Duser.country=CN -J-Dfile.encoding=UTF-8 --features=io.quarkus.runner.Feature,io.quarkus.runtime.graal.DisableLoggingFeature -J--add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED -J--add-opens=java.base/java.text=ALL-UNNAMED -J--ad d-opens=java.base/java.io=ALL-UNNAMED -J--add-opens=java.base/java.lang.invoke=ALL-UNNAMED -J--add-opens=java.base/java.util=ALL-UNNAMED -H:BuildOutputJSONFile=camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner-build-output-stats.json -H:+RunReachabilityHandlersConcurrently -H:+AllowFoldMethods -J-Djava.awt.headless=true --no-fallback --link-at-build-time -H:+ReportExceptionStackTraces -H:-AddAllCharsets --enable-url-protocols=http -H:-UseServiceLoaderFeature -H:+StackTrace -J--add-exports=org.graalvm.sdk/org.graalvm.nativeimage.impl=ALL-UNNAMED --exclude-config io\.netty\.netty-codec /META-INF/native-image/io\.netty/netty-codec/generated/handlers/reflect-config\.json --exclude-config io\.netty\.netty-handler /META-INF/native-image/io\.netty/netty-handler/generated/handlers/reflect-config\.json camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner -jar camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner.jar GraalVM Native Image: Generating 'camel-quarkus-integration-test-google-bigquery-3.0.0-SNAPSHOT-runner' (executable)... [1/8] Initializing... (7.2s @ 0.34GB) Java version: 17.0.7+7, vendor version: Mandrel-23.0.0.0-Final Graal compiler: optimization level: 2, target machine: x86-64-v3 C compiler: gcc (redhat, x86_64, 8.5.0) Garbage collector: Serial GC (max heap size: 80% of RAM) 8 user-specific feature(s) - com.google.api.gax.grpc.nativeimage.GrpcNettyFeature - com.google.api.gax.grpc.nativeimage.ProtobufMessageFeature - com.google.api.gax.nativeimage.GoogleJsonClientFeature - com.google.api.gax.nativeimage.OpenCensusFeature - com.oracle.svm.thirdparty.gson.GsonFeature - io.quarkus.runner.Feature: Auto-generated class by Quarkus from the existing extensions - io.quarkus.runtime.graal.DisableLoggingFeature: Disables INFO logging during the analysis phase - org.eclipse.angus.activation.nativeimage.AngusActivationFeature Warning: RecomputeFieldValue.FieldOffset automatic substitution failed. The automatic substitution registration was attempted because a call to sun.misc.Unsafe.objectFieldOffset(Field) was detected in the static initializer of com.google.protobuf.UnsafeUtil. Detailed failure reason(s): The argument of sun.misc.Unsafe.objectFieldOffset(java.lang.reflect.Field) is not a constant value or a field load that can be constant-folded., Could not determine the field where the value produced by the call to sun.misc.Unsafe.objectFieldOffset(Field) for the field offset computation is stored. The call is not directly followed by a field store or by a sign extend node followed directly by a field store. [2/8] Performing analysis... [] (25.0s @ 3.50GB) 16,967 (84.92%) of 19,981 types reachable 25,097 (60.48%) of 41,495 fields reachable 86,267 (62.59%) of 137,820 methods reachable 5,448 types, 1,267 fields, and 8,656 methods registered for reflection ---
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1612286698 Well, I still got some random results with - `java.lang.NullPointerException: Cannot invoke "java.util.Set.iterator()" because "triggers" is null` - `undefined reference to 'Java_com_sun_management_internal_OperatingSystemImpl_initialize0' collect2: error: ld returned 1 exit status` - some refelection errors -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1611619316 Thanks @zakkak ! I just tried with `-Dquarkus.native.additional-build-args=-H:+RunReachabilityHandlersConcurrently` but it is still not working. Is there anything I missed or what dependecies should be added? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1611215007 You have got a success build? Add some reflective class configurations? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [camel-quarkus] zhfeng commented on issue #5006: [Mandrel 23.0.0] google-bigquery integration test native compilation fails
zhfeng commented on issue #5006: URL: https://github.com/apache/camel-quarkus/issues/5006#issuecomment-1608688596 I think there might be something wrong during the graal perform static analysis. The error about `undefined reference to 'Java_com_sun_management_internal_OperatingSystemImpl_initialize0'` looks related to this [commit](https://github.com/zakkak/mandrel/commit/7662df010649091d6598912cc7c8cc521c154455) The `OPERATING_SYSTEM_IMPL` class is not reachable but actually it is. Then sometimes we get the native image build successful and sometimes not. I have no any idea about how the static analysis work here. @zakkak any hint? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
