aglinxinyuan opened a new issue, #4438:
URL: https://github.com/apache/texera/issues/4438
### What happened?
After the recent sbt-fs2-grpc upgrade in PR #4423t, the runtime gRPC version
is resolved to a newer version that is incompatible with the current Arrow
Flight 14.0.1 dependency.
Root cause:
- Arrow Flight 14.0.1 expects an older gRPC runtime.
- The newer build dependency resolution brings in a newer gRPC version.
- The old internal gRPC class AbstractServerImplBuilder is no longer
available.
### How to reproduce?
Python worker startup can fail when creating the Arrow Flight server with:
`java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder`
The failure happens in:
`org.apache.arrow.flight.FlightServer$Builder.build`
### Version
1.1.0-incubating (Pre-release/Master)
### Commit Hash (Optional)
_No response_
### What browsers are you seeing the problem on?
_No response_
### Relevant log output
```shell
[2026-04-21 17:35:21,752] [WARN] [WF185-LoopStart-d9fe65-main-0]
[PythonWorkflowWorker] [Amber-pekko.actor.default-dispatcher-4] - actor
initialization failed due to exception
java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder
at java.base/java.lang.ClassLoader.defineClass1(Native Method)
at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1022)
at
java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
at
java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:800)
at
java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:698)
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:621)
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:579)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
at
org.apache.arrow.flight.FlightServer$Builder.build(FlightServer.java:233)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonProxyServer.<init>(PythonProxyServer.scala:169)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.startProxyServer(PythonWorkflowWorker.scala:151)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.initState(PythonWorkflowWorker.scala:141)
at
org.apache.texera.amber.engine.architecture.common.WorkflowActor.preStart(WorkflowActor.scala:232)
at org.apache.pekko.actor.Actor.aroundPreStart(Actor.scala:558)
at org.apache.pekko.actor.Actor.aroundPreStart$(Actor.scala:558)
at
org.apache.texera.amber.engine.architecture.common.WorkflowActor.aroundPreStart(WorkflowActor.scala:78)
at org.apache.pekko.actor.ActorCell.create(ActorCell.scala:653)
at org.apache.pekko.actor.ActorCell.invokeAll$1(ActorCell.scala:523)
at org.apache.pekko.actor.ActorCell.systemInvoke(ActorCell.scala:545)
at
org.apache.pekko.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:298)
at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:233)
at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:246)
at
java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at
java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at
java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at
java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at
java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Caused by: java.lang.ClassNotFoundException:
io.grpc.internal.AbstractServerImplBuilder
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
... 28 common frames omitted
[2026-04-21 17:35:21,756] [ERROR] [org.apache.pekko.actor.ActorSystemImpl]
[Amber-pekko.actor.default-dispatcher-22] - Uncaught error from thread
[Amber-pekko.actor.default-dispatcher-4]:
io/grpc/internal/AbstractServerImplBuilder, shutting down JVM since
'pekko.jvm-exit-on-fatal-error' is enabled for ActorSystem[Amber]
java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder
at java.base/java.lang.ClassLoader.defineClass1(Native Method)
at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1022)
at
java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
at
java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:800)
at
java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:698)
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:621)
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:579)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
at
org.apache.arrow.flight.FlightServer$Builder.build(FlightServer.java:233)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonProxyServer.<init>(PythonProxyServer.scala:169)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.startProxyServer(PythonWorkflowWorker.scala:151)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.initState(PythonWorkflowWorker.scala:141)
at
org.apache.texera.amber.engine.architecture.common.WorkflowActor.preStart(WorkflowActor.scala:232)
at org.apache.pekko.actor.Actor.aroundPreStart(Actor.scala:558)
at org.apache.pekko.actor.Actor.aroundPreStart$(Actor.scala:558)
at
org.apache.texera.amber.engine.architecture.common.WorkflowActor.aroundPreStart(WorkflowActor.scala:78)
at org.apache.pekko.actor.ActorCell.create(ActorCell.scala:653)
at org.apache.pekko.actor.ActorCell.invokeAll$1(ActorCell.scala:523)
at org.apache.pekko.actor.ActorCell.systemInvoke(ActorCell.scala:545)
at
org.apache.pekko.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:298)
at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:233)
at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:246)
at
java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at
java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at
java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at
java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at
java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Caused by: java.lang.ClassNotFoundException:
io.grpc.internal.AbstractServerImplBuilder
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
... 28 common frames omitted
[2026-04-21 17:35:21,761] [INFO]
[org.apache.pekko.actor.CoordinatedShutdown]
[Amber-pekko.actor.default-dispatcher-22] - Running CoordinatedShutdown with
reason [JvmExitReason]
Uncaught error from thread [Amber-pekko.actor.default-dispatcher-4]:
io/grpc/internal/AbstractServerImplBuilder, shutting down JVM since
'pekko.jvm-exit-on-fatal-error' is enabled for ActorSystem[Amber]
java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder
at java.base/java.lang.ClassLoader.defineClass1(Native Method)
at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1022)
at
java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
at
java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:800)
at
java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:698)
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:621)
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:579)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
at
org.apache.arrow.flight.FlightServer$Builder.build(FlightServer.java:233)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonProxyServer.<init>(PythonProxyServer.scala:169)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.startProxyServer(PythonWorkflowWorker.scala:151)
at
org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.initState(PythonWorkflowWorker.scala:141)
at
org.apache.texera.amber.engine.architecture.common.WorkflowActor.preStart(WorkflowActor.scala:232)
at org.apache.pekko.actor.Actor.aroundPreStart(Actor.scala:558)
at org.apache.pekko.actor.Actor.aroundPreStart$(Actor.scala:558)
at
org.apache.texera.amber.engine.architecture.common.WorkflowActor.aroundPreStart(WorkflowActor.scala:78)
at org.apache.pekko.actor.ActorCell.create(ActorCell.scala:653)
at org.apache.pekko.actor.ActorCell.invokeAll$1(ActorCell.scala:523)
at org.apache.pekko.actor.ActorCell.systemInvoke(ActorCell.scala:545)
at
org.apache.pekko.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:298)
at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:233)
at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:246)
at
java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
at
java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
at
java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
at
java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
at
java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
Caused by: java.lang.ClassNotFoundException:
io.grpc.internal.AbstractServerImplBuilder
at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
... 28 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
