[
https://issues.apache.org/jira/browse/FLINK-33595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17830515#comment-17830515
]
Ryan Skraba edited comment on FLINK-33595 at 3/25/24 2:24 PM:
--------------------------------------------------------------
There might be a bit more happening here in the stack trace:
[https://github.com/apache/flink/actions/runs/8414062328/job/23037457625#step:10:24129]
, but it also end up with a ModuleNotFoundError in the middle of it:
{code:java}
Mar 25 02:39:42 if answer[1] == REFERENCE_TYPE:
Mar 25 02:39:42 raise Py4JJavaError(
Mar 25 02:39:42 "An error occurred while calling
{0}{1}{2}.\n".
Mar 25 02:39:42 > format(target_id, ".", name), value)
Mar 25 02:39:42 E py4j.protocol.Py4JJavaError: An error
occurred while calling o3678.await.
Mar 25 02:39:42 E : java.util.concurrent.ExecutionException:
org.apache.flink.table.api.TableException: Failed to wait job finish
Mar 25 02:39:42 E at
java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
Mar 25 02:39:42 E at
java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.TableResultImpl.awaitInternal(TableResultImpl.java:118)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.TableResultImpl.await(TableResultImpl.java:81)
Mar 25 02:39:42 E at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Mar 25 02:39:42 E at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
Mar 25 02:39:42 E at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Mar 25 02:39:42 E at
java.base/java.lang.reflect.Method.invoke(Method.java:568)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:374)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.Gateway.invoke(Gateway.java:282)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.commands.CallCommand.execute(CallCommand.java:79)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.GatewayConnection.run(GatewayConnection.java:238)
Mar 25 02:39:42 E at
java.base/java.lang.Thread.run(Thread.java:833)
Mar 25 02:39:42 E Caused by:
org.apache.flink.table.api.TableException: Failed to wait job finish
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.InsertResultProvider.hasNext(InsertResultProvider.java:85)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.InsertResultProvider.isFirstRowReady(InsertResultProvider.java:71)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.TableResultImpl.lambda$awaitInternal$1(TableResultImpl.java:105)
{code}
was (Author: ryanskraba):
There might be a bit more happening here in the stack treace:
[https://github.com/apache/flink/actions/runs/8414062328/job/23037457625#step:10:24129]
, but it also end up with a ModuleNotFoundError in the middle of it:
{code:java}
Mar 25 02:39:42 if answer[1] == REFERENCE_TYPE:
Mar 25 02:39:42 raise Py4JJavaError(
Mar 25 02:39:42 "An error occurred while calling
{0}{1}{2}.\n".
Mar 25 02:39:42 > format(target_id, ".", name), value)
Mar 25 02:39:42 E py4j.protocol.Py4JJavaError: An error
occurred while calling o3678.await.
Mar 25 02:39:42 E : java.util.concurrent.ExecutionException:
org.apache.flink.table.api.TableException: Failed to wait job finish
Mar 25 02:39:42 E at
java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
Mar 25 02:39:42 E at
java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.TableResultImpl.awaitInternal(TableResultImpl.java:118)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.TableResultImpl.await(TableResultImpl.java:81)
Mar 25 02:39:42 E at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Mar 25 02:39:42 E at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
Mar 25 02:39:42 E at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Mar 25 02:39:42 E at
java.base/java.lang.reflect.Method.invoke(Method.java:568)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:374)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.Gateway.invoke(Gateway.java:282)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.commands.CallCommand.execute(CallCommand.java:79)
Mar 25 02:39:42 E at
org.apache.flink.api.python.shaded.py4j.GatewayConnection.run(GatewayConnection.java:238)
Mar 25 02:39:42 E at
java.base/java.lang.Thread.run(Thread.java:833)
Mar 25 02:39:42 E Caused by:
org.apache.flink.table.api.TableException: Failed to wait job finish
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.InsertResultProvider.hasNext(InsertResultProvider.java:85)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.InsertResultProvider.isFirstRowReady(InsertResultProvider.java:71)
Mar 25 02:39:42 E at
org.apache.flink.table.api.internal.TableResultImpl.lambda$awaitInternal$1(TableResultImpl.java:105)
{code}
> StreamDependencyTests.test_set_requirements_with_cached_directory failed with
> ModuleNotFoundError
> -------------------------------------------------------------------------------------------------
>
> Key: FLINK-33595
> URL: https://issues.apache.org/jira/browse/FLINK-33595
> Project: Flink
> Issue Type: Bug
> Components: API / Python
> Affects Versions: 1.18.0
> Reporter: Matthias Pohl
> Priority: Major
> Labels: test-stability
>
> [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=54682&view=logs&j=b53e1644-5cb4-5a3b-5d48-f523f39bcf06&t=b68c9f5c-04c9-5c75-3862-a3a27aabbce3&l=24663]
> {code:java}
> [...]
> Nov 18 02:53:13 E ModuleNotFoundError: No module named
> 'python_package1'
> Nov 18 02:53:13 E
> Nov 18 02:53:13 E at
> java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
> Nov 18 02:53:13 E at
> java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
> Nov 18 02:53:13 E at
> org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:61)
> Nov 18 02:53:13 E at
> org.apache.beam.runners.fnexecution.control.SdkHarnessClient$BundleProcessor$ActiveBundle.close(SdkHarnessClient.java:504)
> Nov 18 02:53:13 E at
> org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$SimpleStageBundleFactory$1.close(DefaultJobBundleFactory.java:555)
> Nov 18 02:53:13 E at
> org.apache.flink.streaming.api.runners.python.beam.BeamPythonFunctionRunner.finishBundle(BeamPythonFunctionRunner.java:421)
> Nov 18 02:53:13 E ... 7 more
> Nov 18 02:53:13 E Caused by: java.lang.RuntimeException:
> Error received from SDK harness for instruction 1: Traceback (most recent
> call last):
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/.tox/py37-cython/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 295, in _execute
> Nov 18 02:53:13 E response = task()
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/.tox/py37-cython/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 370, in <lambda>
> Nov 18 02:53:13 E lambda:
> self.create_worker().do_instruction(request), request)
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/.tox/py37-cython/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 630, in do_instruction
> Nov 18 02:53:13 E getattr(request, request_type),
> request.instruction_id)
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/.tox/py37-cython/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 667, in process_bundle
> Nov 18 02:53:13 E
> bundle_processor.process_bundle(instruction_id))
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/.tox/py37-cython/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
> line 1062, in process_bundle
> Nov 18 02:53:13 E element.data)
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/.tox/py37-cython/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
> line 231, in process_encoded
> Nov 18 02:53:13 E self.output(decoded_value)
> Nov 18 02:53:13 E File
> "apache_beam/runners/worker/operations.py", line 526, in
> apache_beam.runners.worker.operations.Operation.output
> Nov 18 02:53:13 E File
> "apache_beam/runners/worker/operations.py", line 528, in
> apache_beam.runners.worker.operations.Operation.output
> Nov 18 02:53:13 E File
> "apache_beam/runners/worker/operations.py", line 237, in
> apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
> Nov 18 02:53:13 E File
> "apache_beam/runners/worker/operations.py", line 240, in
> apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
> Nov 18 02:53:13 E File
> "pyflink/fn_execution/beam/beam_operations_fast.pyx", line 169, in
> pyflink.fn_execution.beam.beam_operations_fast.FunctionOperation.process
> Nov 18 02:53:13 E with self.scoped_process_state:
> Nov 18 02:53:13 E File
> "pyflink/fn_execution/beam/beam_operations_fast.pyx", line 196, in
> pyflink.fn_execution.beam.beam_operations_fast.FunctionOperation.process
> Nov 18 02:53:13 E
> self.process_element(input_processor.next())
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/pyflink/fn_execution/table/operations.py", line 102,
> in process_element
> Nov 18 02:53:13 E return self.func(value)
> Nov 18 02:53:13 E File "<string>", line 1, in <lambda>
> Nov 18 02:53:13 E File
> "/__w/2/s/flink-python/pyflink/table/tests/test_dependency.py", line 184, in
> add_one
> Nov 18 02:53:13 E from python_package1 import plus
> Nov 18 02:53:13 E ModuleNotFoundError: No module named
> 'python_package1'
> Nov 18 02:53:13 E
> Nov 18 02:53:13 E at
> org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180)
> Nov 18 02:53:13 E at
> org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
> Nov 18 02:53:13 E at
> org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
> Nov 18 02:53:13 E ... 3 more {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
