[jira] [Commented] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1
[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634177#comment-17634177
]
Huang Xingbo commented on FLINK-28394:
--
`Python py36-cython` is not the cause of the actual error. Any test running
under Python 3.6 fails, and then `Python py36-cython` will be displayed at the
end. You need to scroll up in the log to find out the actual failed test. I
looked at the links posted and they are all about
https://issues.apache.org/jira/browse/FLINK-29461.
> Python py36-cython: InvocationError for command install_command.sh fails with
> exit code 1
> -
>
> Key: FLINK-28394
> URL: https://issues.apache.org/jira/browse/FLINK-28394
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.16.0, 1.15.3
>Reporter: Martijn Visser
>Assignee: Huang Xingbo
>Priority: Major
> Labels: stale-assigned, test-stability
>
> {code:java}
> Jul 05 03:47:22 Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> Jul 05 03:47:32 Using Python version 3.8.13 (default, Mar 28 2022 11:38:47)
> Jul 05 03:47:32 pip_test_code.py success!
> Jul 05 03:47:32 py38-cython finish: run-test after 1658.14 seconds
> Jul 05 03:47:32 py38-cython start: run-test-post
> Jul 05 03:47:32 py38-cython finish: run-test-post after 0.00 seconds
> Jul 05 03:47:32 ___ summary
>
> Jul 05 03:47:32 ERROR: py36-cython: InvocationError for command
> /__w/3/s/flink-python/dev/install_command.sh --exists-action w
> .tox/.tmp/package/1/apache-flink-1.15.dev0.zip (exited with code 1)
> Jul 05 03:47:32 py37-cython: commands succeeded
> Jul 05 03:47:32 py38-cython: commands succeeded
> Jul 05 03:47:32 cleanup
> /__w/3/s/flink-python/.tox/.tmp/package/1/apache-flink-1.15.dev0.zip
> Jul 05 03:47:33 tox checks... [FAILED]
> Jul 05 03:47:33 Process exited with EXIT CODE: 1.
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37604&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=27789
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1
[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17633491#comment-17633491
]
Leonard Xu commented on FLINK-28394:
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=43104&view=logs&j=e92ecf6d-e207-5a42-7ff7-528ff0c5b259&t=40fc352e-9b4c-5fd8-363f-628f24b01ec2
> Python py36-cython: InvocationError for command install_command.sh fails with
> exit code 1
> -
>
> Key: FLINK-28394
> URL: https://issues.apache.org/jira/browse/FLINK-28394
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.16.0, 1.15.3
>Reporter: Martijn Visser
>Assignee: Huang Xingbo
>Priority: Major
> Labels: stale-assigned, test-stability
>
> {code:java}
> Jul 05 03:47:22 Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> Jul 05 03:47:32 Using Python version 3.8.13 (default, Mar 28 2022 11:38:47)
> Jul 05 03:47:32 pip_test_code.py success!
> Jul 05 03:47:32 py38-cython finish: run-test after 1658.14 seconds
> Jul 05 03:47:32 py38-cython start: run-test-post
> Jul 05 03:47:32 py38-cython finish: run-test-post after 0.00 seconds
> Jul 05 03:47:32 ___ summary
>
> Jul 05 03:47:32 ERROR: py36-cython: InvocationError for command
> /__w/3/s/flink-python/dev/install_command.sh --exists-action w
> .tox/.tmp/package/1/apache-flink-1.15.dev0.zip (exited with code 1)
> Jul 05 03:47:32 py37-cython: commands succeeded
> Jul 05 03:47:32 py38-cython: commands succeeded
> Jul 05 03:47:32 cleanup
> /__w/3/s/flink-python/.tox/.tmp/package/1/apache-flink-1.15.dev0.zip
> Jul 05 03:47:33 tox checks... [FAILED]
> Jul 05 03:47:33 Process exited with EXIT CODE: 1.
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37604&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=27789
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1
[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17633477#comment-17633477
]
Leonard Xu commented on FLINK-28394:
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=43087&view=logs&j=9cada3cb-c1d3-5621-16da-0f718fb86602&t=c67e71ed-6451-5d26-8920-5a8cf9651901
> Python py36-cython: InvocationError for command install_command.sh fails with
> exit code 1
> -
>
> Key: FLINK-28394
> URL: https://issues.apache.org/jira/browse/FLINK-28394
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.16.0, 1.15.3
>Reporter: Martijn Visser
>Assignee: Huang Xingbo
>Priority: Major
> Labels: stale-assigned, test-stability
>
> {code:java}
> Jul 05 03:47:22 Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> Jul 05 03:47:32 Using Python version 3.8.13 (default, Mar 28 2022 11:38:47)
> Jul 05 03:47:32 pip_test_code.py success!
> Jul 05 03:47:32 py38-cython finish: run-test after 1658.14 seconds
> Jul 05 03:47:32 py38-cython start: run-test-post
> Jul 05 03:47:32 py38-cython finish: run-test-post after 0.00 seconds
> Jul 05 03:47:32 ___ summary
>
> Jul 05 03:47:32 ERROR: py36-cython: InvocationError for command
> /__w/3/s/flink-python/dev/install_command.sh --exists-action w
> .tox/.tmp/package/1/apache-flink-1.15.dev0.zip (exited with code 1)
> Jul 05 03:47:32 py37-cython: commands succeeded
> Jul 05 03:47:32 py38-cython: commands succeeded
> Jul 05 03:47:32 cleanup
> /__w/3/s/flink-python/.tox/.tmp/package/1/apache-flink-1.15.dev0.zip
> Jul 05 03:47:33 tox checks... [FAILED]
> Jul 05 03:47:33 Process exited with EXIT CODE: 1.
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37604&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=27789
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1
[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630851#comment-17630851
]
Matthias Pohl commented on FLINK-28394:
---
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=42957&view=logs&j=e92ecf6d-e207-5a42-7ff7-528ff0c5b259&t=40fc352e-9b4c-5fd8-363f-628f24b01ec2&l=28792
> Python py36-cython: InvocationError for command install_command.sh fails with
> exit code 1
> -
>
> Key: FLINK-28394
> URL: https://issues.apache.org/jira/browse/FLINK-28394
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.16.0, 1.15.2
>Reporter: Martijn Visser
>Assignee: Huang Xingbo
>Priority: Major
> Labels: stale-assigned, test-stability
>
> {code:java}
> Jul 05 03:47:22 Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> Jul 05 03:47:32 Using Python version 3.8.13 (default, Mar 28 2022 11:38:47)
> Jul 05 03:47:32 pip_test_code.py success!
> Jul 05 03:47:32 py38-cython finish: run-test after 1658.14 seconds
> Jul 05 03:47:32 py38-cython start: run-test-post
> Jul 05 03:47:32 py38-cython finish: run-test-post after 0.00 seconds
> Jul 05 03:47:32 ___ summary
>
> Jul 05 03:47:32 ERROR: py36-cython: InvocationError for command
> /__w/3/s/flink-python/dev/install_command.sh --exists-action w
> .tox/.tmp/package/1/apache-flink-1.15.dev0.zip (exited with code 1)
> Jul 05 03:47:32 py37-cython: commands succeeded
> Jul 05 03:47:32 py38-cython: commands succeeded
> Jul 05 03:47:32 cleanup
> /__w/3/s/flink-python/.tox/.tmp/package/1/apache-flink-1.15.dev0.zip
> Jul 05 03:47:33 tox checks... [FAILED]
> Jul 05 03:47:33 Process exited with EXIT CODE: 1.
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37604&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=27789
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1
[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630840#comment-17630840
]
Matthias Pohl commented on FLINK-28394:
---
[~hxbks2ks] can you give some guidance here on what the actual issue is? I'm
not happy with what we extracted from the failed builds so far to give this
Jira issue a meaningful purpose. The only thing I found is the following
stacktrace (but that might be unrelated):
{code}
02:56:45,358 [Source: PythonInputFormatTableSource(a, b, c) ->
SourceConversion[610] -> PythonCorrelate[611] -> Calc[612] ->
SinkConversion[613] -> Map -> Sink: Unnamed (2/2)#0] WARN
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory [] - Error
cleaning up server>
payload:
"\0327/__w/1/s/flink-python/pyflink/bin/pyflink-udf-runner.sh\"\312\002\n\004PATH\022\301\002/__w/1/s/flink-python/.tox/py38-cython/bin:/__w/1/s/flink-python/dev/.conda/envs/3.8/bin:/__w/1/s/flink-python/dev/.conda/envs/3.7/bin:/__w/1/s/flink-python/dev/.conda/envs/3.6/bi>
java.lang.IllegalStateException: call already closed
at
org.apache.beam.vendor.grpc.v1p26p0.com.google.common.base.Preconditions.checkState(Preconditions.java:511)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:209)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:202)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.grpc.v1p26p0.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:371)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:64)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.GrpcFnServer.close(GrpcFnServer.java:156)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:212)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:319)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.streaming.api.runners.python.beam.PythonSharedResources.close(PythonSharedResources.java:67)
~[flink-python_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.memory.SharedResources$LeasedResource.dispose(SharedResources.java:180)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.memory.SharedResources.release(SharedResources.java:108)
~[flink-dist-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at
org.apache.flink.runtime.memory.MemoryManager.lambda$getSharedMemo
[jira] [Commented] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1
[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630834#comment-17630834
]
Matthias Pohl commented on FLINK-28394:
---
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=42956&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=29157
> Python py36-cython: InvocationError for command install_command.sh fails with
> exit code 1
> -
>
> Key: FLINK-28394
> URL: https://issues.apache.org/jira/browse/FLINK-28394
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.16.0, 1.15.2
>Reporter: Martijn Visser
>Assignee: Huang Xingbo
>Priority: Major
> Labels: stale-assigned, test-stability
>
> {code:java}
> Jul 05 03:47:22 Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> Jul 05 03:47:32 Using Python version 3.8.13 (default, Mar 28 2022 11:38:47)
> Jul 05 03:47:32 pip_test_code.py success!
> Jul 05 03:47:32 py38-cython finish: run-test after 1658.14 seconds
> Jul 05 03:47:32 py38-cython start: run-test-post
> Jul 05 03:47:32 py38-cython finish: run-test-post after 0.00 seconds
> Jul 05 03:47:32 ___ summary
>
> Jul 05 03:47:32 ERROR: py36-cython: InvocationError for command
> /__w/3/s/flink-python/dev/install_command.sh --exists-action w
> .tox/.tmp/package/1/apache-flink-1.15.dev0.zip (exited with code 1)
> Jul 05 03:47:32 py37-cython: commands succeeded
> Jul 05 03:47:32 py38-cython: commands succeeded
> Jul 05 03:47:32 cleanup
> /__w/3/s/flink-python/.tox/.tmp/package/1/apache-flink-1.15.dev0.zip
> Jul 05 03:47:33 tox checks... [FAILED]
> Jul 05 03:47:33 Process exited with EXIT CODE: 1.
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37604&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=27789
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1
[
https://issues.apache.org/jira/browse/FLINK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17562469#comment-17562469
]
Martijn Visser commented on FLINK-28394:
CC [~dianfu] [~hxbks2ks]
> Python py36-cython: InvocationError for command install_command.sh fails with
> exit code 1
> -
>
> Key: FLINK-28394
> URL: https://issues.apache.org/jira/browse/FLINK-28394
> Project: Flink
> Issue Type: Bug
> Components: API / Python
>Affects Versions: 1.15.2
>Reporter: Martijn Visser
>Priority: Major
> Labels: test-stability
>
> {code:java}
> Jul 05 03:47:22 Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError
> Jul 05 03:47:32 Using Python version 3.8.13 (default, Mar 28 2022 11:38:47)
> Jul 05 03:47:32 pip_test_code.py success!
> Jul 05 03:47:32 py38-cython finish: run-test after 1658.14 seconds
> Jul 05 03:47:32 py38-cython start: run-test-post
> Jul 05 03:47:32 py38-cython finish: run-test-post after 0.00 seconds
> Jul 05 03:47:32 ___ summary
>
> Jul 05 03:47:32 ERROR: py36-cython: InvocationError for command
> /__w/3/s/flink-python/dev/install_command.sh --exists-action w
> .tox/.tmp/package/1/apache-flink-1.15.dev0.zip (exited with code 1)
> Jul 05 03:47:32 py37-cython: commands succeeded
> Jul 05 03:47:32 py38-cython: commands succeeded
> Jul 05 03:47:32 cleanup
> /__w/3/s/flink-python/.tox/.tmp/package/1/apache-flink-1.15.dev0.zip
> Jul 05 03:47:33 tox checks... [FAILED]
> Jul 05 03:47:33 Process exited with EXIT CODE: 1.
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37604&view=logs&j=bf5e383b-9fd3-5f02-ca1c-8f788e2e76d3&t=85189c57-d8a0-5c9c-b61d-fc05cfac62cf&l=27789
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
