[ https://issues.apache.org/jira/browse/FLINK-26036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490349#comment-17490349 ]
Till Rohrmann commented on FLINK-26036: --------------------------------------- The problem seems to be the following: When shutting down the {{TaskExecutor}}, then we fail all running tasks and close the {{TaskSlotTableImpl}}. If now a terminal state of a {{Task}} is processed, then this removes the {{Task}} from the {{TaskSlotTableImpl}}. This in turn triggers the {{TaskExecutor.freeSlotInternal}} via the {{SlotActions.freeSlot}} call. > LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory > timeout on azure > ------------------------------------------------------------------------------------------- > > Key: FLINK-26036 > URL: https://issues.apache.org/jira/browse/FLINK-26036 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing > Affects Versions: 1.15.0 > Reporter: Yun Gao > Assignee: Till Rohrmann > Priority: Critical > Labels: pull-request-available, test-stability > Fix For: 1.15.0 > > > {code:java} > 022-02-09T02:18:17.1827314Z Feb 09 02:18:14 [ERROR] > org.apache.flink.test.recovery.LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory > Time elapsed: 62.252 s <<< ERROR! > 2022-02-09T02:18:17.1827940Z Feb 09 02:18:14 > java.util.concurrent.TimeoutException > 2022-02-09T02:18:17.1828450Z Feb 09 02:18:14 at > java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1784) > 2022-02-09T02:18:17.1829040Z Feb 09 02:18:14 at > java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928) > 2022-02-09T02:18:17.1829752Z Feb 09 02:18:14 at > org.apache.flink.test.recovery.LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory(LocalRecoveryITCase.java:115) > 2022-02-09T02:18:17.1830407Z Feb 09 02:18:14 at > sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > 2022-02-09T02:18:17.1830954Z Feb 09 02:18:14 at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > 2022-02-09T02:18:17.1831582Z Feb 09 02:18:14 at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > 2022-02-09T02:18:17.1832135Z Feb 09 02:18:14 at > java.lang.reflect.Method.invoke(Method.java:498) > 2022-02-09T02:18:17.1832697Z Feb 09 02:18:14 at > org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725) > 2022-02-09T02:18:17.1833566Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60) > 2022-02-09T02:18:17.1834394Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131) > 2022-02-09T02:18:17.1835125Z Feb 09 02:18:14 at > org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149) > 2022-02-09T02:18:17.1835875Z Feb 09 02:18:14 at > org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140) > 2022-02-09T02:18:17.1836565Z Feb 09 02:18:14 at > org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:84) > 2022-02-09T02:18:17.1837294Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115) > 2022-02-09T02:18:17.1838007Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105) > 2022-02-09T02:18:17.1838743Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106) > 2022-02-09T02:18:17.1839499Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64) > 2022-02-09T02:18:17.1840224Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45) > 2022-02-09T02:18:17.1840952Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37) > 2022-02-09T02:18:17.1841616Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104) > 2022-02-09T02:18:17.1842257Z Feb 09 02:18:14 at > org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98) > 2022-02-09T02:18:17.1842951Z Feb 09 02:18:14 at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$7(TestMethodTestDescriptor.java:214) > 2022-02-09T02:18:17.1843681Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > 2022-02-09T02:18:17.1844782Z Feb 09 02:18:14 at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:210) > 2022-02-09T02:18:17.1845603Z Feb 09 02:18:14 at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:135) > 2022-02-09T02:18:17.1846375Z Feb 09 02:18:14 at > org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:66) > 2022-02-09T02:18:17.1847084Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:151) > 2022-02-09T02:18:17.1847785Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > 2022-02-09T02:18:17.1848490Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) > 2022-02-09T02:18:17.1849138Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) > 2022-02-09T02:18:17.1849797Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) > 2022-02-09T02:18:17.1850500Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > 2022-02-09T02:18:17.1851169Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) > 2022-02-09T02:18:17.1851834Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) > 2022-02-09T02:18:17.1852396Z Feb 09 02:18:14 at > java.util.ArrayList.forEach(ArrayList.java:1259) > 2022-02-09T02:18:17.1853086Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) > 2022-02-09T02:18:17.1853876Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) > 2022-02-09T02:18:17.1854746Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > 2022-02-09T02:18:17.1855633Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) > 2022-02-09T02:18:17.1856371Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) > 2022-02-09T02:18:17.1857033Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) > 2022-02-09T02:18:17.1857722Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > 2022-02-09T02:18:17.1858400Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) > 2022-02-09T02:18:17.1859068Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) > 2022-02-09T02:18:17.1859632Z Feb 09 02:18:14 at > java.util.ArrayList.forEach(ArrayList.java:1259) > 2022-02-09T02:18:17.1860318Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:41) > 2022-02-09T02:18:17.1861122Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$6(NodeTestTask.java:155) > 2022-02-09T02:18:17.1861818Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > 2022-02-09T02:18:17.1862519Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:141) > 2022-02-09T02:18:17.1863169Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137) > 2022-02-09T02:18:17.1863920Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$9(NodeTestTask.java:139) > 2022-02-09T02:18:17.1864685Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73) > 2022-02-09T02:18:17.1865773Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:138) > 2022-02-09T02:18:17.1866640Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:95) > 2022-02-09T02:18:17.1867395Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:35) > 2022-02-09T02:18:17.1868198Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57) > 2022-02-09T02:18:17.1868928Z Feb 09 02:18:14 at > org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:54) > 2022-02-09T02:18:17.1869645Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107) > 2022-02-09T02:18:17.1870359Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88) > 2022-02-09T02:18:17.1871067Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54) > 2022-02-09T02:18:17.1871823Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67) > 2022-02-09T02:18:17.1872551Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52) > 2022-02-09T02:18:17.1873208Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114) > 2022-02-09T02:18:17.1873826Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86) > 2022-02-09T02:18:17.1874572Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86) > 2022-02-09T02:18:17.1875289Z Feb 09 02:18:14 at > org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53) > 2022-02-09T02:18:17.1876343Z Feb 09 02:18:14 at > org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188) > 2022-02-09T02:18:17.1877233Z Feb 09 02:18:14 at > org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154) > 2022-02-09T02:18:17.1877928Z Feb 09 02:18:14 at > org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124) > 2022-02-09T02:18:17.1878584Z Feb 09 02:18:14 at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428) > 2022-02-09T02:18:17.1879206Z Feb 09 02:18:14 at > org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162) > 2022-02-09T02:18:17.1879793Z Feb 09 02:18:14 at > org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562) > 2022-02-09T02:18:17.1880381Z Feb 09 02:18:14 at > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548) > {code} > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=30956&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=23106 -- This message was sent by Atlassian Jira (v8.20.1#820001)