[ https://issues.apache.org/jira/browse/FLINK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462709#comment-17462709 ]
Roman Khachatryan commented on FLINK-25185: ------------------------------------------- > Roman Khachatryan, do you mean > SubtaskCheckpointCoordinatorImpl#cancelAsyncCheckpointRunnable being invoked > and the uploads being cancelled? Yes, or any other case when AsyncCheckpointRunnable.cleanup() is invoked; for example, reporting to JM failed. > Doesn't it point to a larger problem? That future checkpoints in general can > be deemed as completed, even if previous async phases are still uploading > some of the files that those future checkpoints are referencing? I don't think so: the decision whether to re-use some state or not is made by the State backend, not runtime (not AsyncCheckpointRunnable/SubtaskCheckpointCoordinatorImpl). Both RocksDB and Changelog consider state as re-usable only once the upload finishes (RocksIncrementalSnapshotStrategy.lastUploadedSstFiles or FsStateChangelogWriter.uploaded is updated). For a concurrent checkpoint, RocksDB will be re-uploaded the state; and changelog will wait for upload completion in UploadCompletionListener. Does this make sense? > It seems like neither of those problem will be easy to fix? The only easy fix I see is to never discard shared state in IncrementalRemoteKeyedStateHandle.discardState and rely on checkpoint subsumption or job termination for the cleanup. In any case when the state didn't reach JM it will be left orphaned (e.g. checkpoint aborted and backend materialized, not reporting this state again). Orphaned files problem should be mitigated by FLINK-24852. A proper fix I think would be private/shared state separation and TM-side registry (FLINK-23139 and related tickets). As the latter is much more invasive, I'd choose the former for the upcoming release (still need to confirm this is the root cause). > StreamFaultToleranceTestBase hangs on AZP > ----------------------------------------- > > Key: FLINK-25185 > URL: https://issues.apache.org/jira/browse/FLINK-25185 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends, Test Infrastructure > Affects Versions: 1.13.3, 1.15.0 > Reporter: Till Rohrmann > Priority: Critical > Labels: test-stability > Fix For: 1.15.0 > > > The {{StreamFaultToleranceTestBase}} hangs on AZP. > {code} > 2021-12-06T04:24:48.1676089Z > ========================================================================================== > 2021-12-06T04:24:48.1678883Z === WARNING: This task took already 95% of the > available time budget of 237 minutes === > 2021-12-06T04:24:48.1679596Z > ========================================================================================== > 2021-12-06T04:24:48.1680326Z > ============================================================================== > 2021-12-06T04:24:48.1680877Z The following Java processes are running (JPS) > 2021-12-06T04:24:48.1681467Z > ============================================================================== > 2021-12-06T04:24:48.6514536Z 13701 surefirebooter17740627448580534543.jar > 2021-12-06T04:24:48.6515353Z 1622 Jps > 2021-12-06T04:24:48.6515795Z 780 Launcher > 2021-12-06T04:24:48.6825889Z > ============================================================================== > 2021-12-06T04:24:48.6826565Z Printing stack trace of Java process 13701 > 2021-12-06T04:24:48.6827012Z > ============================================================================== > 2021-12-06T04:24:49.1876086Z 2021-12-06 04:24:49 > 2021-12-06T04:24:49.1877098Z Full thread dump OpenJDK 64-Bit Server VM > (11.0.10+9 mixed mode): > 2021-12-06T04:24:49.1877362Z > 2021-12-06T04:24:49.1877672Z Threads class SMR info: > 2021-12-06T04:24:49.1878049Z _java_thread_list=0x00007f254c007630, > length=365, elements={ > 2021-12-06T04:24:49.1878504Z 0x00007f2598028000, 0x00007f2598280800, > 0x00007f2598284800, 0x00007f2598299000, > 2021-12-06T04:24:49.1878973Z 0x00007f259829b000, 0x00007f259829d800, > 0x00007f259829f800, 0x00007f25982a1800, > 2021-12-06T04:24:49.1879680Z 0x00007f2598337800, 0x00007f25983e3000, > 0x00007f2598431000, 0x00007f2528016000, > 2021-12-06T04:24:49.1896613Z 0x00007f2599003000, 0x00007f259972e000, > 0x00007f2599833800, 0x00007f259984c000, > 2021-12-06T04:24:49.1897558Z 0x00007f259984f000, 0x00007f2599851000, > 0x00007f2599892000, 0x00007f2599894800, > 2021-12-06T04:24:49.1898075Z 0x00007f2499a16000, 0x00007f2485acd800, > 0x00007f2485ace000, 0x00007f24876bb800, > 2021-12-06T04:24:49.1898562Z 0x00007f2461e59000, 0x00007f2499a0e800, > 0x00007f2461e5e800, 0x00007f2461e81000, > 2021-12-06T04:24:49.1899037Z 0x00007f24dc015000, 0x00007f2461e86800, > 0x00007f2448002000, 0x00007f24dc01c000, > 2021-12-06T04:24:49.1899522Z 0x00007f2438001000, 0x00007f2438003000, > 0x00007f2438005000, 0x00007f2438006800, > 2021-12-06T04:24:49.1899982Z 0x00007f2438008800, 0x00007f2434017800, > 0x00007f243401a800, 0x00007f2414008800, > 2021-12-06T04:24:49.1900495Z 0x00007f24e8089800, 0x00007f24e8090000, > 0x00007f23e4005800, 0x00007f24e8092800, > 2021-12-06T04:24:49.1901163Z 0x00007f24e8099000, 0x00007f2414015800, > 0x00007f24dc04c000, 0x00007f2414018800, > 2021-12-06T04:24:49.1901680Z 0x00007f2414020000, 0x00007f24dc058000, > 0x00007f24dc05b000, 0x00007f2414022000, > 2021-12-06T04:24:49.1902283Z 0x00007f24d400f000, 0x00007f241402e800, > 0x00007f2414031800, 0x00007f2414033800, > 2021-12-06T04:24:49.1902880Z 0x00007f2414035000, 0x00007f2414037000, > 0x00007f2414038800, 0x00007f241403a800, > 2021-12-06T04:24:49.1903354Z 0x00007f241403c000, 0x00007f241403e000, > 0x00007f241403f800, 0x00007f2414041800, > 2021-12-06T04:24:49.1903812Z 0x00007f2414043000, 0x00007f2414045000, > 0x00007f24dc064800, 0x00007f2414047000, > 2021-12-06T04:24:49.1904284Z 0x00007f2414048800, 0x00007f241404a800, > 0x00007f241404c800, 0x00007f241404e000, > 2021-12-06T04:24:49.1904800Z 0x00007f2414050000, 0x00007f2414051800, > 0x00007f2414053800, 0x00007f2414055000, > 2021-12-06T04:24:49.1905455Z 0x00007f2414057000, 0x00007f2414059000, > 0x00007f241405a800, 0x00007f241405c800, > 2021-12-06T04:24:49.1906098Z 0x00007f241405e000, 0x00007f2414060000, > 0x00007f2414062000, 0x00007f2414063800, > 2021-12-06T04:24:49.1906728Z 0x00007f22e400c800, 0x00007f2328008000, > 0x00007f2284007000, 0x00007f22cc019800, > 2021-12-06T04:24:49.1907396Z 0x00007f21f8004000, 0x00007f2304012800, > 0x00007f230001b000, 0x00007f223c011000, > 2021-12-06T04:24:49.1908080Z 0x00007f24e40c1800, 0x00007f2454001000, > 0x00007f24e40c3000, 0x00007f2454003000, > 2021-12-06T04:24:49.1908794Z 0x00007f24e40c5000, 0x00007f2454004800, > 0x00007f2444002000, 0x00007f2444002800, > 2021-12-06T04:24:49.1909522Z 0x00007f245808b800, 0x00007f24b8032800, > 0x00007f24ac021000, 0x00007f24b8034800, > 2021-12-06T04:24:49.1910280Z 0x00007f24b8036800, 0x00007f24ac032800, > 0x00007f24b8052000, 0x00007f24ac033800, > 2021-12-06T04:24:49.1911023Z 0x00007f24ac035000, 0x00007f24b8067000, > 0x00007f24ac036000, 0x00007f241407d000, > 2021-12-06T04:24:49.1911714Z 0x00007f24ac0a9800, 0x00007f24b4018800, > 0x00007f254008a800, 0x00007f24ac06f800, > 2021-12-06T04:24:49.1912565Z 0x00007f2540247800, 0x00007f21f400d000, > 0x00007f24b4058000, 0x00007f24b4052000, > 2021-12-06T04:24:49.1913476Z 0x00007f24ac0a3000, 0x00007f24b4052800, > 0x00007f24b401f800, 0x00007f24b4020800, > 2021-12-06T04:24:49.1914496Z 0x00007f24b4022000, 0x00007f24b4025000, > 0x00007f24b4026000, 0x00007f24b4027000, > 2021-12-06T04:24:49.1915097Z 0x00007f24ac022000, 0x00007f24b4028000, > 0x00007f24b4029800, 0x00007f24b402b000, > 2021-12-06T04:24:49.1915580Z 0x00007f24b402c000, 0x00007f24ac024000, > 0x00007f2540248800, 0x00007f2540013000, > 2021-12-06T04:24:49.1916060Z 0x00007f2540014000, 0x00007f24b402d000, > 0x00007f24b402e000, 0x00007f24b4030000, > 2021-12-06T04:24:49.1916716Z 0x00007f24b4031000, 0x00007f24ac025000, > 0x00007f24ac027000, 0x00007f24b4032000, > 2021-12-06T04:24:49.1917403Z 0x00007f24b4033800, 0x00007f2540014800, > 0x00007f24b4035800, 0x00007f2540015800, > 2021-12-06T04:24:49.1918098Z 0x00007f2540017800, 0x00007f24ac028000, > 0x00007f24ac096000, 0x00007f241406b000, > 2021-12-06T04:24:49.1918810Z 0x00007f24140a4000, 0x00007f24ac097000, > 0x00007f24140a5000, 0x00007f24ac098000, > 2021-12-06T04:24:49.1919516Z 0x00007f24140a6000, 0x00007f24ac099000, > 0x00007f24ac09b000, 0x00007f24ac09d000, > 2021-12-06T04:24:49.1920238Z 0x00007f24ac02a800, 0x00007f24140a7000, > 0x00007f2414091000, 0x00007f2414092800, > 2021-12-06T04:24:49.1924443Z 0x00007f2414094000, 0x00007f2414095800, > 0x00007f2414096800, 0x00007f2414098000, > 2021-12-06T04:24:49.1924945Z 0x00007f24b4037000, 0x00007f24140aa000, > 0x00007f24b4038800, 0x00007f24b403a000, > 2021-12-06T04:24:49.1925435Z 0x00007f24b403b800, 0x00007f24b403d000, > 0x00007f24140ab000, 0x00007f24b403e000, > 2021-12-06T04:24:49.1926138Z 0x00007f24140ac800, 0x00007f24b403f000, > 0x00007f2540018800, 0x00007f254001a000, > 2021-12-06T04:24:49.1926888Z 0x00007f24140ad800, 0x00007f24b4040800, > 0x00007f24b4042000, 0x00007f24b4043800, > 2021-12-06T04:24:49.1927871Z 0x00007f24b4045000, 0x00007f24140af000, > 0x00007f24140b1000, 0x00007f24b4046000, > 2021-12-06T04:24:49.1928615Z 0x00007f24b4047800, 0x00007f24b4049000, > 0x00007f24b404a800, 0x00007f2414088000, > 2021-12-06T04:24:49.1929344Z 0x00007f2414089800, 0x00007f24b404b000, > 0x00007f24b404c800, 0x00007f24b405b000, > 2021-12-06T04:24:49.1930089Z 0x00007f24b405c800, 0x00007f24b405d800, > 0x00007f24b405f000, 0x00007f24b4060000, > 2021-12-06T04:24:49.1930874Z 0x00007f24b4061800, 0x00007f24b4062800, > 0x00007f24b4064000, 0x00007f24b4065800, > 2021-12-06T04:24:49.1931655Z 0x00007f24b4066800, 0x00007f24b4068000, > 0x00007f241408a800, 0x00007f241408c000, > 2021-12-06T04:24:49.1932594Z 0x00007f241408e000, 0x00007f241407f800, > 0x00007f24b4069000, 0x00007f24b406a800, > 2021-12-06T04:24:49.1933513Z 0x00007f2414080800, 0x00007f2414082000, > 0x00007f24ac02b800, 0x00007f24b406c000, > 2021-12-06T04:24:49.1934301Z 0x00007f24ac02c000, 0x00007f24b406d000, > 0x00007f24b406e800, 0x00007f24b4070800, > 2021-12-06T04:24:49.1935060Z 0x00007f24b4071800, 0x00007f24b4073000, > 0x00007f24b4074800, 0x00007f2540306000, > 2021-12-06T04:24:49.1935827Z 0x00007f2540307800, 0x00007f24b4075800, > 0x00007f24b4076800, 0x00007f2540309000, > 2021-12-06T04:24:49.1936660Z 0x00007f24ac02d800, 0x00007f254030a000, > 0x00007f24b4078800, 0x00007f24ac02e800, > 2021-12-06T04:24:49.1937398Z 0x00007f24b4079800, 0x00007f24b407a800, > 0x00007f24ac030000, 0x00007f24ac070800, > 2021-12-06T04:24:49.1938146Z 0x00007f24b407b800, 0x00007f24ac071800, > 0x00007f24b407d000, 0x00007f24ac072800, > 2021-12-06T04:24:49.1938914Z 0x00007f24b407e800, 0x00007f24ac074000, > 0x00007f24b407f800, 0x00007f24b4081800, > 2021-12-06T04:24:49.1939771Z 0x00007f254030b000, 0x00007f2540068800, > 0x00007f254006a000, 0x00007f24ac075000, > 2021-12-06T04:24:49.1940516Z 0x00007f24ac077000, 0x00007f24ac079000, > 0x00007f24b4082800, 0x00007f24b4084000, > 2021-12-06T04:24:49.1941260Z 0x00007f254006b000, 0x00007f254006c000, > 0x00007f24b4085000, 0x00007f24b4086800, > 2021-12-06T04:24:49.1942145Z 0x00007f24b4088800, 0x00007f24ac07a000, > 0x00007f24ac07b800, 0x00007f254006d800, > 2021-12-06T04:24:49.1943222Z 0x00007f24ac07c800, 0x00007f24ac07e000, > 0x00007f24ac080000, 0x00007f24ac081800, > 2021-12-06T04:24:49.1944028Z 0x00007f24ac083000, 0x00007f24140db000, > 0x00007f2414084000, 0x00007f2414086000, > 2021-12-06T04:24:49.1944838Z 0x00007f24140c2800, 0x00007f254006e800, > 0x00007f2540082000, 0x00007f2540084000, > 2021-12-06T04:24:49.1945905Z 0x00007f24140c3000, 0x00007f24ac084000, > 0x00007f24ac085800, 0x00007f2540085000, > 2021-12-06T04:24:49.1946697Z 0x00007f2540086800, 0x00007f24ac087000, > 0x00007f2540088000, 0x00007f2540209800, > 2021-12-06T04:24:49.1947452Z 0x00007f24140c4000, 0x00007f24140c6000, > 0x00007f24140c8000, 0x00007f254020b000, > 2021-12-06T04:24:49.1948246Z 0x00007f254020c800, 0x00007f24140c8800, > 0x00007f24140ca000, 0x00007f24140cc000, > 2021-12-06T04:24:49.1949033Z 0x00007f254020d800, 0x00007f24ac088000, > 0x00007f254020e800, 0x00007f24ac001000, > 2021-12-06T04:24:49.1949834Z 0x00007f2540210800, 0x00007f254001c800, > 0x00007f24140cd000, 0x00007f24140cf000, > 2021-12-06T04:24:49.1950625Z 0x00007f254001e000, 0x00007f24140d0800, > 0x00007f254001f800, 0x00007f24140e0000, > 2021-12-06T04:24:49.1951396Z 0x00007f2540021000, 0x00007f24140e1800, > 0x00007f2540023000, 0x00007f24140e3800, > 2021-12-06T04:24:49.1952354Z 0x00007f2540025000, 0x00007f2540027800, > 0x00007f24ac002000, 0x00007f24ac005000, > 2021-12-06T04:24:49.1953367Z 0x00007f24b40f9800, 0x00007f24b40fb800, > 0x00007f24ac006800, 0x00007f24b40fd000, > 2021-12-06T04:24:49.1953862Z 0x00007f2540029800, 0x00007f25402f0000, > 0x00007f25402f2000, 0x00007f24ac008000, > 2021-12-06T04:24:49.1954520Z 0x00007f25402f3800, 0x00007f24ac00a000, > 0x00007f24ac00c800, 0x00007f25402f5000, > 2021-12-06T04:24:49.1955005Z 0x00007f25402f7800, 0x00007f24ac00e800, > 0x00007f24ac010000, 0x00007f24ac012800, > 2021-12-06T04:24:49.1955688Z 0x00007f25402f9800, 0x00007f24ac014000, > 0x00007f24ac016000, 0x00007f24ac018000, > 2021-12-06T04:24:49.1956176Z 0x00007f24ac01a000, 0x00007f25402fb000, > 0x00007f25402fd000, 0x00007f2540255800, > 2021-12-06T04:24:49.1956653Z 0x00007f2540257800, 0x00007f24ac01b000, > 0x00007f24ac01d000, 0x00007f24ac01f800, > 2021-12-06T04:24:49.1957118Z 0x00007f24b40fe800, 0x00007f24ac037800, > 0x00007f24ac039000, 0x00007f24ac03b800, > 2021-12-06T04:24:49.1957598Z 0x00007f24ac03d800, 0x00007f24b4100800, > 0x00007f24ac03e800, 0x00007f24ac040000, > 2021-12-06T04:24:49.1958086Z 0x00007f24b4102800, 0x00007f24b4104800, > 0x00007f24b4107000, 0x00007f2540258800, > 2021-12-06T04:24:49.1958567Z 0x00007f24b4108000, 0x00007f254025a000, > 0x00007f24ac042000, 0x00007f254025b800, > 2021-12-06T04:24:49.1959126Z 0x00007f254025e000, 0x00007f24b4109000, > 0x00007f24b410b800, 0x00007f2540260000, > 2021-12-06T04:24:49.1960049Z 0x00007f2540261800, 0x00007f24b410d800, > 0x00007f2540263800, 0x00007f2540002800, > 2021-12-06T04:24:49.1960764Z 0x00007f2540004800, 0x00007f24b401b800, > 0x00007f24b401e800, 0x00007f24b4114000, > 2021-12-06T04:24:49.1961638Z 0x00007f254c006800 > 2021-12-06T04:24:49.1962301Z } > 2021-12-06T04:24:49.1962496Z > 2021-12-06T04:24:49.1963236Z "main" #1 prio=5 os_prio=0 cpu=3941.93ms > elapsed=12601.44s tid=0x00007f2598028000 nid=0x3586 waiting on condition > [0x00007f25a129c000] > 2021-12-06T04:24:49.1963791Z java.lang.Thread.State: WAITING (parking) > 2021-12-06T04:24:49.1964243Z at > jdk.internal.misc.Unsafe.park(java.base@11.0.10/Native Method) > 2021-12-06T04:24:49.1965467Z - parking to wait for <0x00000000816de610> (a > java.util.concurrent.CompletableFuture$Signaller) > 2021-12-06T04:24:49.1966054Z at > java.util.concurrent.locks.LockSupport.park(java.base@11.0.10/LockSupport.java:194) > 2021-12-06T04:24:49.1966626Z at > java.util.concurrent.CompletableFuture$Signaller.block(java.base@11.0.10/CompletableFuture.java:1796) > 2021-12-06T04:24:49.1967433Z at > java.util.concurrent.ForkJoinPool.managedBlock(java.base@11.0.10/ForkJoinPool.java:3128) > 2021-12-06T04:24:49.1967965Z at > java.util.concurrent.CompletableFuture.waitingGet(java.base@11.0.10/CompletableFuture.java:1823) > 2021-12-06T04:24:49.1968522Z at > java.util.concurrent.CompletableFuture.get(java.base@11.0.10/CompletableFuture.java:1998) > 2021-12-06T04:24:49.1969094Z at > org.apache.flink.test.util.TestUtils.submitJobAndWaitForResult(TestUtils.java:74) > 2021-12-06T04:24:49.1970124Z at > org.apache.flink.test.checkpointing.StreamFaultToleranceTestBase.runCheckpointedProgram(StreamFaultToleranceTestBase.java:124) > 2021-12-06T04:24:49.1970886Z at > jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.10/Native > Method) > 2021-12-06T04:24:49.1971968Z at > jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.10/NativeMethodAccessorImpl.java:62) > 2021-12-06T04:24:49.1972745Z at > jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.10/DelegatingMethodAccessorImpl.java:43) > 2021-12-06T04:24:49.1973551Z at > java.lang.reflect.Method.invoke(java.base@11.0.10/Method.java:566) > 2021-12-06T04:24:49.1974066Z at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > 2021-12-06T04:24:49.1974656Z at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > 2021-12-06T04:24:49.1975236Z at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > 2021-12-06T04:24:49.1975894Z at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > 2021-12-06T04:24:49.1976436Z at > org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) > 2021-12-06T04:24:49.1976965Z at > org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) > 2021-12-06T04:24:49.1977525Z at > org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) > 2021-12-06T04:24:49.1978151Z at > org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) > 2021-12-06T04:24:49.1978620Z at > org.junit.rules.RunRules.evaluate(RunRules.java:20) > 2021-12-06T04:24:49.1979088Z at > org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > 2021-12-06T04:24:49.1979990Z at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > 2021-12-06T04:24:49.1980661Z at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > 2021-12-06T04:24:49.1981232Z at > org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > 2021-12-06T04:24:49.1981722Z at > org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > 2021-12-06T04:24:49.1982285Z at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > 2021-12-06T04:24:49.1982963Z at > org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > 2021-12-06T04:24:49.1983501Z at > org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > 2021-12-06T04:24:49.1984216Z at > org.junit.runners.ParentRunner.run(ParentRunner.java:363) > 2021-12-06T04:24:49.1984710Z at > org.junit.runners.Suite.runChild(Suite.java:128) > 2021-12-06T04:24:49.1985150Z at > org.junit.runners.Suite.runChild(Suite.java:27) > 2021-12-06T04:24:49.1985592Z at > org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > 2021-12-06T04:24:49.1986084Z at > org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > 2021-12-06T04:24:49.1986783Z at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > 2021-12-06T04:24:49.1987435Z at > org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > 2021-12-06T04:24:49.1988142Z at > org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > 2021-12-06T04:24:49.1988755Z at > org.junit.runners.ParentRunner.run(ParentRunner.java:363) > 2021-12-06T04:24:49.1989222Z at > org.junit.runners.Suite.runChild(Suite.java:128) > 2021-12-06T04:24:49.1989664Z at > org.junit.runners.Suite.runChild(Suite.java:27) > 2021-12-06T04:24:49.1990207Z at > org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > 2021-12-06T04:24:49.1990907Z at > org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > 2021-12-06T04:24:49.1991408Z at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > 2021-12-06T04:24:49.1992088Z at > org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > 2021-12-06T04:24:49.1992821Z at > org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > 2021-12-06T04:24:49.1993304Z at > org.junit.runners.ParentRunner.run(ParentRunner.java:363) > 2021-12-06T04:24:49.1993900Z at > org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55) > 2021-12-06T04:24:49.1994488Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137) > 2021-12-06T04:24:49.1995112Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) > 2021-12-06T04:24:49.1999560Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) > 2021-12-06T04:24:49.2000208Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) > 2021-12-06T04:24:49.2000807Z at > org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:158) > 2021-12-06T04:24:49.2001423Z at > org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) > 2021-12-06T04:24:49.2002128Z at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) > 2021-12-06T04:24:49.2002952Z at > org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) > 2021-12-06T04:24:49.2003562Z at > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) > {code} > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27568&view=logs&j=2c3cbe13-dee0-5837-cf47-3053da9a8a78&t=2c7d57b9-7341-5a87-c9af-2cf7cc1a37dc -- This message was sent by Atlassian Jira (v8.20.1#820001)