[ https://issues.apache.org/jira/browse/FLINK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17463325#comment-17463325 ]
Piotr Nowojski edited comment on FLINK-25185 at 12/21/21, 4:03 PM: ------------------------------------------------------------------- After an offline discussion with [~roman] and some further analysis this is what we think is happening for 1.15 branch. # Test is hitting {{FileNotFoundException}}, probably caused by FLINK-25395 # Test ends up in an infinite restart loop, where each restart attempt hits {{FileNotFoundException}} # After tens of thousands of restart attempts and cancellations (for example in attempt #14176 as [commented in Roman's post| https://issues.apache.org/jira/browse/FLINK-25185?focusedCommentId=17462834&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17462834]), this endless cycle of restarts and cancellations is causing FLINK-25407 deadlock to surface. # From now on, StreamFaultToleranceTestBase will end up in yet another infinite restart loop, but this time scheduling will be failing with "Could not acquire the minimum required resources." This is because one TaskManager is stuck in this deadlock and hence we are missing resources to restart the job. We have extracted those two issues FLINK-25395 (affects only 1.15, after merging FLINK-24611 a couple of days ago. It's a release blocker) and FLINK-25407 (affects 1.14.x and 1.15.x, but not as severe issue) to independent tickets. For the time being we will disable changelog state backend randomisation until FLINK-25395 is fixed to reduce the number of test failure. However the first report was from 1.13 branch, and I can not see the same deadlock there. I can not verify the logs from that failure, because logs upload has failed. So most likely there is still another issue present in the code base (At least in 1.13.x branch), that we have no way of analysing at the moment and we will have to wait for another failure with successful logs upload this time. was (Author: pnowojski): After an offline discussion with [~roman] and some further analysis this is what we think is happening for 1.15 branch. # Test is hitting {{FileNotFoundException}}, probably caused by FLINK-25395 # Test ends up in an infinite restart loop, where each restart attempt hits {{FileNotFoundException}} # After tens of thousands of restart attempts and cancellations (for example in attempt #14176 as [commented in Roman's post| https://issues.apache.org/jira/browse/FLINK-25185?focusedCommentId=17462834&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17462834]), this endless cycle of restarts and cancellations is causing FLINK-25407 deadlock to surface # From now on, StreamFaultToleranceTestBase will end up in yet another infinite restart loop, but this time scheduling will be failing with "Could not acquire the minimum required resources." We have extracted those two issues FLINK-25395 (affects only 1.15, after merging FLINK-24611 a couple of days ago. It's a release blocker) and FLINK-25407 (affects 1.14.x and 1.15.x, but not as severe issue) to independent tickets. For the time being we will disable changelog state backend randomisation until FLINK-25395 is fixed to reduce the number of test failure. However the first report was from 1.13 branch, and I can not see the same deadlock there. I can not verify the logs from that failure, because logs upload has failed. So most likely there is still another issue present in the code base (At least in 1.13.x branch), that we have no way of analysing at the moment and we will have to wait for another failure with successful logs upload this time. > StreamFaultToleranceTestBase hangs on AZP > ----------------------------------------- > > Key: FLINK-25185 > URL: https://issues.apache.org/jira/browse/FLINK-25185 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends, Test Infrastructure > Affects Versions: 1.13.3, 1.15.0 > Reporter: Till Rohrmann > Priority: Blocker > Labels: test-stability > Fix For: 1.15.0 > > > The {{StreamFaultToleranceTestBase}} hangs on AZP. > {code} > 2021-12-06T04:24:48.1676089Z > ========================================================================================== > 2021-12-06T04:24:48.1678883Z === WARNING: This task took already 95% of the > available time budget of 237 minutes === > 2021-12-06T04:24:48.1679596Z > ========================================================================================== > 2021-12-06T04:24:48.1680326Z > ============================================================================== > 2021-12-06T04:24:48.1680877Z The following Java processes are running (JPS) > 2021-12-06T04:24:48.1681467Z > ============================================================================== > 2021-12-06T04:24:48.6514536Z 13701 surefirebooter17740627448580534543.jar > 2021-12-06T04:24:48.6515353Z 1622 Jps > 2021-12-06T04:24:48.6515795Z 780 Launcher > 2021-12-06T04:24:48.6825889Z > ============================================================================== > 2021-12-06T04:24:48.6826565Z Printing stack trace of Java process 13701 > 2021-12-06T04:24:48.6827012Z > ============================================================================== > 2021-12-06T04:24:49.1876086Z 2021-12-06 04:24:49 > 2021-12-06T04:24:49.1877098Z Full thread dump OpenJDK 64-Bit Server VM > (11.0.10+9 mixed mode): > 2021-12-06T04:24:49.1877362Z > 2021-12-06T04:24:49.1877672Z Threads class SMR info: > 2021-12-06T04:24:49.1878049Z _java_thread_list=0x00007f254c007630, > length=365, elements={ > 2021-12-06T04:24:49.1878504Z 0x00007f2598028000, 0x00007f2598280800, > 0x00007f2598284800, 0x00007f2598299000, > 2021-12-06T04:24:49.1878973Z 0x00007f259829b000, 0x00007f259829d800, > 0x00007f259829f800, 0x00007f25982a1800, > 2021-12-06T04:24:49.1879680Z 0x00007f2598337800, 0x00007f25983e3000, > 0x00007f2598431000, 0x00007f2528016000, > 2021-12-06T04:24:49.1896613Z 0x00007f2599003000, 0x00007f259972e000, > 0x00007f2599833800, 0x00007f259984c000, > 2021-12-06T04:24:49.1897558Z 0x00007f259984f000, 0x00007f2599851000, > 0x00007f2599892000, 0x00007f2599894800, > 2021-12-06T04:24:49.1898075Z 0x00007f2499a16000, 0x00007f2485acd800, > 0x00007f2485ace000, 0x00007f24876bb800, > 2021-12-06T04:24:49.1898562Z 0x00007f2461e59000, 0x00007f2499a0e800, > 0x00007f2461e5e800, 0x00007f2461e81000, > 2021-12-06T04:24:49.1899037Z 0x00007f24dc015000, 0x00007f2461e86800, > 0x00007f2448002000, 0x00007f24dc01c000, > 2021-12-06T04:24:49.1899522Z 0x00007f2438001000, 0x00007f2438003000, > 0x00007f2438005000, 0x00007f2438006800, > 2021-12-06T04:24:49.1899982Z 0x00007f2438008800, 0x00007f2434017800, > 0x00007f243401a800, 0x00007f2414008800, > 2021-12-06T04:24:49.1900495Z 0x00007f24e8089800, 0x00007f24e8090000, > 0x00007f23e4005800, 0x00007f24e8092800, > 2021-12-06T04:24:49.1901163Z 0x00007f24e8099000, 0x00007f2414015800, > 0x00007f24dc04c000, 0x00007f2414018800, > 2021-12-06T04:24:49.1901680Z 0x00007f2414020000, 0x00007f24dc058000, > 0x00007f24dc05b000, 0x00007f2414022000, > 2021-12-06T04:24:49.1902283Z 0x00007f24d400f000, 0x00007f241402e800, > 0x00007f2414031800, 0x00007f2414033800, > 2021-12-06T04:24:49.1902880Z 0x00007f2414035000, 0x00007f2414037000, > 0x00007f2414038800, 0x00007f241403a800, > 2021-12-06T04:24:49.1903354Z 0x00007f241403c000, 0x00007f241403e000, > 0x00007f241403f800, 0x00007f2414041800, > 2021-12-06T04:24:49.1903812Z 0x00007f2414043000, 0x00007f2414045000, > 0x00007f24dc064800, 0x00007f2414047000, > 2021-12-06T04:24:49.1904284Z 0x00007f2414048800, 0x00007f241404a800, > 0x00007f241404c800, 0x00007f241404e000, > 2021-12-06T04:24:49.1904800Z 0x00007f2414050000, 0x00007f2414051800, > 0x00007f2414053800, 0x00007f2414055000, > 2021-12-06T04:24:49.1905455Z 0x00007f2414057000, 0x00007f2414059000, > 0x00007f241405a800, 0x00007f241405c800, > 2021-12-06T04:24:49.1906098Z 0x00007f241405e000, 0x00007f2414060000, > 0x00007f2414062000, 0x00007f2414063800, > 2021-12-06T04:24:49.1906728Z 0x00007f22e400c800, 0x00007f2328008000, > 0x00007f2284007000, 0x00007f22cc019800, > 2021-12-06T04:24:49.1907396Z 0x00007f21f8004000, 0x00007f2304012800, > 0x00007f230001b000, 0x00007f223c011000, > 2021-12-06T04:24:49.1908080Z 0x00007f24e40c1800, 0x00007f2454001000, > 0x00007f24e40c3000, 0x00007f2454003000, > 2021-12-06T04:24:49.1908794Z 0x00007f24e40c5000, 0x00007f2454004800, > 0x00007f2444002000, 0x00007f2444002800, > 2021-12-06T04:24:49.1909522Z 0x00007f245808b800, 0x00007f24b8032800, > 0x00007f24ac021000, 0x00007f24b8034800, > 2021-12-06T04:24:49.1910280Z 0x00007f24b8036800, 0x00007f24ac032800, > 0x00007f24b8052000, 0x00007f24ac033800, > 2021-12-06T04:24:49.1911023Z 0x00007f24ac035000, 0x00007f24b8067000, > 0x00007f24ac036000, 0x00007f241407d000, > 2021-12-06T04:24:49.1911714Z 0x00007f24ac0a9800, 0x00007f24b4018800, > 0x00007f254008a800, 0x00007f24ac06f800, > 2021-12-06T04:24:49.1912565Z 0x00007f2540247800, 0x00007f21f400d000, > 0x00007f24b4058000, 0x00007f24b4052000, > 2021-12-06T04:24:49.1913476Z 0x00007f24ac0a3000, 0x00007f24b4052800, > 0x00007f24b401f800, 0x00007f24b4020800, > 2021-12-06T04:24:49.1914496Z 0x00007f24b4022000, 0x00007f24b4025000, > 0x00007f24b4026000, 0x00007f24b4027000, > 2021-12-06T04:24:49.1915097Z 0x00007f24ac022000, 0x00007f24b4028000, > 0x00007f24b4029800, 0x00007f24b402b000, > 2021-12-06T04:24:49.1915580Z 0x00007f24b402c000, 0x00007f24ac024000, > 0x00007f2540248800, 0x00007f2540013000, > 2021-12-06T04:24:49.1916060Z 0x00007f2540014000, 0x00007f24b402d000, > 0x00007f24b402e000, 0x00007f24b4030000, > 2021-12-06T04:24:49.1916716Z 0x00007f24b4031000, 0x00007f24ac025000, > 0x00007f24ac027000, 0x00007f24b4032000, > 2021-12-06T04:24:49.1917403Z 0x00007f24b4033800, 0x00007f2540014800, > 0x00007f24b4035800, 0x00007f2540015800, > 2021-12-06T04:24:49.1918098Z 0x00007f2540017800, 0x00007f24ac028000, > 0x00007f24ac096000, 0x00007f241406b000, > 2021-12-06T04:24:49.1918810Z 0x00007f24140a4000, 0x00007f24ac097000, > 0x00007f24140a5000, 0x00007f24ac098000, > 2021-12-06T04:24:49.1919516Z 0x00007f24140a6000, 0x00007f24ac099000, > 0x00007f24ac09b000, 0x00007f24ac09d000, > 2021-12-06T04:24:49.1920238Z 0x00007f24ac02a800, 0x00007f24140a7000, > 0x00007f2414091000, 0x00007f2414092800, > 2021-12-06T04:24:49.1924443Z 0x00007f2414094000, 0x00007f2414095800, > 0x00007f2414096800, 0x00007f2414098000, > 2021-12-06T04:24:49.1924945Z 0x00007f24b4037000, 0x00007f24140aa000, > 0x00007f24b4038800, 0x00007f24b403a000, > 2021-12-06T04:24:49.1925435Z 0x00007f24b403b800, 0x00007f24b403d000, > 0x00007f24140ab000, 0x00007f24b403e000, > 2021-12-06T04:24:49.1926138Z 0x00007f24140ac800, 0x00007f24b403f000, > 0x00007f2540018800, 0x00007f254001a000, > 2021-12-06T04:24:49.1926888Z 0x00007f24140ad800, 0x00007f24b4040800, > 0x00007f24b4042000, 0x00007f24b4043800, > 2021-12-06T04:24:49.1927871Z 0x00007f24b4045000, 0x00007f24140af000, > 0x00007f24140b1000, 0x00007f24b4046000, > 2021-12-06T04:24:49.1928615Z 0x00007f24b4047800, 0x00007f24b4049000, > 0x00007f24b404a800, 0x00007f2414088000, > 2021-12-06T04:24:49.1929344Z 0x00007f2414089800, 0x00007f24b404b000, > 0x00007f24b404c800, 0x00007f24b405b000, > 2021-12-06T04:24:49.1930089Z 0x00007f24b405c800, 0x00007f24b405d800, > 0x00007f24b405f000, 0x00007f24b4060000, > 2021-12-06T04:24:49.1930874Z 0x00007f24b4061800, 0x00007f24b4062800, > 0x00007f24b4064000, 0x00007f24b4065800, > 2021-12-06T04:24:49.1931655Z 0x00007f24b4066800, 0x00007f24b4068000, > 0x00007f241408a800, 0x00007f241408c000, > 2021-12-06T04:24:49.1932594Z 0x00007f241408e000, 0x00007f241407f800, > 0x00007f24b4069000, 0x00007f24b406a800, > 2021-12-06T04:24:49.1933513Z 0x00007f2414080800, 0x00007f2414082000, > 0x00007f24ac02b800, 0x00007f24b406c000, > 2021-12-06T04:24:49.1934301Z 0x00007f24ac02c000, 0x00007f24b406d000, > 0x00007f24b406e800, 0x00007f24b4070800, > 2021-12-06T04:24:49.1935060Z 0x00007f24b4071800, 0x00007f24b4073000, > 0x00007f24b4074800, 0x00007f2540306000, > 2021-12-06T04:24:49.1935827Z 0x00007f2540307800, 0x00007f24b4075800, > 0x00007f24b4076800, 0x00007f2540309000, > 2021-12-06T04:24:49.1936660Z 0x00007f24ac02d800, 0x00007f254030a000, > 0x00007f24b4078800, 0x00007f24ac02e800, > 2021-12-06T04:24:49.1937398Z 0x00007f24b4079800, 0x00007f24b407a800, > 0x00007f24ac030000, 0x00007f24ac070800, > 2021-12-06T04:24:49.1938146Z 0x00007f24b407b800, 0x00007f24ac071800, > 0x00007f24b407d000, 0x00007f24ac072800, > 2021-12-06T04:24:49.1938914Z 0x00007f24b407e800, 0x00007f24ac074000, > 0x00007f24b407f800, 0x00007f24b4081800, > 2021-12-06T04:24:49.1939771Z 0x00007f254030b000, 0x00007f2540068800, > 0x00007f254006a000, 0x00007f24ac075000, > 2021-12-06T04:24:49.1940516Z 0x00007f24ac077000, 0x00007f24ac079000, > 0x00007f24b4082800, 0x00007f24b4084000, > 2021-12-06T04:24:49.1941260Z 0x00007f254006b000, 0x00007f254006c000, > 0x00007f24b4085000, 0x00007f24b4086800, > 2021-12-06T04:24:49.1942145Z 0x00007f24b4088800, 0x00007f24ac07a000, > 0x00007f24ac07b800, 0x00007f254006d800, > 2021-12-06T04:24:49.1943222Z 0x00007f24ac07c800, 0x00007f24ac07e000, > 0x00007f24ac080000, 0x00007f24ac081800, > 2021-12-06T04:24:49.1944028Z 0x00007f24ac083000, 0x00007f24140db000, > 0x00007f2414084000, 0x00007f2414086000, > 2021-12-06T04:24:49.1944838Z 0x00007f24140c2800, 0x00007f254006e800, > 0x00007f2540082000, 0x00007f2540084000, > 2021-12-06T04:24:49.1945905Z 0x00007f24140c3000, 0x00007f24ac084000, > 0x00007f24ac085800, 0x00007f2540085000, > 2021-12-06T04:24:49.1946697Z 0x00007f2540086800, 0x00007f24ac087000, > 0x00007f2540088000, 0x00007f2540209800, > 2021-12-06T04:24:49.1947452Z 0x00007f24140c4000, 0x00007f24140c6000, > 0x00007f24140c8000, 0x00007f254020b000, > 2021-12-06T04:24:49.1948246Z 0x00007f254020c800, 0x00007f24140c8800, > 0x00007f24140ca000, 0x00007f24140cc000, > 2021-12-06T04:24:49.1949033Z 0x00007f254020d800, 0x00007f24ac088000, > 0x00007f254020e800, 0x00007f24ac001000, > 2021-12-06T04:24:49.1949834Z 0x00007f2540210800, 0x00007f254001c800, > 0x00007f24140cd000, 0x00007f24140cf000, > 2021-12-06T04:24:49.1950625Z 0x00007f254001e000, 0x00007f24140d0800, > 0x00007f254001f800, 0x00007f24140e0000, > 2021-12-06T04:24:49.1951396Z 0x00007f2540021000, 0x00007f24140e1800, > 0x00007f2540023000, 0x00007f24140e3800, > 2021-12-06T04:24:49.1952354Z 0x00007f2540025000, 0x00007f2540027800, > 0x00007f24ac002000, 0x00007f24ac005000, > 2021-12-06T04:24:49.1953367Z 0x00007f24b40f9800, 0x00007f24b40fb800, > 0x00007f24ac006800, 0x00007f24b40fd000, > 2021-12-06T04:24:49.1953862Z 0x00007f2540029800, 0x00007f25402f0000, > 0x00007f25402f2000, 0x00007f24ac008000, > 2021-12-06T04:24:49.1954520Z 0x00007f25402f3800, 0x00007f24ac00a000, > 0x00007f24ac00c800, 0x00007f25402f5000, > 2021-12-06T04:24:49.1955005Z 0x00007f25402f7800, 0x00007f24ac00e800, > 0x00007f24ac010000, 0x00007f24ac012800, > 2021-12-06T04:24:49.1955688Z 0x00007f25402f9800, 0x00007f24ac014000, > 0x00007f24ac016000, 0x00007f24ac018000, > 2021-12-06T04:24:49.1956176Z 0x00007f24ac01a000, 0x00007f25402fb000, > 0x00007f25402fd000, 0x00007f2540255800, > 2021-12-06T04:24:49.1956653Z 0x00007f2540257800, 0x00007f24ac01b000, > 0x00007f24ac01d000, 0x00007f24ac01f800, > 2021-12-06T04:24:49.1957118Z 0x00007f24b40fe800, 0x00007f24ac037800, > 0x00007f24ac039000, 0x00007f24ac03b800, > 2021-12-06T04:24:49.1957598Z 0x00007f24ac03d800, 0x00007f24b4100800, > 0x00007f24ac03e800, 0x00007f24ac040000, > 2021-12-06T04:24:49.1958086Z 0x00007f24b4102800, 0x00007f24b4104800, > 0x00007f24b4107000, 0x00007f2540258800, > 2021-12-06T04:24:49.1958567Z 0x00007f24b4108000, 0x00007f254025a000, > 0x00007f24ac042000, 0x00007f254025b800, > 2021-12-06T04:24:49.1959126Z 0x00007f254025e000, 0x00007f24b4109000, > 0x00007f24b410b800, 0x00007f2540260000, > 2021-12-06T04:24:49.1960049Z 0x00007f2540261800, 0x00007f24b410d800, > 0x00007f2540263800, 0x00007f2540002800, > 2021-12-06T04:24:49.1960764Z 0x00007f2540004800, 0x00007f24b401b800, > 0x00007f24b401e800, 0x00007f24b4114000, > 2021-12-06T04:24:49.1961638Z 0x00007f254c006800 > 2021-12-06T04:24:49.1962301Z } > 2021-12-06T04:24:49.1962496Z > 2021-12-06T04:24:49.1963236Z "main" #1 prio=5 os_prio=0 cpu=3941.93ms > elapsed=12601.44s tid=0x00007f2598028000 nid=0x3586 waiting on condition > [0x00007f25a129c000] > 2021-12-06T04:24:49.1963791Z java.lang.Thread.State: WAITING (parking) > 2021-12-06T04:24:49.1964243Z at > jdk.internal.misc.Unsafe.park(java.base@11.0.10/Native Method) > 2021-12-06T04:24:49.1965467Z - parking to wait for <0x00000000816de610> (a > java.util.concurrent.CompletableFuture$Signaller) > 2021-12-06T04:24:49.1966054Z at > java.util.concurrent.locks.LockSupport.park(java.base@11.0.10/LockSupport.java:194) > 2021-12-06T04:24:49.1966626Z at > java.util.concurrent.CompletableFuture$Signaller.block(java.base@11.0.10/CompletableFuture.java:1796) > 2021-12-06T04:24:49.1967433Z at > java.util.concurrent.ForkJoinPool.managedBlock(java.base@11.0.10/ForkJoinPool.java:3128) > 2021-12-06T04:24:49.1967965Z at > java.util.concurrent.CompletableFuture.waitingGet(java.base@11.0.10/CompletableFuture.java:1823) > 2021-12-06T04:24:49.1968522Z at > java.util.concurrent.CompletableFuture.get(java.base@11.0.10/CompletableFuture.java:1998) > 2021-12-06T04:24:49.1969094Z at > org.apache.flink.test.util.TestUtils.submitJobAndWaitForResult(TestUtils.java:74) > 2021-12-06T04:24:49.1970124Z at > org.apache.flink.test.checkpointing.StreamFaultToleranceTestBase.runCheckpointedProgram(StreamFaultToleranceTestBase.java:124) > 2021-12-06T04:24:49.1970886Z at > jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.10/Native > Method) > 2021-12-06T04:24:49.1971968Z at > jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.10/NativeMethodAccessorImpl.java:62) > 2021-12-06T04:24:49.1972745Z at > jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.10/DelegatingMethodAccessorImpl.java:43) > 2021-12-06T04:24:49.1973551Z at > java.lang.reflect.Method.invoke(java.base@11.0.10/Method.java:566) > 2021-12-06T04:24:49.1974066Z at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > 2021-12-06T04:24:49.1974656Z at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > 2021-12-06T04:24:49.1975236Z at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > 2021-12-06T04:24:49.1975894Z at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > 2021-12-06T04:24:49.1976436Z at > org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) > 2021-12-06T04:24:49.1976965Z at > org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) > 2021-12-06T04:24:49.1977525Z at > org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) > 2021-12-06T04:24:49.1978151Z at > org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) > 2021-12-06T04:24:49.1978620Z at > org.junit.rules.RunRules.evaluate(RunRules.java:20) > 2021-12-06T04:24:49.1979088Z at > org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > 2021-12-06T04:24:49.1979990Z at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > 2021-12-06T04:24:49.1980661Z at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > 2021-12-06T04:24:49.1981232Z at > org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > 2021-12-06T04:24:49.1981722Z at > org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > 2021-12-06T04:24:49.1982285Z at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > 2021-12-06T04:24:49.1982963Z at > org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > 2021-12-06T04:24:49.1983501Z at > org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > 2021-12-06T04:24:49.1984216Z at > org.junit.runners.ParentRunner.run(ParentRunner.java:363) > 2021-12-06T04:24:49.1984710Z at > org.junit.runners.Suite.runChild(Suite.java:128) > 2021-12-06T04:24:49.1985150Z at > org.junit.runners.Suite.runChild(Suite.java:27) > 2021-12-06T04:24:49.1985592Z at > org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > 2021-12-06T04:24:49.1986084Z at > org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > 2021-12-06T04:24:49.1986783Z at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > 2021-12-06T04:24:49.1987435Z at > org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > 2021-12-06T04:24:49.1988142Z at > org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > 2021-12-06T04:24:49.1988755Z at > org.junit.runners.ParentRunner.run(ParentRunner.java:363) > 2021-12-06T04:24:49.1989222Z at > org.junit.runners.Suite.runChild(Suite.java:128) > 2021-12-06T04:24:49.1989664Z at > org.junit.runners.Suite.runChild(Suite.java:27) > 2021-12-06T04:24:49.1990207Z at > org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > 2021-12-06T04:24:49.1990907Z at > org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > 2021-12-06T04:24:49.1991408Z at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > 2021-12-06T04:24:49.1992088Z at > org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > 2021-12-06T04:24:49.1992821Z at > org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > 2021-12-06T04:24:49.1993304Z at > org.junit.runners.ParentRunner.run(ParentRunner.java:363) > 2021-12-06T04:24:49.1993900Z at > org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55) > 2021-12-06T04:24:49.1994488Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137) > 2021-12-06T04:24:49.1995112Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) > 2021-12-06T04:24:49.1999560Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) > 2021-12-06T04:24:49.2000208Z at > org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) > 2021-12-06T04:24:49.2000807Z at > org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:158) > 2021-12-06T04:24:49.2001423Z at > org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) > 2021-12-06T04:24:49.2002128Z at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) > 2021-12-06T04:24:49.2002952Z at > org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) > 2021-12-06T04:24:49.2003562Z at > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) > {code} > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27568&view=logs&j=2c3cbe13-dee0-5837-cf47-3053da9a8a78&t=2c7d57b9-7341-5a87-c9af-2cf7cc1a37dc -- This message was sent by Atlassian Jira (v8.20.1#820001)