Yun Gao created FLINK-25498: ------------------------------- Summary: FlinkKafkaProducerITCase. testRestoreToCheckpointAfterExceedingProducersPool failed on azure Key: FLINK-25498 URL: https://issues.apache.org/jira/browse/FLINK-25498 Project: Flink Issue Type: Bug Components: kafka Affects Versions: 1.14.2 Reporter: Yun Gao
{code:java} 2021-12-31T08:14:15.9176162Z Dec 31 08:14:15 [ERROR] testRestoreToCheckpointAfterExceedingProducersPool Time elapsed: 74.087 s <<< FAILURE! 2021-12-31T08:14:15.9176809Z Dec 31 08:14:15 java.lang.AssertionError: Expected elements: <[42]>, but was: elements: <[42, 42, 42, 42]> 2021-12-31T08:14:15.9177351Z Dec 31 08:14:15 at org.junit.Assert.fail(Assert.java:89) 2021-12-31T08:14:15.9177963Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:331) 2021-12-31T08:14:15.9183636Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:159) 2021-12-31T08:14:15.9184980Z Dec 31 08:14:15 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2021-12-31T08:14:15.9185908Z Dec 31 08:14:15 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2021-12-31T08:14:15.9186954Z Dec 31 08:14:15 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2021-12-31T08:14:15.9187888Z Dec 31 08:14:15 at java.lang.reflect.Method.invoke(Method.java:498) 2021-12-31T08:14:15.9188819Z Dec 31 08:14:15 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2021-12-31T08:14:15.9189826Z Dec 31 08:14:15 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2021-12-31T08:14:15.9191068Z Dec 31 08:14:15 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2021-12-31T08:14:15.9191923Z Dec 31 08:14:15 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2021-12-31T08:14:15.9193167Z Dec 31 08:14:15 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 2021-12-31T08:14:15.9193891Z Dec 31 08:14:15 at org.apache.flink.testutils.junit.RetryRule$RetryOnFailureStatement.evaluate(RetryRule.java:135) 2021-12-31T08:14:15.9194516Z Dec 31 08:14:15 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) 2021-12-31T08:14:15.9195078Z Dec 31 08:14:15 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) 2021-12-31T08:14:15.9195616Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2021-12-31T08:14:15.9196194Z Dec 31 08:14:15 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) 2021-12-31T08:14:15.9196762Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) 2021-12-31T08:14:15.9197389Z Dec 31 08:14:15 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) 2021-12-31T08:14:15.9197988Z Dec 31 08:14:15 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) 2021-12-31T08:14:15.9198818Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) 2021-12-31T08:14:15.9199544Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) 2021-12-31T08:14:15.9200367Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) 2021-12-31T08:14:15.9200914Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) 2021-12-31T08:14:15.9201465Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) 2021-12-31T08:14:15.9202369Z Dec 31 08:14:15 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 2021-12-31T08:14:15.9203399Z Dec 31 08:14:15 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 2021-12-31T08:14:15.9203973Z Dec 31 08:14:15 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) 2021-12-31T08:14:15.9204504Z Dec 31 08:14:15 at org.junit.rules.RunRules.evaluate(RunRules.java:20) 2021-12-31T08:14:15.9205027Z Dec 31 08:14:15 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) 2021-12-31T08:14:15.9205549Z Dec 31 08:14:15 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) 2021-12-31T08:14:15.9206053Z Dec 31 08:14:15 at org.junit.runner.JUnitCore.run(JUnitCore.java:137) 2021-12-31T08:14:15.9206540Z Dec 31 08:14:15 at org.junit.runner.JUnitCore.run(JUnitCore.java:115) 2021-12-31T08:14:15.9207069Z Dec 31 08:14:15 at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43) 2021-12-31T08:14:15.9207661Z Dec 31 08:14:15 at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) 2021-12-31T08:14:15.9208412Z Dec 31 08:14:15 at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) 2021-12-31T08:14:15.9208957Z Dec 31 08:14:15 at java.util.Iterator.forEachRemaining(Iterator.java:116) 2021-12-31T08:14:15.9209512Z Dec 31 08:14:15 at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801) 2021-12-31T08:14:15.9210113Z Dec 31 08:14:15 at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) 2021-12-31T08:14:15.9210688Z Dec 31 08:14:15 at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) 2021-12-31T08:14:15.9211258Z Dec 31 08:14:15 at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) 2021-12-31T08:14:15.9211861Z Dec 31 08:14:15 at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173) 2021-12-31T08:14:15.9212446Z Dec 31 08:14:15 at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) 2021-12-31T08:14:15.9213288Z Dec 31 08:14:15 at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485) 2021-12-31T08:14:15.9214004Z Dec 31 08:14:15 at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82) 2021-12-31T08:14:15.9214792Z Dec 31 08:14:15 at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73) 2021-12-31T08:14:15.9215739Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220) 2021-12-31T08:14:15.9216617Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188) 2021-12-31T08:14:15.9217412Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202) 2021-12-31T08:14:15.9218088Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181) 2021-12-31T08:14:15.9218827Z Dec 31 08:14:15 at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128) 2021-12-31T08:14:15.9219507Z Dec 31 08:14:15 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150) 2021-12-31T08:14:15.9220205Z Dec 31 08:14:15 at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120) 2021-12-31T08:14:15.9221047Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) 2021-12-31T08:14:15.9221917Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) 2021-12-31T08:14:15.9222532Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) 2021-12-31T08:14:15.9223499Z Dec 31 08:14:15 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) 2021-12-31T08:14:15.9225268Z Dec 31 08:14:15 Suppressed: org.apache.flink.streaming.connectors.kafka.FlinkKafkaException: Failed to send data to Kafka: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker. 2021-12-31T08:14:15.9226290Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.checkErroneous(FlinkKafkaProducer.java:1429) 2021-12-31T08:14:15.9226969Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.close(FlinkKafkaProducer.java:977) 2021-12-31T08:14:15.9227632Z Dec 31 08:14:15 at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41) 2021-12-31T08:14:15.9228314Z Dec 31 08:14:15 at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114) 2021-12-31T08:14:15.9229035Z Dec 31 08:14:15 at org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.close(AbstractStreamOperatorTestHarness.java:726) 2021-12-31T08:14:15.9229853Z Dec 31 08:14:15 at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:161) 2021-12-31T08:14:15.9230602Z Dec 31 08:14:15 ... 54 more 2021-12-31T08:14:15.9231641Z Dec 31 08:14:15 Caused by: org.apache.kafka.common.errors.ProducerFencedException: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker. 2021-12-31T08:14:15.9232332Z Dec 31 08:14:15 2021-12-31T08:14:16.4493533Z Dec 31 08:14:16 [INFO] 2021-12-31T08:14:16.4494222Z Dec 31 08:14:16 [INFO] Results: 2021-12-31T08:14:16.4494741Z Dec 31 08:14:16 [INFO] 2021-12-31T08:14:16.4495080Z Dec 31 08:14:16 [ERROR] Failures: 2021-12-31T08:14:16.4496559Z Dec 31 08:14:16 [ERROR] FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool:159->KafkaTestBase.assertExactlyOnceForTopic:331 Expected elements: <[42]>, but was: elements: <[42, 42, 42, 42]> 2021-12-31T08:14:16.4497521Z Dec 31 08:14:16 [INFO] {code} https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=28786&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7412 -- This message was sent by Atlassian Jira (v8.20.1#820001)