[
https://issues.apache.org/jira/browse/FLINK-25674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477312#comment-17477312
]
Etienne Chauchot commented on FLINK-25674:
------------------------------------------
[~trohrmann] I think we should consider all pojo tests together:
_testCassandraBatchPojoFormat_, _testCassandraPojoAtLeastOnceSink_ and
_testCassandraPojoNoAnnotatedKeyspaceAtLeastOnceSink_ because the
_AlreadyExistsException: Table _ happens only on them. These tests use
different table names and the whole keyspace is dropped at the begining of the
testCase. So it could be either:
1- a race condition between instances of the same test method. Is this even
possible considering that we create a test container as a ClassRule ? tests
should not share a test container.
2- retrial: if the test fails with NoHostAvailableExeception after the table
creation and the test is retried, the table still exists and the whole test is
relaunched along with the table creation leading to the exception. I'm
wondering why we don't see the log.warn message but, as the rule restarts the
test, maybe it is a different log file in azure
=> I'd go for 2. I guess we should allow some house cleaning in the retrial
rule. I propose we allow the retry rule to receive a callback that is called in
case of error. WDYT ?
> CassandraConnectorITCase.testCassandraPojoNoAnnotatedKeyspaceAtLeastOnceSink
> fails on AZP
> -----------------------------------------------------------------------------------------
>
> Key: FLINK-25674
> URL: https://issues.apache.org/jira/browse/FLINK-25674
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Cassandra
> Affects Versions: 1.14.0
> Reporter: Till Rohrmann
> Priority: Critical
> Labels: test-stability
>
> The test
> {{CassandraConnectorITCase.testCassandraPojoNoAnnotatedKeyspaceAtLeastOnceSink}}
> fails on AZP with
> {code}
> 2022-01-17T02:20:49.5493218Z Jan 17 02:20:49 [ERROR]
> testCassandraPojoNoAnnotatedKeyspaceAtLeastOnceSink Time elapsed: 15.145 s
> <<< ERROR!
> 2022-01-17T02:20:49.5494292Z Jan 17 02:20:49
> com.datastax.driver.core.exceptions.AlreadyExistsException: Table
> flink.testpojonoannotatedkeyspace already exists
> 2022-01-17T02:20:49.5495503Z Jan 17 02:20:49 at
> com.datastax.driver.core.exceptions.AlreadyExistsException.copy(AlreadyExistsException.java:111)
> 2022-01-17T02:20:49.5496540Z Jan 17 02:20:49 at
> com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)
> 2022-01-17T02:20:49.5497594Z Jan 17 02:20:49 at
> com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:245)
> 2022-01-17T02:20:49.5498647Z Jan 17 02:20:49 at
> com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:63)
> 2022-01-17T02:20:49.5499594Z Jan 17 02:20:49 at
> com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:39)
> 2022-01-17T02:20:49.5501059Z Jan 17 02:20:49 at
> org.apache.flink.streaming.connectors.cassandra.CassandraConnectorITCase.testCassandraPojoNoAnnotatedKeyspaceAtLeastOnceSink(CassandraConnectorITCase.java:449)
> 2022-01-17T02:20:49.5502208Z Jan 17 02:20:49 at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 2022-01-17T02:20:49.5503180Z Jan 17 02:20:49 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 2022-01-17T02:20:49.5504178Z Jan 17 02:20:49 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 2022-01-17T02:20:49.5604696Z Jan 17 02:20:49 at
> java.lang.reflect.Method.invoke(Method.java:498)
> 2022-01-17T02:20:49.5605959Z Jan 17 02:20:49 at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> 2022-01-17T02:20:49.5606983Z Jan 17 02:20:49 at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 2022-01-17T02:20:49.5608008Z Jan 17 02:20:49 at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> 2022-01-17T02:20:49.5608991Z Jan 17 02:20:49 at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 2022-01-17T02:20:49.5609957Z Jan 17 02:20:49 at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2022-01-17T02:20:49.5610970Z Jan 17 02:20:49 at
> org.apache.flink.testutils.junit.RetryRule$RetryOnExceptionStatement.evaluate(RetryRule.java:192)
> 2022-01-17T02:20:49.5612021Z Jan 17 02:20:49 at
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> 2022-01-17T02:20:49.5613033Z Jan 17 02:20:49 at
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> 2022-01-17T02:20:49.5613888Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> 2022-01-17T02:20:49.5614902Z Jan 17 02:20:49 at
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> 2022-01-17T02:20:49.5615847Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> 2022-01-17T02:20:49.5616769Z Jan 17 02:20:49 at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> 2022-01-17T02:20:49.5617759Z Jan 17 02:20:49 at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> 2022-01-17T02:20:49.5618667Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> 2022-01-17T02:20:49.5619532Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> 2022-01-17T02:20:49.5620398Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> 2022-01-17T02:20:49.5621274Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> 2022-01-17T02:20:49.5622475Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
> 2022-01-17T02:20:49.5623473Z Jan 17 02:20:49 at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> 2022-01-17T02:20:49.5624427Z Jan 17 02:20:49 at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 2022-01-17T02:20:49.5625607Z Jan 17 02:20:49 at
> org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
> 2022-01-17T02:20:49.5626610Z Jan 17 02:20:49 at
> org.junit.rules.RunRules.evaluate(RunRules.java:20)
> 2022-01-17T02:20:49.5627446Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> 2022-01-17T02:20:49.5628284Z Jan 17 02:20:49 at
> org.junit.runners.ParentRunner.run(ParentRunner.java:413)
> 2022-01-17T02:20:49.5629203Z Jan 17 02:20:49 at
> org.junit.runner.JUnitCore.run(JUnitCore.java:137)
> 2022-01-17T02:20:49.5629991Z Jan 17 02:20:49 at
> org.junit.runner.JUnitCore.run(JUnitCore.java:115)
> 2022-01-17T02:20:49.5630869Z Jan 17 02:20:49 at
> org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
> 2022-01-17T02:20:49.5631813Z Jan 17 02:20:49 at
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
> 2022-01-17T02:20:49.5633005Z Jan 17 02:20:49 at
> java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> 2022-01-17T02:20:49.5633889Z Jan 17 02:20:49 at
> java.util.Iterator.forEachRemaining(Iterator.java:116)
> 2022-01-17T02:20:49.5634814Z Jan 17 02:20:49 at
> java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
> 2022-01-17T02:20:49.5635842Z Jan 17 02:20:49 at
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> 2022-01-17T02:20:49.5636790Z Jan 17 02:20:49 at
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> 2022-01-17T02:20:49.5637730Z Jan 17 02:20:49 at
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
> 2022-01-17T02:20:49.5638725Z Jan 17 02:20:49 at
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
> 2022-01-17T02:20:49.5639686Z Jan 17 02:20:49 at
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> 2022-01-17T02:20:49.5640616Z Jan 17 02:20:49 at
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
> 2022-01-17T02:20:49.5641595Z Jan 17 02:20:49 at
> org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82)
> 2022-01-17T02:20:49.5642592Z Jan 17 02:20:49 at
> org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73)
> 2022-01-17T02:20:49.5643666Z Jan 17 02:20:49 at
> org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
> 2022-01-17T02:20:49.5644683Z Jan 17 02:20:49 at
> org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
> 2022-01-17T02:20:49.5645817Z Jan 17 02:20:49 at
> org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
> 2022-01-17T02:20:49.5646854Z Jan 17 02:20:49 at
> org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
> 2022-01-17T02:20:49.5647822Z Jan 17 02:20:49 at
> org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
> 2022-01-17T02:20:49.5648898Z Jan 17 02:20:49 at
> org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
> 2022-01-17T02:20:49.5650007Z Jan 17 02:20:49 at
> org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
> 2022-01-17T02:20:49.5651102Z Jan 17 02:20:49 at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> 2022-01-17T02:20:49.5652152Z Jan 17 02:20:49 at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> 2022-01-17T02:20:49.5653235Z Jan 17 02:20:49 at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> 2022-01-17T02:20:49.5654317Z Jan 17 02:20:49 at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> 2022-01-17T02:20:49.5655468Z Jan 17 02:20:49 Caused by:
> com.datastax.driver.core.exceptions.AlreadyExistsException: Table
> flink.testpojonoannotatedkeyspace already exists
> 2022-01-17T02:20:49.5656599Z Jan 17 02:20:49 at
> com.datastax.driver.core.exceptions.AlreadyExistsException.copy(AlreadyExistsException.java:130)
> 2022-01-17T02:20:49.5657602Z Jan 17 02:20:49 at
> com.datastax.driver.core.Responses$Error.asException(Responses.java:140)
> 2022-01-17T02:20:49.5658569Z Jan 17 02:20:49 at
> com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:179)
> 2022-01-17T02:20:49.5659567Z Jan 17 02:20:49 at
> com.datastax.driver.core.RequestHandler.setFinalResult(RequestHandler.java:184)
> 2022-01-17T02:20:49.5660533Z Jan 17 02:20:49 at
> com.datastax.driver.core.RequestHandler.access$2500(RequestHandler.java:43)
> 2022-01-17T02:20:49.5661559Z Jan 17 02:20:49 at
> com.datastax.driver.core.RequestHandler$SpeculativeExecution.setFinalResult(RequestHandler.java:798)
> 2022-01-17T02:20:49.5662625Z Jan 17 02:20:49 at
> com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:617)
> 2022-01-17T02:20:49.5663854Z Jan 17 02:20:49 at
> com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1005)
> 2022-01-17T02:20:49.5664921Z Jan 17 02:20:49 at
> com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:928)
> 2022-01-17T02:20:49.5665972Z Jan 17 02:20:49 at
> io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
> 2022-01-17T02:20:49.5667057Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
> 2022-01-17T02:20:49.5668167Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
> 2022-01-17T02:20:49.5669381Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
> 2022-01-17T02:20:49.5670503Z Jan 17 02:20:49 at
> io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
> 2022-01-17T02:20:49.5671610Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
> 2022-01-17T02:20:49.5672901Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
> 2022-01-17T02:20:49.5674102Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
> 2022-01-17T02:20:49.5675361Z Jan 17 02:20:49 at
> io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
> 2022-01-17T02:20:49.5676552Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
> 2022-01-17T02:20:49.5677759Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
> 2022-01-17T02:20:49.5678973Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
> 2022-01-17T02:20:49.5680129Z Jan 17 02:20:49 at
> io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
> 2022-01-17T02:20:49.5681156Z Jan 17 02:20:49 at
> io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
> 2022-01-17T02:20:49.5682317Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
> 2022-01-17T02:20:49.5683617Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
> 2022-01-17T02:20:49.5684808Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
> 2022-01-17T02:20:49.5686259Z Jan 17 02:20:49 at
> io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
> 2022-01-17T02:20:49.5687453Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
> 2022-01-17T02:20:49.5688674Z Jan 17 02:20:49 at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
> 2022-01-17T02:20:49.5689860Z Jan 17 02:20:49 at
> io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
> 2022-01-17T02:20:49.5691053Z Jan 17 02:20:49 at
> io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
> 2022-01-17T02:20:49.5692211Z Jan 17 02:20:49 at
> io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475)
> 2022-01-17T02:20:49.5693887Z Jan 17 02:20:49 at
> io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
> 2022-01-17T02:20:49.5695131Z Jan 17 02:20:49 at
> io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
> 2022-01-17T02:20:49.5696227Z Jan 17 02:20:49 at
> io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> 2022-01-17T02:20:49.5697143Z Jan 17 02:20:49 at
> java.lang.Thread.run(Thread.java:748)
> 2022-01-17T02:20:49.5698317Z Jan 17 02:20:49 Caused by:
> com.datastax.driver.core.exceptions.AlreadyExistsException: Table
> flink.testpojonoannotatedkeyspace already exists
> 2022-01-17T02:20:49.5699458Z Jan 17 02:20:49 at
> com.datastax.driver.core.Responses$Error$1.decode(Responses.java:85)
> 2022-01-17T02:20:49.5700446Z Jan 17 02:20:49 at
> com.datastax.driver.core.Responses$Error$1.decode(Responses.java:37)
> 2022-01-17T02:20:49.5701433Z Jan 17 02:20:49 at
> com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:266)
> 2022-01-17T02:20:49.5702452Z Jan 17 02:20:49 at
> com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:246)
> 2022-01-17T02:20:49.5703619Z Jan 17 02:20:49 at
> io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
> 2022-01-17T02:20:49.5704484Z Jan 17 02:20:49 ... 18 more
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=29510&view=logs&j=ba53eb01-1462-56a3-8e98-0dd97fbcaab5&t=2e426bf0-b717-56bb-ab62-d63086457354&l=14943
> It might be related to FLINK-25165.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
