subject:"\[jira\] \[Commented\] \(FLINK\-24457\) FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement"

[jira] [Commented] (FLINK-24457) FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement

2021-11-07 Thread Till Rohrmann (Jira)



[ 
https://issues.apache.org/jira/browse/FLINK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440242#comment-17440242
 ] 

Till Rohrmann commented on FLINK-24457:
---

[~xmarker] can you provide a fix for the problem?

> FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover 
> fails with NoSuchElement
> -
>
> Key: FLINK-24457
> URL: https://issues.apache.org/jira/browse/FLINK-24457
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem
>Affects Versions: 1.13.3, 1.15.0
>Reporter: Dawid Wysakowicz
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24781=logs=a5ef94ef-68c2-57fd-3794-dc108ed1c495=2c68b137-b01d-55c9-e603-3ff3f320364b=23849
> {code}
> Oct 06 00:07:54 [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, 
> Time elapsed: 41.682 s <<< FAILURE! - in 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase
> Oct 06 00:07:54 [ERROR] testContinuousTextFileSourceWithJobManagerFailover  
> Time elapsed: 10.826 s  <<< ERROR!
> Oct 06 00:07:54 java.util.NoSuchElementException
> Oct 06 00:07:54   at java.util.LinkedList.removeLast(LinkedList.java:283)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.revert(AbstractCollectResultBuffer.java:112)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CheckpointedCollectResultBuffer.sinkRestarted(CheckpointedCollectResultBuffer.java:37)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.dealWithResponse(AbstractCollectResultBuffer.java:87)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:147)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.datastream.DataStreamUtils.collectRecordsFromUnboundedStream(DataStreamUtils.java:142)
> Oct 06 00:07:54   at 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSource(FileSourceTextLinesITCase.java:224)
> Oct 06 00:07:54   at 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover(FileSourceTextLinesITCase.java:180)
> Oct 06 00:07:54   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Oct 06 00:07:54   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Oct 06 00:07:54   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Oct 06 00:07:54   at java.lang.reflect.Method.invoke(Method.java:498)
> Oct 06 00:07:54   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> Oct 06 00:07:54   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Oct 06 00:07:54   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> Oct 06 00:07:54   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Oct 06 00:07:54   at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> Oct 06 00:07:54   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Oct 06 00:07:54   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)

[jira] [Commented] (FLINK-24457) FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement

2021-11-07 Thread Yun Gao (Jira)



[ 
https://issues.apache.org/jira/browse/FLINK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440020#comment-17440020
 ] 

Yun Gao commented on FLINK-24457:
-

Another instance on 1.13: 
[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26069=logs=a5ef94ef-68c2-57fd-3794-dc108ed1c495=9c1ddabe-d186-5a2c-5fcc-f3cafb3ec699=21677]
 

> FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover 
> fails with NoSuchElement
> -
>
> Key: FLINK-24457
> URL: https://issues.apache.org/jira/browse/FLINK-24457
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem
>Affects Versions: 1.15.0
>Reporter: Dawid Wysakowicz
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24781=logs=a5ef94ef-68c2-57fd-3794-dc108ed1c495=2c68b137-b01d-55c9-e603-3ff3f320364b=23849
> {code}
> Oct 06 00:07:54 [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, 
> Time elapsed: 41.682 s <<< FAILURE! - in 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase
> Oct 06 00:07:54 [ERROR] testContinuousTextFileSourceWithJobManagerFailover  
> Time elapsed: 10.826 s  <<< ERROR!
> Oct 06 00:07:54 java.util.NoSuchElementException
> Oct 06 00:07:54   at java.util.LinkedList.removeLast(LinkedList.java:283)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.revert(AbstractCollectResultBuffer.java:112)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CheckpointedCollectResultBuffer.sinkRestarted(CheckpointedCollectResultBuffer.java:37)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.dealWithResponse(AbstractCollectResultBuffer.java:87)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:147)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.datastream.DataStreamUtils.collectRecordsFromUnboundedStream(DataStreamUtils.java:142)
> Oct 06 00:07:54   at 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSource(FileSourceTextLinesITCase.java:224)
> Oct 06 00:07:54   at 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover(FileSourceTextLinesITCase.java:180)
> Oct 06 00:07:54   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Oct 06 00:07:54   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Oct 06 00:07:54   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Oct 06 00:07:54   at java.lang.reflect.Method.invoke(Method.java:498)
> Oct 06 00:07:54   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> Oct 06 00:07:54   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Oct 06 00:07:54   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> Oct 06 00:07:54   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Oct 06 00:07:54   at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> Oct 06 00:07:54   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Oct 06 00:07:54   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> Oct 06 00:07:54   at 
>

[jira] [Commented] (FLINK-24457) FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement

2021-10-13 Thread xmarker (Jira)



[ 
https://issues.apache.org/jira/browse/FLINK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428125#comment-17428125
 ] 

xmarker commented on FLINK-24457:
-

I investigated the relevant code, I think it may be CollectSinkFunction.offset 
was concurrent use in different thread( the snapshot thread read  and the 
ServerThread thread write) 

> FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover 
> fails with NoSuchElement
> -
>
> Key: FLINK-24457
> URL: https://issues.apache.org/jira/browse/FLINK-24457
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / FileSystem
>Affects Versions: 1.15.0
>Reporter: Dawid Wysakowicz
>Priority: Major
>  Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24781=logs=a5ef94ef-68c2-57fd-3794-dc108ed1c495=2c68b137-b01d-55c9-e603-3ff3f320364b=23849
> {code}
> Oct 06 00:07:54 [ERROR] Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, 
> Time elapsed: 41.682 s <<< FAILURE! - in 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase
> Oct 06 00:07:54 [ERROR] testContinuousTextFileSourceWithJobManagerFailover  
> Time elapsed: 10.826 s  <<< ERROR!
> Oct 06 00:07:54 java.util.NoSuchElementException
> Oct 06 00:07:54   at java.util.LinkedList.removeLast(LinkedList.java:283)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.revert(AbstractCollectResultBuffer.java:112)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CheckpointedCollectResultBuffer.sinkRestarted(CheckpointedCollectResultBuffer.java:37)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.dealWithResponse(AbstractCollectResultBuffer.java:87)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:147)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
> Oct 06 00:07:54   at 
> org.apache.flink.streaming.api.datastream.DataStreamUtils.collectRecordsFromUnboundedStream(DataStreamUtils.java:142)
> Oct 06 00:07:54   at 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSource(FileSourceTextLinesITCase.java:224)
> Oct 06 00:07:54   at 
> org.apache.flink.connector.file.src.FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover(FileSourceTextLinesITCase.java:180)
> Oct 06 00:07:54   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Method)
> Oct 06 00:07:54   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> Oct 06 00:07:54   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Oct 06 00:07:54   at java.lang.reflect.Method.invoke(Method.java:498)
> Oct 06 00:07:54   at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> Oct 06 00:07:54   at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Oct 06 00:07:54   at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> Oct 06 00:07:54   at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Oct 06 00:07:54   at 
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> Oct 06 00:07:54   at 
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Oct 06 00:07:54   at 
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> Oct 06 00:07:54   at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> Oct 06 00:07:54   at 
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> Oct 06 00:07:54   at 
>

[jira] [Commented] (FLINK-24457) FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement

[jira] [Commented] (FLINK-24457) FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement

[jira] [Commented] (FLINK-24457) FileSourceTextLinesITCase.testContinuousTextFileSourceWithJobManagerFailover fails with NoSuchElement

3 matches

Site Navigation

Mail list logo

Footer information