[jira] [Comment Edited] (FLINK-35456) Many tests fails on AZP as NPE related to FileMerging

2024-05-26 Thread Weijie Guo (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-35456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849612#comment-17849612
 ] 

Weijie Guo edited comment on FLINK-35456 at 5/27/24 4:04 AM:
-

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=11943

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=f2c100be-250b-5e85-7bbe-176f68fcddc5&t=05efd11e-5400-54a4-0d27-a4663be008a9&l=12577

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=26b84117-e436-5720-913e-3e280ce55cae&t=77cc7e77-39a0-5007-6d65-4137ac13a471&l=12538


was (Author: weijie guo):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=11943

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=f2c100be-250b-5e85-7bbe-176f68fcddc5&t=05efd11e-5400-54a4-0d27-a4663be008a9&l=12577

> Many tests fails on AZP as NPE related to FileMerging
> -
>
> Key: FLINK-35456
> URL: https://issues.apache.org/jira/browse/FLINK-35456
> Project: Flink
>  Issue Type: Bug
>  Components: Build System / CI
>Affects Versions: 1.20.0
>Reporter: Weijie Guo
>Priority: Blocker
>
> {code:java}
> May 25 02:12:16 Caused by: java.lang.NullPointerException
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.isManagedByFileMergingManager(FileMergingSnapshotManagerBase.java:733)
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.lambda$null$4(FileMergingSnapshotManagerBase.java:687)
> May 25 02:12:16   at java.util.HashMap.computeIfAbsent(HashMap.java:1127)
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.lambda$restoreStateHandles$5(FileMergingSnapshotManagerBase.java:683)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
> May 25 02:12:16   at 
> java.util.stream.Streams$StreamBuilderImpl.forEachRemaining(Streams.java:419)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
> May 25 02:12:16   at 
> java.util.ArrayList$Itr.forEachRemaining(ArrayList.java:901)
> May 25 02:12:16   at 
> java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
> May 25 02:12:16   at 
> java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
> May 25 02:12:16   at 
> java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.restoreStateHandles(FileMergingSnapshotManagerBase.java:680)
> May 25 02:12:16

[jira] [Comment Edited] (FLINK-35456) Many tests fails on AZP as NPE related to FileMerging

2024-05-26 Thread Weijie Guo (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-35456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849612#comment-17849612
 ] 

Weijie Guo edited comment on FLINK-35456 at 5/27/24 4:03 AM:
-

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=11943

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=f2c100be-250b-5e85-7bbe-176f68fcddc5&t=05efd11e-5400-54a4-0d27-a4663be008a9&l=12577


was (Author: weijie guo):
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59839&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=11943

> Many tests fails on AZP as NPE related to FileMerging
> -
>
> Key: FLINK-35456
> URL: https://issues.apache.org/jira/browse/FLINK-35456
> Project: Flink
>  Issue Type: Bug
>  Components: Build System / CI
>Affects Versions: 1.20.0
>Reporter: Weijie Guo
>Priority: Blocker
>
> {code:java}
> May 25 02:12:16 Caused by: java.lang.NullPointerException
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.isManagedByFileMergingManager(FileMergingSnapshotManagerBase.java:733)
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.lambda$null$4(FileMergingSnapshotManagerBase.java:687)
> May 25 02:12:16   at java.util.HashMap.computeIfAbsent(HashMap.java:1127)
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.lambda$restoreStateHandles$5(FileMergingSnapshotManagerBase.java:683)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
> May 25 02:12:16   at 
> java.util.stream.Streams$StreamBuilderImpl.forEachRemaining(Streams.java:419)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
> May 25 02:12:16   at 
> java.util.ArrayList$Itr.forEachRemaining(ArrayList.java:901)
> May 25 02:12:16   at 
> java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
> May 25 02:12:16   at 
> java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
> May 25 02:12:16   at 
> java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
> May 25 02:12:16   at 
> java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
> May 25 02:12:16   at 
> java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> May 25 02:12:16   at 
> java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.restoreStateHandles(FileMergingSnapshotManagerBase.java:680)
> May 25 02:12:16   at 
> org.apache.flink.runtime.checkpoint.filemerging.SubtaskFileMergingManagerRestoreOperation.restore(SubtaskFileMergingManagerRestoreOperation.java:102)
> May 25 02:12:16   at 
> org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.registerRestoredStateToFileMergingManager(StreamTaskStateInitializerImpl.java:353)
> {c