MartijnVisser commented on PR #23489:
URL: https://github.com/apache/flink/pull/23489#issuecomment-1857672990
@JingGe @singhravidutt I think I've cracked it :)
1. I've setup a GCS bucket and created a checkpointing test job in order to
reproduce the error that's happening in Flink 1.18.0. That has worked:
```
2023-12-15 11:42:18,119 ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'jobmanager-io-thread-5' produced an uncaught exception. Stopping the process...
java.lang.NoSuchMethodError: 'com.google.common.collect.ImmutableMap
com.google.common.collect.ImmutableMap$Builder.buildOrThrow()'
```
2. I've tested my PR (which is based on 1.19-SNAPSHOT), with that
checkpointing works once more:
```
2023-12-15 11:32:01,039 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 1 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1702636321029 for job
d9bd270aefde98f6b9aec07f39e6e08b.
2023-12-15 11:32:01,931 INFO org.apache.flink.fs.gs.GSFileSystem
[] - Creating GSRecoverableWriter with file-system options
GSFileSystemOptions{writerTemporaryBucketName=Optional.empty,
writerChunkSize=Optional.empty}
2023-12-15 11:32:03,557 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 1 for job d9bd270aefde98f6b9aec07f39e6e08b (4201 bytes,
checkpointDuration=2526 ms, finalizationTime=2 ms).
2023-12-15 11:32:06,031 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 2 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1702636326028 for job
d9bd270aefde98f6b9aec07f39e6e08b.
2023-12-15 11:32:06,899 INFO org.apache.flink.fs.gs.GSFileSystem
[] - Creating GSRecoverableWriter with file-system options
GSFileSystemOptions{writerTemporaryBucketName=Optional.empty,
writerChunkSize=Optional.empty}
2023-12-15 11:32:08,287 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 2 for job d9bd270aefde98f6b9aec07f39e6e08b (4201 bytes,
checkpointDuration=2246 ms, finalizationTime=12 ms).
```
I'm currently testing if my patch would also work when backported to 1.18.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
