dlmarion opened a new issue, #3023: URL: https://github.com/apache/accumulo/issues/3023
External compactions are cancelled [here](https://github.com/apache/accumulo/blob/main/server/compactor/src/main/java/org/apache/accumulo/compactor/Compactor.java#L218) when a Tablet is split or merged. Calling JOB_HOLDER.cancel() in this case creates a lot of logging which ends up in the Monitor. This doesn't seem to be an exceptional case here, we might want to look at tuning the logging in this case and other cases where JOB_HOLDER.cancel is called. Here's what the log looked like: ``` 2022-10-14T15:00:07,822 [compaction.FileCompactor] ERROR: Interrupted while waiting for data to be acknowledged by pipeline java.io.InterruptedIOException: Interrupted while waiting for data to be acknowledged by pipeline at org.apache.hadoop.hdfs.DataStreamer.waitForAckedSeqno(DataStreamer.java:937) ~[hadoop-client-api-3.3.4.jar:?] at org.apache.hadoop.hdfs.DFSOutputStream.flushInternal(DFSOutputStream.java:778) ~[hadoop-client-api-3.3.4.jar:?] at org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:888) ~[hadoop-client-api-3.3.4.jar:?] at org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:847) ~[hadoop-client-api-3.3.4.jar:?] at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:77) ~[hadoop-client-api-3.3.4.jar:?] at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106) ~[hadoop-client-api-3.3.4.jar:?] at org.apache.accumulo.core.file.streams.RateLimitedOutputStream.close(RateLimitedOutputStream.java:54) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer.close(BCFile.java:368) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.core.file.rfile.RFile$Writer.close(RFile.java:635) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.server.compaction.FileCompactor.compactLocalityGroup(FileCompactor.java:393) ~[accumulo-server-base-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.server.compaction.FileCompactor.call(FileCompactor.java:234) ~[accumulo-server-base-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.compactor.Compactor.lambda$createCompactionJob$7(Compactor.java:569) ~[accumulo-compactor-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.core.trace.TraceWrappedRunnable.run(TraceWrappedRunnable.java:52) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at java.lang.Thread.run(Thread.java:829) ~[?:?] 2022-10-14T15:00:07,874 [server.GarbageCollectionLogger] DEBUG: gc G1 Young Generation=18.05(+0.08) secs G1 Old Generation=0.00(+0.00) secs freemem=81,075,656(-64,866,976) totalmem=268,435,456 2022-10-14T15:00:07,878 [compaction.FileCompactor] WARN : name=RFile.index org.apache.accumulo.core.file.rfile.bcfile.MetaBlockAlreadyExists: name=RFile.index at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer.prepareMetaBlock(BCFile.java:386) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.core.file.rfile.bcfile.BCFile$Writer.prepareMetaBlock(BCFile.java:410) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.core.file.rfile.RFile$Writer.close(RFile.java:606) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.server.compaction.FileCompactor.call(FileCompactor.java:275) ~[accumulo-server-base-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.compactor.Compactor.lambda$createCompactionJob$7(Compactor.java:569) ~[accumulo-compactor-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.core.trace.TraceWrappedRunnable.run(TraceWrappedRunnable.java:52) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at java.lang.Thread.run(Thread.java:829) ~[?:?] 2022-10-14T15:00:07,878 [compactor.Compactor] ERROR: Compaction failed org.apache.accumulo.server.compaction.FileCompactor$CompactionCanceledException: null at org.apache.accumulo.server.compaction.FileCompactor.compactLocalityGroup(FileCompactor.java:401) ~[accumulo-server-base-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.server.compaction.FileCompactor.call(FileCompactor.java:234) ~[accumulo-server-base-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.compactor.Compactor.lambda$createCompactionJob$7(Compactor.java:569) ~[accumulo-compactor-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at org.apache.accumulo.core.trace.TraceWrappedRunnable.run(TraceWrappedRunnable.java:52) ~[accumulo-core-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT] at java.lang.Thread.run(Thread.java:829) ~[?:?] 2022-10-14T15:00:07,885 [compactor.Compactor] INFO : Cancelling compaction ECID:00c58155-52e5-4948-b2df-77c082cffd1d that no longer has a metadata entry at 1;1ccd3;199999999999999c 2022-10-14T15:00:07,885 [compactor.Compactor] WARN : Compaction thread was interrupted, sending CANCELLED state ``` And the section of the monitor showing logs:  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
