[ 
https://issues.apache.org/jira/browse/CASSANDRA-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13039199#comment-13039199
 ] 

Marko Mikulicic commented on CASSANDRA-2671:
--------------------------------------------

perhaps I didn't mention it explicitly in the report. The number of compacted 
files which were deleted was small w.r.t the total number of compacted files 
which remained (309). 

Or, perhaps you mean that there is no problem because the compaction will be 
retried later ? In any case, I think it's wiser not get used to "Fatal 
exception" in the logs during normal operation.

(Furthermore I waited more than 10 minutes and the files were not deleted, but 
I currently don't have time to reproduce the whole scenario)

(This whole foolproof way to delegate the disk space freeing to the GC is 
interesting but I'm not feeling very confortable with it)

> Not deleting compacted files even on out of disk space condition
> ----------------------------------------------------------------
>
>                 Key: CASSANDRA-2671
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2671
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.7.6
>         Environment: Linux 64-bit ubuntu. Installed via deb package (datastax 
> distro)
>            Reporter: Marko Mikulicic
>
> I have a node consuming about 170 Gb and filling disk space:
>  INFO [CompactionExecutor:1] 2011-05-19 23:01:40,577 StorageService.java 
> (line 1888) requesting GC to free disk space
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,448 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1873
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,449 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1872
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,467 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1584
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,481 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1609
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,492 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1789
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,505 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1663
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,539 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1769
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:01:51,560 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1794
> ERROR [CompactionExecutor:1] 2011-05-19 23:02:02,461 
> AbstractCassandraDaemon.java (line 114) Fatal exception in thread 
> Thread[CompactionExecutor:1,1,main]
> java.io.IOException: disk full
>         at 
> org.apache.cassandra.db.CompactionManager.doCleanupCompaction(CompactionManager.java:697)
>         at 
> org.apache.cassandra.db.CompactionManager.access$500(CompactionManager.java:56)
>         at 
> org.apache.cassandra.db.CompactionManager$2.call(CompactionManager.java:173)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:05:00,502 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1874
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:05:00,503 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1875
>  INFO [NonPeriodicTasks:1] 2011-05-19 23:05:00,504 SSTable.java (line 147) 
> Deleted /var/lib/cassandra/data/dnet/body-f-1876
> Then it didn't continue to delete other files.
>  echo *Compacted | wc -l
> 309
> A lot of Compacted files remained (309). After restart they are deleted 
> during startup.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to