[
https://issues.apache.org/jira/browse/CASSANDRA-18770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vaibhav khedkar updated CASSANDRA-18770:
----------------------------------------
Description:
We recently upgraded our fleet of ~2500 Cassandra instances from 3.11.9 to
4.0.5.
After the upgrade, we are seeing a unique issue where the compacted SSTables's
file descriptors are still present and are never cleared. This is causing false
disk alerts. We have to restart nodes very often in order to reclaim the disk
space.
We use the *Apache* version of C* along with CentOS Linux 7.9.2009 and Java 8.
We are seeing it for all the tables (Filter, Data ..etc ) when checked with
`lsof` command
{code:java}
<path>/nb-1-big-Statistics.db.tmp (deleted)
<path>/nb-3-big-Statistics.db.tmp (deleted)
<path>/nb-2-big-Data.db (deleted)
<path>/nb-2-big-Statistics.db.tmp (deleted)
<path>/nb-2-big-Index.db (deleted)
<path>/nb-2-big-Statistics.db.tmp (deleted)
<path>/nb-2-big-CompressionInfo.db (deleted)
<path>/nb-2-big-Filter.db (deleted)
<path>/nb-2-big-Summary.db (deleted)
<path>/nb-2-big-Digest.crc32 (deleted)
{code}
was:
We recently upgraded our fleet of ~2500 Cassandra instances from 3.11.9 to
4.0.5.
After the upgrade, we are seeing a unique issue where the compacted SSTables's
file descriptors are still present and are never cleared. This is causing false
disk alerts. We have to restart nodes very often in order to reclaim the disk
space.
We use the *Apache* version of C* along with CentOS Linux 7.9.2009 and Java 8.
We are seeing it for all the tables (Filter, Data ..etc ) when checked with
`lsof` command
```
<path>/nb-1-big-Statistics.db.tmp (deleted)
<path>/nb-3-big-Statistics.db.tmp (deleted)
<path>/nb-2-big-Data.db (deleted)
<path>/nb-2-big-Statistics.db.tmp (deleted)
<path>/nb-2-big-Index.db (deleted)
<path>/nb-2-big-Statistics.db.tmp (deleted)
<path>/nb-2-big-CompressionInfo.db (deleted)
<path>/nb-2-big-Filter.db (deleted)
<path>/nb-2-big-Summary.db (deleted)
<path>/nb-2-big-Digest.crc32 (deleted)
```
> Open File Descriptors not cleared post upgrade from 3.11.9 to 4.0.5
> -------------------------------------------------------------------
>
> Key: CASSANDRA-18770
> URL: https://issues.apache.org/jira/browse/CASSANDRA-18770
> Project: Cassandra
> Issue Type: Bug
> Reporter: vaibhav khedkar
> Priority: Normal
>
> We recently upgraded our fleet of ~2500 Cassandra instances from 3.11.9 to
> 4.0.5.
> After the upgrade, we are seeing a unique issue where the compacted
> SSTables's file descriptors are still present and are never cleared. This is
> causing false disk alerts. We have to restart nodes very often in order to
> reclaim the disk space.
> We use the *Apache* version of C* along with CentOS Linux 7.9.2009 and Java 8.
> We are seeing it for all the tables (Filter, Data ..etc ) when checked with
> `lsof` command
> {code:java}
> <path>/nb-1-big-Statistics.db.tmp (deleted)
> <path>/nb-3-big-Statistics.db.tmp (deleted)
> <path>/nb-2-big-Data.db (deleted)
> <path>/nb-2-big-Statistics.db.tmp (deleted)
> <path>/nb-2-big-Index.db (deleted)
> <path>/nb-2-big-Statistics.db.tmp (deleted)
> <path>/nb-2-big-CompressionInfo.db (deleted)
> <path>/nb-2-big-Filter.db (deleted)
> <path>/nb-2-big-Summary.db (deleted)
> <path>/nb-2-big-Digest.crc32 (deleted)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org
