[
https://issues.apache.org/jira/browse/CASSANDRA-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13004916#comment-13004916
]
Jason Harvey commented on CASSANDRA-2304:
-----------------------------------------
Output from lsof. Thousands of lines of the following:
{code}
java 1766 root 1080r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1081r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1082r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1083r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1084r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1085r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1086r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1087r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1088r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1089r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1090r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1091r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1092r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1093r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1094r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
java 1766 root 1095r REG 251,0 11809597 32374948
/var/lib/cassandra/data/reddit/Hide-f-734-Data.db
{code}
> sstable2json dies with "Too many open files", regardless of ulimit
> ------------------------------------------------------------------
>
> Key: CASSANDRA-2304
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2304
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jason Harvey
> Attachments: sstable.tar.bz2
>
>
> Running sstable2json on the attached sstable eventually results in the
> following:
> {code}
> Exception in thread "main" java.io.IOError: java.io.FileNotFoundException:
> /var/lib/cassandra/data/reddit/CommentSortsCache-f-9764-Data.db (Too many
> open files)
> at
> org.apache.cassandra.io.util.BufferedSegmentedFile.getSegment(BufferedSegmentedFile.java:68)
> at
> org.apache.cassandra.io.sstable.SSTableReader.getFileDataInput(SSTableReader.java:567)
> at
> org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:49)
> at
> org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:68)
> at
> org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:80)
> at
> org.apache.cassandra.tools.SSTableExport.serializeRow(SSTableExport.java:187)
> at
> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:355)
> at
> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:377)
> at
> org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:390)
> at
> org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:448)
> Caused by: java.io.FileNotFoundException:
> /var/lib/cassandra/data/reddit/CommentSortsCache-f-9764-Data.db (Too many
> open files)
> at java.io.RandomAccessFile.open(Native Method)
> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
> at
> org.apache.cassandra.io.util.BufferedRandomAccessFile.<init>(BufferedRandomAccessFile.java:111)
> at
> org.apache.cassandra.io.util.BufferedRandomAccessFile.<init>(BufferedRandomAccessFile.java:106)
> at
> org.apache.cassandra.io.util.BufferedRandomAccessFile.<init>(BufferedRandomAccessFile.java:91)
> at
> org.apache.cassandra.io.util.BufferedSegmentedFile.getSegment(BufferedSegmentedFile.java:62)
> {code}
> Set my ulimit -n to 60000 and got the same result. Leaking file descriptors?
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
