[ https://issues.apache.org/jira/browse/CASSANDRA-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155282#comment-13155282 ]
Peter Velas commented on CASSANDRA-3521: ---------------------------------------- progress line is updating and bitrate is changing but it never ends. And my CF is still empty. {noformat} sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed Starting client (and waiting 30 seconds for gossip) ... Streaming revelant part of Impressions_compressed/Hid-hb-9-Data.db Impressions_compressed/Impression-hb-11-Data.db Impressions_compressed/HidSaid-hb-9-Data.db to [/10.20.30.135] progress: [/10.20.30.135 0/3 (3851)] [total: 3851 - 7MB/s (avg: 6MB/s)] {noformat} {noformat} [default@Impressions_compressed] list Impression; Using default limit of 100 0 Row Returned. {noformat} When I tried to list files from OS point of view (loading only one CF right now) Its looks like some loop . Streaming data to file and when it reach 200 MB start with new file and increase by 1. {noformat} [root@cass101 Impressions_compressed]# ls -sh1 total 193M 28K Impression-tmp-hb-59-CompressionInfo.db 193M Impression-tmp-hb-59-Data.db 0 Impression-tmp-hb-59-Index.db [root@cass101 Impressions_compressed]# ls -sh1 total 2.0M 4.0K Impression-tmp-hb-60-CompressionInfo.db 2.0M Impression-tmp-hb-60-Data.db 0 Impression-tmp-hb-60-Index.db {noformat} Hope now its better described . > sstableloader throwing exceptions when loading snapshot data from compressed > CFs > -------------------------------------------------------------------------------- > > Key: CASSANDRA-3521 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3521 > Project: Cassandra > Issue Type: Bug > Environment: One node cluster (same problem with 4 nodes ) and > dedicated machine for sstable loader. > node and loader running jdk1.6.0_29 and cassandra-1.0.3 > Reporter: Peter Velas > > Loaded data from snapshot then enabled `sstable_compression: > org.apache.cassandra.io.compress.SnappyCompressor` > Then flush, scrub and compact. I can see actual CompressionRatio in JMX > Console and access my data without problems.. > Now I snapshot compressed keyspace and when trying to load snapshot to > another single node or different Keyspace (the same super CF structure with > compression options enabled, even try to truncate snapshoted CFs.) I cant > load any data. > sstableloader command with debug mode dont throw any errors and shows its > streaming > {quote} > sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed/ > {quote} > Node logs contains repeating the errors bellow. > {quote} > ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line > 133) Fatal exception in thread Thread[Thread-319,5,main] > java.lang.AssertionError: attempted to delete non-existing file > HidSaid-tmp-hb-260-Data.db > at > org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49) > at > org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170) > at > org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92) > at > org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184) > at > org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81) > INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120) > Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1 > progress=0/5616749 - 0% from > org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a > retry. > ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line > 133) Fatal exception in thread Thread[Thread-320,5,main] > java.lang.AssertionError: attempted to delete non-existing file > HidSaid-tmp-hb-261-Data.db > at > org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49) > at > org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170) > at > org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92) > at > org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184) > at > org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81) > {quote} > Hope its enough if you need more info just tell me what you need to reproduce > this bug. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira