[
https://issues.apache.org/jira/browse/CASSANDRA-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuki Morishita updated CASSANDRA-3521:
--------------------------------------
Attachment: 3521.txt
Thanks for the detail, Peter.
Current version of sstableloader seems it does not pick up sstable's
compression info before start streaming, and that causes receiver node handle
streaming data incorrectly.
Attached patch let sstableloader to pick up compression information if
available.
> sstableloader throwing exceptions when loading snapshot data from compressed
> CFs
> --------------------------------------------------------------------------------
>
> Key: CASSANDRA-3521
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3521
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Environment: One node cluster (same problem with 4 nodes ) and
> dedicated machine for sstable loader.
> node and loader running jdk1.6.0_29 and cassandra-1.0.3
> Reporter: Peter Velas
> Assignee: Yuki Morishita
> Labels: compression
> Fix For: 1.0.4
>
> Attachments: 3521.txt
>
>
> Loaded data from snapshot then enabled `sstable_compression:
> org.apache.cassandra.io.compress.SnappyCompressor`
> Then flush, scrub and compact. I can see actual CompressionRatio in JMX
> Console and access my data without problems..
> Now I snapshot compressed keyspace and when trying to load snapshot to
> another single node or different Keyspace (the same super CF structure with
> compression options enabled, even try to truncate snapshoted CFs.) I cant
> retrieve any records .
> sstableloader command with debug mode dont throw any errors and shows its
> streaming
> {quote}
> sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed/
> {quote}
> Node logs contains repeating the errors bellow.
> {quote}
> ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line
> 133) Fatal exception in thread Thread[Thread-319,5,main]
> java.lang.AssertionError: attempted to delete non-existing file
> HidSaid-tmp-hb-260-Data.db
> at
> org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
> at
> org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
> INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120)
> Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1
> progress=0/5616749 - 0% from
> org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a
> retry.
> ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line
> 133) Fatal exception in thread Thread[Thread-320,5,main]
> java.lang.AssertionError: attempted to delete non-existing file
> HidSaid-tmp-hb-261-Data.db
> at
> org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
> at
> org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
> {quote}
> Hope its enough if you need more info just tell me what you need to reproduce
> this bug.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
