[
https://issues.apache.org/jira/browse/CASSANDRA-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Will Zhang updated CASSANDRA-10778:
-----------------------------------
Description:
Hi,
I have been running some test for upgrading from v2.2.2 to v3.0.0. I
encountered the following `ERROR` in the `system.log`. I did some searches
online but couldn't find anything useful so filing this. The log seem to
suggest that it is bug-like.
Any thoughts on this would be appreciated.
{code}
INFO [SharedPool-Worker-2] 2015-11-26 15:25:37,152
MigrationManager.java:336 - Create new view:
org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT NULL
AND broker IS NOT
NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
read_repair_chance=0.0, dclocal_read_repair_chance=0.1,
bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000,
default_time_to_live=0, memtable_flush_period_in_ms=0, min_index_interval=128,
max_index_interval=2048, speculative_retry=99PERCENTILE, caching={'keys' :
'ALL', 'rows_per_partition' : 'NONE'},
compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
options={min_threshold=4, max_threshold=32}},
compression=org.apache.cassandra.schema.CompressionParams@f3ef4959,
extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
org.apache.cassandra.db.marshal.UTF8Type,
org.apache.cassandra.db.marshal.UTF8Type,
org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | [bmark_spread
g_spread is_axed oas_spread price size ytw
z_spread]],partitionKeyColumns=[ColumnDefinition{name=date,
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY,
position=0}],clusteringColumns=[ColumnDefinition{name=datetime,
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
kind=CLUSTERING, position=0}, ColumnDefinition{name=side,
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1},
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type,
kind=CLUSTERING, position=2}, ColumnDefinition{name=broker,
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING,
position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=datetime,
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
kind=CLUSTERING, position=0}, ColumnDefinition{name=date,
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY,
position=0}, ColumnDefinition{name=oas_spread,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type,
kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type,
kind=CLUSTERING, position=1}, ColumnDefinition{name=broker,
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3},
ColumnDefinition{name=is_axed,
type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1},
ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType,
kind=REGULAR, position=-1}, ColumnDefinition{name=price,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=g_spread, type=org.apache.cassandra.db.marshal.FloatType,
kind=REGULAR, position=-1}, ColumnDefinition{name=size,
type=org.apache.cassandra.db.marshal.DoubleType, kind=REGULAR,
position=-1}],droppedColumns={},triggers=[],indexes=[]]]
INFO [MigrationStage:1] 2015-11-26 15:25:37,440 ColumnFamilyStore.java:381
- Initializing demo.broker_quotes_by_date
ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033
CassandraDaemon.java:195 - Exception in thread
Thread[CompactionExecutor:4,1,main]
java.lang.AssertionError: We read old index files but we should never write
them
at
org.apache.cassandra.db.RowIndexEntry$Serializer.serialize(RowIndexEntry.java:130)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.service.CacheService$KeyCacheSerializer.serialize(CacheService.java:466)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.service.CacheService$KeyCacheSerializer.serialize(CacheService.java:454)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.cache.AutoSavingCache$Writer.saveCache(AutoSavingCache.java:358)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.db.compaction.CompactionManager$12.run(CompactionManager.java:1302)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_60]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_60]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
~[na:1.8.0_60]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
INFO [IndexSummaryManager:1] 2015-11-26 15:41:10,729
IndexSummaryManager.java:257 - Redistributing index summaries
{code}
was:
Hi,
I have been running some test for upgrading from v2.2.2 to v3.0.0. I
encountered the following `ERROR` in the `system.log`. I did some searches
online but couldn't find anything useful so filing this. The log seem to
suggest that it is bug-like.
Any thoughts on this would be appreciated.
INFO [MigrationStage:1] 2015-11-26 15:21:56,612 ColumnFamilyStore.java:381
- Initializing demo.broker_quotes_by_date
INFO [SharedPool-Worker-1] 2015-11-26 15:25:32,113
MigrationManager.java:455 - Drop table 'demo/broker_quotes_by_date'
INFO [SharedPool-Worker-2] 2015-11-26 15:25:37,152
MigrationManager.java:336 - Create new view:
org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT NULL
AND broker IS NOT
NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
read_repair_chance=0.0, dclocal_read_repair_chance=0.1,
bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000,
default_time_to_live=0, memtable_flush_period_in_ms=0, min_index_interval=128,
max_index_interval=2048, speculative_retry=99PERCENTILE, caching={'keys' :
'ALL', 'rows_per_partition' : 'NONE'},
compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
options={min_threshold=4, max_threshold=32}},
compression=org.apache.cassandra.schema.CompressionParams@f3ef4959,
extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
org.apache.cassandra.db.marshal.UTF8Type,
org.apache.cassandra.db.marshal.UTF8Type,
org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | [bmark_spread
g_spread is_axed oas_spread price size ytw
z_spread]],partitionKeyColumns=[ColumnDefinition{name=date,
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY,
position=0}],clusteringColumns=[ColumnDefinition{name=datetime,
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
kind=CLUSTERING, position=0}, ColumnDefinition{name=side,
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1},
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type,
kind=CLUSTERING, position=2}, ColumnDefinition{name=broker,
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING,
position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=datetime,
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
kind=CLUSTERING, position=0}, ColumnDefinition{name=date,
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY,
position=0}, ColumnDefinition{name=oas_spread,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type,
kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type,
kind=CLUSTERING, position=1}, ColumnDefinition{name=broker,
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3},
ColumnDefinition{name=is_axed,
type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1},
ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType,
kind=REGULAR, position=-1}, ColumnDefinition{name=price,
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
ColumnDefinition{name=g_spread, type=org.apache.cassandra.db.marshal.FloatType,
kind=REGULAR, position=-1}, ColumnDefinition{name=size,
type=org.apache.cassandra.db.marshal.DoubleType, kind=REGULAR,
position=-1}],droppedColumns={},triggers=[],indexes=[]]]
INFO [MigrationStage:1] 2015-11-26 15:25:37,440 ColumnFamilyStore.java:381
- Initializing demo.broker_quotes_by_date
ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033
CassandraDaemon.java:195 - Exception in thread
Thread[CompactionExecutor:4,1,main]
java.lang.AssertionError: We read old index files but we should never write
them
at
org.apache.cassandra.db.RowIndexEntry$Serializer.serialize(RowIndexEntry.java:130)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.service.CacheService$KeyCacheSerializer.serialize(CacheService.java:466)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.service.CacheService$KeyCacheSerializer.serialize(CacheService.java:454)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.cache.AutoSavingCache$Writer.saveCache(AutoSavingCache.java:358)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
org.apache.cassandra.db.compaction.CompactionManager$12.run(CompactionManager.java:1302)
~[apache-cassandra-3.0.0.jar:3.0.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_60]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_60]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
~[na:1.8.0_60]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
INFO [IndexSummaryManager:1] 2015-11-26 15:41:10,729
IndexSummaryManager.java:257 - Redistributing index summaries
> CompactionExecutor writing to old index files
> ---------------------------------------------
>
> Key: CASSANDRA-10778
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10778
> Project: Cassandra
> Issue Type: Bug
> Components: Compaction
> Environment: Windows 7 64-bit, Cassandra 3.0.0, Java 1.8u60
> Reporter: Will Zhang
> Labels: error
>
> Hi,
> I have been running some test for upgrading from v2.2.2 to v3.0.0. I
> encountered the following `ERROR` in the `system.log`. I did some searches
> online but couldn't find anything useful so filing this. The log seem to
> suggest that it is bug-like.
> Any thoughts on this would be appreciated.
> {code}
> INFO [SharedPool-Worker-2] 2015-11-26 15:25:37,152
> MigrationManager.java:336 - Create new view:
> org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
> IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT
> NULL AND broker IS NOT
> NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
> read_repair_chance=0.0, dclocal_read_repair_chance=0.1,
> bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000,
> default_time_to_live=0, memtable_flush_period_in_ms=0,
> min_index_interval=128, max_index_interval=2048,
> speculative_retry=99PERCENTILE, caching={'keys' : 'ALL', 'rows_per_partition'
> : 'NONE'},
> compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
> options={min_threshold=4, max_threshold=32}},
> compression=org.apache.cassandra.schema.CompressionParams@f3ef4959,
> extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
> org.apache.cassandra.db.marshal.UTF8Type,
> org.apache.cassandra.db.marshal.UTF8Type,
> org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] |
> [bmark_spread g_spread is_axed oas_spread price size ytw
> z_spread]],partitionKeyColumns=[ColumnDefinition{name=date,
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY,
> position=0}],clusteringColumns=[ColumnDefinition{name=datetime,
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
> kind=CLUSTERING, position=0}, ColumnDefinition{name=side,
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1},
> ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type,
> kind=CLUSTERING, position=2}, ColumnDefinition{name=broker,
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING,
> position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
> ColumnDefinition{name=datetime,
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
> kind=CLUSTERING, position=0}, ColumnDefinition{name=date,
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY,
> position=0}, ColumnDefinition{name=oas_spread,
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
> ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type,
> kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread,
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
> ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type,
> kind=CLUSTERING, position=1}, ColumnDefinition{name=broker,
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3},
> ColumnDefinition{name=is_axed,
> type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1},
> ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType,
> kind=REGULAR, position=-1}, ColumnDefinition{name=price,
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
> ColumnDefinition{name=g_spread,
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1},
> ColumnDefinition{name=size, type=org.apache.cassandra.db.marshal.DoubleType,
> kind=REGULAR, position=-1}],droppedColumns={},triggers=[],indexes=[]]]
> INFO [MigrationStage:1] 2015-11-26 15:25:37,440
> ColumnFamilyStore.java:381 - Initializing demo.broker_quotes_by_date
> ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033
> CassandraDaemon.java:195 - Exception in thread
> Thread[CompactionExecutor:4,1,main]
> java.lang.AssertionError: We read old index files but we should never
> write them
> at
> org.apache.cassandra.db.RowIndexEntry$Serializer.serialize(RowIndexEntry.java:130)
> ~[apache-cassandra-3.0.0.jar:3.0.0]
> at
> org.apache.cassandra.service.CacheService$KeyCacheSerializer.serialize(CacheService.java:466)
> ~[apache-cassandra-3.0.0.jar:3.0.0]
> at
> org.apache.cassandra.service.CacheService$KeyCacheSerializer.serialize(CacheService.java:454)
> ~[apache-cassandra-3.0.0.jar:3.0.0]
> at
> org.apache.cassandra.cache.AutoSavingCache$Writer.saveCache(AutoSavingCache.java:358)
> ~[apache-cassandra-3.0.0.jar:3.0.0]
> at
> org.apache.cassandra.db.compaction.CompactionManager$12.run(CompactionManager.java:1302)
> ~[apache-cassandra-3.0.0.jar:3.0.0]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> ~[na:1.8.0_60]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ~[na:1.8.0_60]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> ~[na:1.8.0_60]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_60]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
> INFO [IndexSummaryManager:1] 2015-11-26 15:41:10,729
> IndexSummaryManager.java:257 - Redistributing index summaries
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
