[jira] [Commented] (CASSANDRA-9116) Indexes lost on upgrading to 2.1.4

2015-04-09 Thread Yuki Morishita (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487543#comment-14487543
 ] 

Yuki Morishita commented on CASSANDRA-9116:
---

+1 for the patch.
[~mildewey] Can you also test the patch with your upgrade test?

 Indexes lost on upgrading to 2.1.4
 --

 Key: CASSANDRA-9116
 URL: https://issues.apache.org/jira/browse/CASSANDRA-9116
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Reporter: Mark Dewey
Assignee: Sam Tunnicliffe
Priority: Blocker
 Fix For: 2.1.5

 Attachments: 9116.txt


 How to reproduce:
 # Create a 2.0.12 cluster
 # Create the following keyspace/table (or something similar, it's primarily 
 the indexes that matter to this case afaict)
 {noformat}
 CREATE KEYSPACE tshirts WITH replication = {'class': 
 'NetworkTopologyStrategy', 'datacenter1': '1'}  AND durable_writes = true;
 CREATE TABLE tshirts.tshirtorders (
 store text,
 order_time timestamp,
 order_number uuid,
 color text,
 qty int,
 size text,
 PRIMARY KEY (store, order_time, order_number)
 ) WITH CLUSTERING ORDER BY (order_time ASC, order_number ASC)
 AND bloom_filter_fp_chance = 0.01
 AND caching = '{keys:ALL, rows_per_partition:NONE}'
 AND comment = ''
 AND compaction = {'min_threshold': '4', 'class': 
 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 
 'max_threshold': '32'}
 AND compression = {'sstable_compression': 
 'org.apache.cassandra.io.compress.LZ4Compressor'}
 AND dclocal_read_repair_chance = 0.1
 AND default_time_to_live = 0
 AND gc_grace_seconds = 864000
 AND max_index_interval = 2048
 AND memtable_flush_period_in_ms = 0
 AND min_index_interval = 128
 AND read_repair_chance = 0.0
 AND speculative_retry = '99.0PERCENTILE';
 CREATE INDEX color ON tshirts.tshirtorders (color);
 CREATE INDEX size ON tshirts.tshirtorders (size);
 {noformat}
 # Load it with data
 # Stop the node (one node cluster is enough to replicate)
 # Upgrade the node to 2.1.4
 # Start the node
 # Optional: Run nodetool upgradesstables
 # Run the following queries:
 {noformat}
 SELECT * FROM tshirts.tshirtorders WHERE store = 'store 65';
 SELECT store, color, qty, size FROM tshirts.tshirtorders WHERE store = 'store 
 65' AND color = 'red';
 {noformat}
 No rows containing will appear in the indexed table.
 Sample output:
 {noformat}
 cqlsh SELECT * FROM tshirts.tshirtorders WHERE store = 'store 65';
  store| order_time   | order_number | 
 color  | qty  | size
 --+--+--++--+--
  store 65 | 2000-01-03 18:20:20+ | 457e60e6-da39-11e4-add3-42010af08298 | 
red | 1295 |M
  store 65 | 2000-01-04 01:29:21+ | 45947304-da39-11e4-add3-42010af08298 | 
   grey | 2805 |M
  store 65 | 2000-01-04 19:55:51+ | 45d69220-da39-11e4-add3-42010af08298 | 
  brown | 3380 | XXXL
  store 65 | 2000-01-04 22:45:07+ | 45e16894-da39-11e4-add3-42010af08298 | 
 yellow | 7000 |  XXL
  store 65 | 2000-01-05 17:09:56+ | 46083bd6-da39-11e4-add3-42010af08298 | 
 purple | 2440 |S
  store 65 | 2000-01-05 19:16:48+ | 460cadd8-da39-11e4-add3-42010af08298 | 
  green | 5690 |L
  store 65 | 2000-01-06 00:26:06+ | 461ccdbc-da39-11e4-add3-42010af08298 | 
  brown | 9890 |P
  store 65 | 2000-01-06 11:35:11+ | 4633aa00-da39-11e4-add3-42010af08298 | 
  black | 9350 |P
  store 65 | 2000-01-07 06:07:20+ | 4658e0ea-da39-11e4-add3-42010af08298 | 
  black | 1300 |S
  store 65 | 2000-01-07 06:47:40+ | 465be93e-da39-11e4-add3-42010af08298 | 
 purple | 9630 |   XL
  store 65 | 2000-01-09 12:42:38+ | 46bafdd4-da39-11e4-add3-42010af08298 | 
 purple | 1470 |M
  store 65 | 2000-01-09 19:07:35+ | 46c43e08-da39-11e4-add3-42010af08298 | 
   pink | 6005 |S
  store 65 | 2000-01-10 04:47:56+ | 46d4b170-da39-11e4-add3-42010af08298 | 
red |  345 |   XL
  store 65 | 2000-01-10 20:25:44+ | 46ef7d52-da39-11e4-add3-42010af08298 | 
   pink |  420 |  XXL
  store 65 | 2000-01-11 00:55:27+ | 46f7a84c-da39-11e4-add3-42010af08298 | 
 purple | 9045 |S
  store 65 | 2000-01-11 17:54:25+ | 4724ea00-da39-11e4-add3-42010af08298 | 
  green | 5030 |  XXL
  store 65 | 2000-01-12 08:21:15+ | 473c0370-da39-11e4-add3-42010af08298 | 
  white | 2860 |   XL
  store 65 | 2000-01-12 17:09:19+ | 47497d2a-da39-11e4-add3-42010af08298 | 
red | 6425 |L
  store 65 | 2000-01-14 07:27:37+ | 478662a8-da39-11e4-add3-42010af08298 | 
   pink |  330 | XXXL
  store 65 | 2000-01-14 11:31:38+ | 478b43cc-da39-11e4-add3-42010af08298 | 
   pink | 3335 |  XXL
  store 65 | 2000-01-14 18:55:59+ | 

[jira] [Commented] (CASSANDRA-9116) Indexes lost on upgrading to 2.1.4

2015-04-03 Thread Mark Dewey (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395096#comment-14395096
 ] 

Mark Dewey commented on CASSANDRA-9116:
---

In tests against a three-node cluster, when two nodes are on 2.1.4 and one node 
is on 2.0.12, the following exception shows up in the system.log:
{noformat}
ERROR [Thread-18] 2015-04-03 16:02:04,366 CassandraDaemon.java (line 199) 
Exception in thread Thread[Thread-18,5,main]
java.lang.NullPointerException
at 
org.apache.cassandra.db.RangeSliceCommandSerializer.deserialize(RangeSliceCommand.java:247)
at 
org.apache.cassandra.db.RangeSliceCommandSerializer.deserialize(RangeSliceCommand.java:156)
at org.apache.cassandra.net.MessageIn.read(MessageIn.java:99)
at 
org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:149)
at 
org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:131)
at 
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:74)
{noformat}

 Indexes lost on upgrading to 2.1.4
 --

 Key: CASSANDRA-9116
 URL: https://issues.apache.org/jira/browse/CASSANDRA-9116
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Reporter: Mark Dewey
Assignee: Sam Tunnicliffe
Priority: Blocker
 Fix For: 2.1.5


 How to reproduce:
 # Create a 2.0.12 cluster
 # Create the following keyspace/table (or something similar, it's primarily 
 the indexes that matter to this case afaict)
 {noformat}
 CREATE KEYSPACE tshirts WITH replication = {'class': 
 'NetworkTopologyStrategy', 'datacenter1': '1'}  AND durable_writes = true;
 CREATE TABLE tshirts.tshirtorders (
 store text,
 order_time timestamp,
 order_number uuid,
 color text,
 qty int,
 size text,
 PRIMARY KEY (store, order_time, order_number)
 ) WITH CLUSTERING ORDER BY (order_time ASC, order_number ASC)
 AND bloom_filter_fp_chance = 0.01
 AND caching = '{keys:ALL, rows_per_partition:NONE}'
 AND comment = ''
 AND compaction = {'min_threshold': '4', 'class': 
 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 
 'max_threshold': '32'}
 AND compression = {'sstable_compression': 
 'org.apache.cassandra.io.compress.LZ4Compressor'}
 AND dclocal_read_repair_chance = 0.1
 AND default_time_to_live = 0
 AND gc_grace_seconds = 864000
 AND max_index_interval = 2048
 AND memtable_flush_period_in_ms = 0
 AND min_index_interval = 128
 AND read_repair_chance = 0.0
 AND speculative_retry = '99.0PERCENTILE';
 CREATE INDEX color ON tshirts.tshirtorders (color);
 CREATE INDEX size ON tshirts.tshirtorders (size);
 {noformat}
 # Load it with data
 # Stop the node (one node cluster is enough to replicate)
 # Upgrade the node to 2.1.4
 # Start the node
 # Optional: Run nodetool upgradesstables
 # Run the following queries:
 {noformat}
 SELECT * FROM tshirts.tshirtorders WHERE store = 'store 65';
 SELECT store, color, qty, size FROM tshirts.tshirtorders WHERE store = 'store 
 65' AND color = 'red';
 {noformat}
 No rows containing will appear in the indexed table.
 Sample output:
 {noformat}
 cqlsh SELECT * FROM tshirts.tshirtorders WHERE store = 'store 65';
  store| order_time   | order_number | 
 color  | qty  | size
 --+--+--++--+--
  store 65 | 2000-01-03 18:20:20+ | 457e60e6-da39-11e4-add3-42010af08298 | 
red | 1295 |M
  store 65 | 2000-01-04 01:29:21+ | 45947304-da39-11e4-add3-42010af08298 | 
   grey | 2805 |M
  store 65 | 2000-01-04 19:55:51+ | 45d69220-da39-11e4-add3-42010af08298 | 
  brown | 3380 | XXXL
  store 65 | 2000-01-04 22:45:07+ | 45e16894-da39-11e4-add3-42010af08298 | 
 yellow | 7000 |  XXL
  store 65 | 2000-01-05 17:09:56+ | 46083bd6-da39-11e4-add3-42010af08298 | 
 purple | 2440 |S
  store 65 | 2000-01-05 19:16:48+ | 460cadd8-da39-11e4-add3-42010af08298 | 
  green | 5690 |L
  store 65 | 2000-01-06 00:26:06+ | 461ccdbc-da39-11e4-add3-42010af08298 | 
  brown | 9890 |P
  store 65 | 2000-01-06 11:35:11+ | 4633aa00-da39-11e4-add3-42010af08298 | 
  black | 9350 |P
  store 65 | 2000-01-07 06:07:20+ | 4658e0ea-da39-11e4-add3-42010af08298 | 
  black | 1300 |S
  store 65 | 2000-01-07 06:47:40+ | 465be93e-da39-11e4-add3-42010af08298 | 
 purple | 9630 |   XL
  store 65 | 2000-01-09 12:42:38+ | 46bafdd4-da39-11e4-add3-42010af08298 | 
 purple | 1470 |M
  store 65 | 2000-01-09 19:07:35+ | 46c43e08-da39-11e4-add3-42010af08298 | 
   pink | 6005 |S
  store 65 | 2000-01-10 04:47:56+ | 46d4b170-da39-11e4-add3-42010af08298 | 
red |  345 |   XL
  

[jira] [Commented] (CASSANDRA-9116) Indexes lost on upgrading to 2.1.4

2015-04-03 Thread Mark Dewey (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395067#comment-14395067
 ] 

Mark Dewey commented on CASSANDRA-9116:
---

Reach out to me to get the generator I used to fill data into the table if you 
need to use my exact tables.

 Indexes lost on upgrading to 2.1.4
 --

 Key: CASSANDRA-9116
 URL: https://issues.apache.org/jira/browse/CASSANDRA-9116
 Project: Cassandra
  Issue Type: Bug
  Components: Core
Reporter: Mark Dewey
Priority: Blocker
 Fix For: 2.1.5


 How to reproduce:
 # Create a 2.0.12 cluster
 # Create the following keyspace/table (or something similar, it's primarily 
 the indexes that matter to this case afaict)
 {noformat}
 CREATE KEYSPACE tshirts WITH replication = {'class': 
 'NetworkTopologyStrategy', 'datacenter1': '1'}  AND durable_writes = true;
 CREATE TABLE tshirts.tshirtorders (
 store text,
 order_time timestamp,
 order_number uuid,
 color text,
 qty int,
 size text,
 PRIMARY KEY (store, order_time, order_number)
 ) WITH CLUSTERING ORDER BY (order_time ASC, order_number ASC)
 AND bloom_filter_fp_chance = 0.01
 AND caching = '{keys:ALL, rows_per_partition:NONE}'
 AND comment = ''
 AND compaction = {'min_threshold': '4', 'class': 
 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 
 'max_threshold': '32'}
 AND compression = {'sstable_compression': 
 'org.apache.cassandra.io.compress.LZ4Compressor'}
 AND dclocal_read_repair_chance = 0.1
 AND default_time_to_live = 0
 AND gc_grace_seconds = 864000
 AND max_index_interval = 2048
 AND memtable_flush_period_in_ms = 0
 AND min_index_interval = 128
 AND read_repair_chance = 0.0
 AND speculative_retry = '99.0PERCENTILE';
 CREATE INDEX color ON tshirts.tshirtorders (color);
 CREATE INDEX size ON tshirts.tshirtorders (size);
 {noformat}
 # Load it with data
 # Stop the node (one node cluster is enough to replicate)
 # Upgrade the node to 2.1.4
 # Start the node
 # Optional: Run nodetool upgradesstables
 # Run the following queries:
 {noformat}
 SELECT * FROM tshirts.tshirtorders WHERE store = 'store 65';
 SELECT store, color, qty, size FROM tshirts.tshirtorders WHERE store = 'store 
 65' AND color = 'red';
 {noformat}
 No rows containing will appear in the indexed table.
 Sample output:
 {noformat}
 cqlsh SELECT * FROM tshirts.tshirtorders WHERE store = 'store 65';
  store| order_time   | order_number | 
 color  | qty  | size
 --+--+--++--+--
  store 65 | 2000-01-03 18:20:20+ | 457e60e6-da39-11e4-add3-42010af08298 | 
red | 1295 |M
  store 65 | 2000-01-04 01:29:21+ | 45947304-da39-11e4-add3-42010af08298 | 
   grey | 2805 |M
  store 65 | 2000-01-04 19:55:51+ | 45d69220-da39-11e4-add3-42010af08298 | 
  brown | 3380 | XXXL
  store 65 | 2000-01-04 22:45:07+ | 45e16894-da39-11e4-add3-42010af08298 | 
 yellow | 7000 |  XXL
  store 65 | 2000-01-05 17:09:56+ | 46083bd6-da39-11e4-add3-42010af08298 | 
 purple | 2440 |S
  store 65 | 2000-01-05 19:16:48+ | 460cadd8-da39-11e4-add3-42010af08298 | 
  green | 5690 |L
  store 65 | 2000-01-06 00:26:06+ | 461ccdbc-da39-11e4-add3-42010af08298 | 
  brown | 9890 |P
  store 65 | 2000-01-06 11:35:11+ | 4633aa00-da39-11e4-add3-42010af08298 | 
  black | 9350 |P
  store 65 | 2000-01-07 06:07:20+ | 4658e0ea-da39-11e4-add3-42010af08298 | 
  black | 1300 |S
  store 65 | 2000-01-07 06:47:40+ | 465be93e-da39-11e4-add3-42010af08298 | 
 purple | 9630 |   XL
  store 65 | 2000-01-09 12:42:38+ | 46bafdd4-da39-11e4-add3-42010af08298 | 
 purple | 1470 |M
  store 65 | 2000-01-09 19:07:35+ | 46c43e08-da39-11e4-add3-42010af08298 | 
   pink | 6005 |S
  store 65 | 2000-01-10 04:47:56+ | 46d4b170-da39-11e4-add3-42010af08298 | 
red |  345 |   XL
  store 65 | 2000-01-10 20:25:44+ | 46ef7d52-da39-11e4-add3-42010af08298 | 
   pink |  420 |  XXL
  store 65 | 2000-01-11 00:55:27+ | 46f7a84c-da39-11e4-add3-42010af08298 | 
 purple | 9045 |S
  store 65 | 2000-01-11 17:54:25+ | 4724ea00-da39-11e4-add3-42010af08298 | 
  green | 5030 |  XXL
  store 65 | 2000-01-12 08:21:15+ | 473c0370-da39-11e4-add3-42010af08298 | 
  white | 2860 |   XL
  store 65 | 2000-01-12 17:09:19+ | 47497d2a-da39-11e4-add3-42010af08298 | 
red | 6425 |L
  store 65 | 2000-01-14 07:27:37+ | 478662a8-da39-11e4-add3-42010af08298 | 
   pink |  330 | XXXL
  store 65 | 2000-01-14 11:31:38+ | 478b43cc-da39-11e4-add3-42010af08298 | 
   pink | 3335 |  XXL
  store 65 | 2000-01-14 18:55:59+ | 47955a24-da39-11e4-add3-42010af08298 | 
 yellow |  500 |P
  store 65 |