[jira] [Comment Edited] (CASSANDRA-7904) Repair hangs

2015-11-27 Thread Anuj Wadehra (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030201#comment-15030201
 ] 

Anuj Wadehra edited comment on CASSANDRA-7904 at 11/27/15 7:58 PM:
---

[#Michael Shuler] First of all, I would like to express my discomfort on the 
way few things are happening. In March,2015 Apache web site mentioned that 
2.0.14 is the most stable version recommended for Production and in Nov (just 7 
mths time), people get little community support for 2.0.x (sort of EOL). It 
takes months to roll out a Cassandra upgrade to all your clients and by the 
time all your clients get the latest Cassandra version, you learn that 
virtually no help is available on community for that version. I understand the 
fast paced environment but can we revisit the strategy to make sure that once 
declared "stable", a version must be supported on community for at least one 
year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.
Many times, restarting the node and then running repair is successful. May be 
there is an issue with open TCP connections used by repair. Restarting 
Cassandra creates new connections and then its successful.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?







was (Author: eanujwa):
[#Michael Shuler] First of all, I would like to express my discomfort on the 
way few things are happening. In March,2015 Apache web site mentioned that 
2.0.14 is the most stable version recommended for Production and in Nov (just 7 
mths time), people get little community support for 2.0.x (sort of EOL). It 
takes months to roll out a Cassandra upgrade to all your clients and by the 
time all your clients get the latest Cassandra version, you learn that 
virtually no help is available on community for that version. I understand the 
fast paced environment but can we revisit the strategy to make sure that once 
declared "stable", a version must be supported on community for at least one 
year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?






> Repair hangs
> 
>
> Key: CASSANDRA-7904
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7904
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.0.10, ubuntu 14.04, Java HotSpot(TM) 64-Bit Server, 
> java version "1.7.0_45"
>Reporter: Duncan Sands
> Attachments: ls-172.18.68.138, ls-192.168.21.13, ls-192.168.60.134, 
> ls-192.168.60.136
>
>
> Cluster of 22 nodes spread over 4 data centres.  Not used on the weekend, so 
> repair is run on all nodes (in a staggered fashion) on the weekend.  Nodetool 
> options: -par -pr.  There is usually some overlap in the repairs: repair on 
> one node may well still be running when repair is started on the next node.  
> Repair hangs for some of the nodes almost every weekend.  It hung last 
> weekend, here are the details:
> In the whole cluster, only one node had an exception since C* was last 
> restarted.  This node is 192.168.60.136 and the exception is harmless: a 
> client disconnected abruptly.
> tpstats
>   4 nodes have a non-zero value for "active" or "pending" in 
> AntiEntropySessions.  These nodes all have Active => 1 and Pending => 1.  The 
> nodes are:
>   192.168.21.13 (data centre R)
>   192.168.60.134 (data centre A)
>   192.168.60.136 (data centre A)
>   172.18.68.138 (data 

[jira] [Commented] (CASSANDRA-10753) Fix completion problems breaking clqshlib tests

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030001#comment-15030001
 ] 

Paulo Motta commented on CASSANDRA-10753:
-

bq. By the way, do you know which version it is? I could not even find commit 
3f15725 on any branch in the driver repository. Shouldn't we upgrade to a later 
and more official version instead?

I think this was a custom build before c5354507aab471bd9f9f017138302693ea9e48ed 
was merged into master. I guess we should be safe to update to the released 
3.0.0 tag. There are some [instructions 
here|https://github.com/datastax/python-driver/blob/master/README-dev.rst#packaging-for-cassandra]
 here for creating the artifact.

bq. I also started noticing some timeout failures in the cqlshlib tests, on all 
branches, when dropping keyspaces. Do you think this is normal?

That's strange, it shouldn't take that long with such a small amount of data 
even on HDDs IMO. Maybe it's a ccm problem? CASSANDRA-8816 reported slowness on 
keyspace drop on Windows, so maybe you could run those tests and check if 
they're failing in your machine? Is it possible to enable tracing on drop 
keyspace statements? It would may be nice see what's making it so slow.

bq. I'll start the dtests as soon as CASSCI is back.

Seems cassci is still not back, so we can restart it after it's back.

> Fix completion problems breaking clqshlib tests
> ---
>
> Key: CASSANDRA-10753
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10753
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Stefania
>Assignee: Stefania
> Fix For: 3.0.x
>
>
> The recent changes in the python driver APIs have caused some completion 
> problems as indicated by 2 of these failing tests:
> http://cassci.datastax.com/job/trunk_cqlshlib/579/testReport/
> The third failing test, {{test_timestamp_output}}, has been failing for some 
> time due to uncertainty on what to do regarding timezone conversion but it 
> too can be changed to reflect the fact that we convert the timestamp to UTC.
> Finally, {{max_window_size_seconds}} was recently added to the compaction 
> properties and this caused 2 more tests to fail. It cannot be seen on Jenkins 
> because of the relative import problem introduced by CASSANDRA-9304. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (CASSANDRA-7904) Repair hangs

2015-11-27 Thread Anuj Wadehra (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030201#comment-15030201
 ] 

Anuj Wadehra edited comment on CASSANDRA-7904 at 11/27/15 7:55 PM:
---

[#Michael Shuler] First of all, I would like to express my discomfort on the 
way few things are happening. In March,2015 Apache web site mentioned that 
2.0.14 is the most stable version recommended for Production and in Nov (just 7 
mths time), people get little community support for 2.0.x (sort of EOL). It 
takes months to roll out a Cassandra upgrade to all your clients and by the 
time all your clients get the latest Cassandra version, you learn that 
virtually no help is available on community for that version. I understand the 
fast paced environment but can we revisit the strategy to make sure that once 
declared "stable", a version must be supported on community for at least one 
year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?







was (Author: eanujwa):
[#Michael Shuler] First of all, I would like to express my discomfort on the 
way few things are happening. In March,2015 Apache web site mentioned that 
2.0.14 is the most stable version recommended for Production and in Nov (just 7 
mths time), people get the message in community saying that 2.0.x is sort of 
EOL. It takes months to roll out a Cassandra upgrade to all your clients and by 
the time all your clients get the latest Cassandra version, you learn that 
virtually no help is available on community for that version. I understand the 
fast paced environment but can we revisit the strategy to make sure that once 
declared "stable", a version must be supported on community for at least one 
year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?






> Repair hangs
> 
>
> Key: CASSANDRA-7904
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7904
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.0.10, ubuntu 14.04, Java HotSpot(TM) 64-Bit Server, 
> java version "1.7.0_45"
>Reporter: Duncan Sands
> Attachments: ls-172.18.68.138, ls-192.168.21.13, ls-192.168.60.134, 
> ls-192.168.60.136
>
>
> Cluster of 22 nodes spread over 4 data centres.  Not used on the weekend, so 
> repair is run on all nodes (in a staggered fashion) on the weekend.  Nodetool 
> options: -par -pr.  There is usually some overlap in the repairs: repair on 
> one node may well still be running when repair is started on the next node.  
> Repair hangs for some of the nodes almost every weekend.  It hung last 
> weekend, here are the details:
> In the whole cluster, only one node had an exception since C* was last 
> restarted.  This node is 192.168.60.136 and the exception is harmless: a 
> client disconnected abruptly.
> tpstats
>   4 nodes have a non-zero value for "active" or "pending" in 
> AntiEntropySessions.  These nodes all have Active => 1 and Pending => 1.  The 
> nodes are:
>   192.168.21.13 (data centre R)
>   192.168.60.134 (data centre A)
>   192.168.60.136 (data centre A)
>   172.18.68.138 (data centre Z)
> compactionstats:
>   No compactions.  All nodes have:
> pending tasks: 0
> Active compaction remaining time :n/a
> netstats:
>   All except one node have nothing.  One node 

[jira] [Commented] (CASSANDRA-7904) Repair hangs

2015-11-27 Thread Anuj Wadehra (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030201#comment-15030201
 ] 

Anuj Wadehra commented on CASSANDRA-7904:
-

[#mshuler]
First of all, I would like to express my discomfort on the way few things are 
happening. In March,2015 Apache web site mentioned that 2.0.14 is the most 
stable version recommended for Production and in Nov (just 7 mths time), people 
get the message in community saying that 2.0.x is sort of EOL. It takes months 
to roll out a Cassandra upgrade to all your clients and by the time all your 
clients get the latest Cassandra version, you learn that virtually no help is 
available on community for that version. I understand the fast paced 
environment but can we revisit the strategy to make sure that once declared 
"stable", a version must be supported on community for at least one year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?






> Repair hangs
> 
>
> Key: CASSANDRA-7904
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7904
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.0.10, ubuntu 14.04, Java HotSpot(TM) 64-Bit Server, 
> java version "1.7.0_45"
>Reporter: Duncan Sands
> Attachments: ls-172.18.68.138, ls-192.168.21.13, ls-192.168.60.134, 
> ls-192.168.60.136
>
>
> Cluster of 22 nodes spread over 4 data centres.  Not used on the weekend, so 
> repair is run on all nodes (in a staggered fashion) on the weekend.  Nodetool 
> options: -par -pr.  There is usually some overlap in the repairs: repair on 
> one node may well still be running when repair is started on the next node.  
> Repair hangs for some of the nodes almost every weekend.  It hung last 
> weekend, here are the details:
> In the whole cluster, only one node had an exception since C* was last 
> restarted.  This node is 192.168.60.136 and the exception is harmless: a 
> client disconnected abruptly.
> tpstats
>   4 nodes have a non-zero value for "active" or "pending" in 
> AntiEntropySessions.  These nodes all have Active => 1 and Pending => 1.  The 
> nodes are:
>   192.168.21.13 (data centre R)
>   192.168.60.134 (data centre A)
>   192.168.60.136 (data centre A)
>   172.18.68.138 (data centre Z)
> compactionstats:
>   No compactions.  All nodes have:
> pending tasks: 0
> Active compaction remaining time :n/a
> netstats:
>   All except one node have nothing.  One node (192.168.60.131, not one of the 
> nodes listed in the tpstats section above) has (note the Responses Pending 
> value of 1):
> Mode: NORMAL
> Not sending any streams.
> Read Repair Statistics:
> Attempted: 4233
> Mismatch (Blocking): 0
> Mismatch (Background): 243
> Pool NameActive   Pending  Completed
> Commandsn/a 0   34785445
> Responses   n/a 1   38567167
> Repair sessions
>   I looked for repair sessions that failed to complete.  On 3 of the 4 nodes 
> mentioned in tpstats above I found that they had sent merkle tree requests 
> and got responses from all but one node.  In the log file for the node that 
> failed to respond there is no sign that it ever received the request.  On 1 
> node (172.18.68.138) it looks like responses were received from every node, 
> some streaming was done, and then... nothing.  Details:
>   Node 192.168.21.13 (data centre R):
> Sent merkle trees to /172.18.33.24, /192.168.60.140, /192.168.60.142, 
> /172.18.68.139, /172.18.68.138, /172.18.33.22, /192.168.21.13 for table 
> brokers, never got a response from /172.18.68.139.  On /172.18.68.139, just 
> before this time it sent a response for the same repair session but a 
> different table, and there is no record of it receiving a request for table 
> brokers.
>   Node 192.168.60.134 (data centre A):
> Sent merkle trees to /172.18.68.139, /172.18.68.138, /192.168.60.132, 
> /192.168.21.14, /192.168.60.134 for table swxess_outbound, never got a 
> response from /172.18.68.138.  On 

[jira] [Comment Edited] (CASSANDRA-7904) Repair hangs

2015-11-27 Thread Anuj Wadehra (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030201#comment-15030201
 ] 

Anuj Wadehra edited comment on CASSANDRA-7904 at 11/27/15 7:52 PM:
---

[#Michael Shuler]
First of all, I would like to express my discomfort on the way few things are 
happening. In March,2015 Apache web site mentioned that 2.0.14 is the most 
stable version recommended for Production and in Nov (just 7 mths time), people 
get the message in community saying that 2.0.x is sort of EOL. It takes months 
to roll out a Cassandra upgrade to all your clients and by the time all your 
clients get the latest Cassandra version, you learn that virtually no help is 
available on community for that version. I understand the fast paced 
environment but can we revisit the strategy to make sure that once declared 
"stable", a version must be supported on community for at least one year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?







was (Author: eanujwa):
[#mshuler]
First of all, I would like to express my discomfort on the way few things are 
happening. In March,2015 Apache web site mentioned that 2.0.14 is the most 
stable version recommended for Production and in Nov (just 7 mths time), people 
get the message in community saying that 2.0.x is sort of EOL. It takes months 
to roll out a Cassandra upgrade to all your clients and by the time all your 
clients get the latest Cassandra version, you learn that virtually no help is 
available on community for that version. I understand the fast paced 
environment but can we revisit the strategy to make sure that once declared 
"stable", a version must be supported on community for at least one year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?






> Repair hangs
> 
>
> Key: CASSANDRA-7904
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7904
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.0.10, ubuntu 14.04, Java HotSpot(TM) 64-Bit Server, 
> java version "1.7.0_45"
>Reporter: Duncan Sands
> Attachments: ls-172.18.68.138, ls-192.168.21.13, ls-192.168.60.134, 
> ls-192.168.60.136
>
>
> Cluster of 22 nodes spread over 4 data centres.  Not used on the weekend, so 
> repair is run on all nodes (in a staggered fashion) on the weekend.  Nodetool 
> options: -par -pr.  There is usually some overlap in the repairs: repair on 
> one node may well still be running when repair is started on the next node.  
> Repair hangs for some of the nodes almost every weekend.  It hung last 
> weekend, here are the details:
> In the whole cluster, only one node had an exception since C* was last 
> restarted.  This node is 192.168.60.136 and the exception is harmless: a 
> client disconnected abruptly.
> tpstats
>   4 nodes have a non-zero value for "active" or "pending" in 
> AntiEntropySessions.  These nodes all have Active => 1 and Pending => 1.  The 
> nodes are:
>   192.168.21.13 (data centre R)
>   192.168.60.134 (data centre A)
>   192.168.60.136 (data centre A)
>   172.18.68.138 (data centre Z)
> compactionstats:
>   No compactions.  All nodes have:
> pending tasks: 0
> Active compaction remaining time :n/a
> netstats:
>   All except one node have nothing.  One node 

[jira] [Comment Edited] (CASSANDRA-7904) Repair hangs

2015-11-27 Thread Anuj Wadehra (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030201#comment-15030201
 ] 

Anuj Wadehra edited comment on CASSANDRA-7904 at 11/27/15 7:53 PM:
---

[#Michael Shuler] First of all, I would like to express my discomfort on the 
way few things are happening. In March,2015 Apache web site mentioned that 
2.0.14 is the most stable version recommended for Production and in Nov (just 7 
mths time), people get the message in community saying that 2.0.x is sort of 
EOL. It takes months to roll out a Cassandra upgrade to all your clients and by 
the time all your clients get the latest Cassandra version, you learn that 
virtually no help is available on community for that version. I understand the 
fast paced environment but can we revisit the strategy to make sure that once 
declared "stable", a version must be supported on community for at least one 
year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?







was (Author: eanujwa):
[#Michael Shuler]
First of all, I would like to express my discomfort on the way few things are 
happening. In March,2015 Apache web site mentioned that 2.0.14 is the most 
stable version recommended for Production and in Nov (just 7 mths time), people 
get the message in community saying that 2.0.x is sort of EOL. It takes months 
to roll out a Cassandra upgrade to all your clients and by the time all your 
clients get the latest Cassandra version, you learn that virtually no help is 
available on community for that version. I understand the fast paced 
environment but can we revisit the strategy to make sure that once declared 
"stable", a version must be supported on community for at least one year?

Coming back to the issue, I see similar problem in 2.2.0 code too. We are still 
facing the issue. Merkle Requests across DCs are getting lost and then repair 
hangs. We have enabled DEBUG. When we started repair on a node, we got error 
messages "error writing to /X.X.X.X
java.io.IOException: Connection timed out" for  2 nodes in remote DC. Merkle 
tree were received from these 2 nodes. But we didnt get any error for 3rd node 
in remote DC and strangely this was the node which never got Merkle tree 
request. Moreoever, we observed that hinted handoff started for 3rd node from 
the node being repaired but hint replay timed-out too.

Please find attached logs of node 10.X.15.115. Merkle tree request never 
reached 10.X.14.115 and thus no response was received.Absolutely no logs got 
printed on 10.X.14.115.

Can we reopen the ticket?






> Repair hangs
> 
>
> Key: CASSANDRA-7904
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7904
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.0.10, ubuntu 14.04, Java HotSpot(TM) 64-Bit Server, 
> java version "1.7.0_45"
>Reporter: Duncan Sands
> Attachments: ls-172.18.68.138, ls-192.168.21.13, ls-192.168.60.134, 
> ls-192.168.60.136
>
>
> Cluster of 22 nodes spread over 4 data centres.  Not used on the weekend, so 
> repair is run on all nodes (in a staggered fashion) on the weekend.  Nodetool 
> options: -par -pr.  There is usually some overlap in the repairs: repair on 
> one node may well still be running when repair is started on the next node.  
> Repair hangs for some of the nodes almost every weekend.  It hung last 
> weekend, here are the details:
> In the whole cluster, only one node had an exception since C* was last 
> restarted.  This node is 192.168.60.136 and the exception is harmless: a 
> client disconnected abruptly.
> tpstats
>   4 nodes have a non-zero value for "active" or "pending" in 
> AntiEntropySessions.  These nodes all have Active => 1 and Pending => 1.  The 
> nodes are:
>   192.168.21.13 (data centre R)
>   192.168.60.134 (data centre A)
>   192.168.60.136 (data centre A)
>   172.18.68.138 (data centre Z)
> compactionstats:
>   No compactions.  All nodes have:
> pending tasks: 0
> Active compaction remaining time :n/a
> netstats:
>   All except one node have nothing.  

[jira] [Created] (CASSANDRA-10778) CompactionExecutor writing to old index files

2015-11-27 Thread Will Zhang (JIRA)
Will Zhang created CASSANDRA-10778:
--

 Summary: CompactionExecutor writing to old index files
 Key: CASSANDRA-10778
 URL: https://issues.apache.org/jira/browse/CASSANDRA-10778
 Project: Cassandra
  Issue Type: Bug
  Components: Compaction
 Environment: Windows 7 64-bit, Cassandra 3.0.0, Java 1.8u60
Reporter: Will Zhang


Hi,

I have been running some test for upgrading from v2.2.2 to v3.0.0. I 
encountered the following `ERROR` in the `system.log`. I did some searches 
online but couldn't find anything useful so filing this. The log seem to 
suggest that it is bug-like.

Any thoughts on this would be appreciated.

INFO  [MigrationStage:1] 2015-11-26 15:21:56,612 ColumnFamilyStore.java:381 
- Initializing demo.broker_quotes_by_date
INFO  [SharedPool-Worker-1] 2015-11-26 15:25:32,113 
MigrationManager.java:455 - Drop table 'demo/broker_quotes_by_date'
INFO  [SharedPool-Worker-2] 2015-11-26 15:25:37,152 
MigrationManager.java:336 - Create new view: 
org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
 IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT NULL 
AND broker IS NOT 
NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
 read_repair_chance=0.0, dclocal_read_repair_chance=0.1, 
bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000, 
default_time_to_live=0, memtable_flush_period_in_ms=0, min_index_interval=128, 
max_index_interval=2048, speculative_retry=99PERCENTILE, caching={'keys' : 
'ALL', 'rows_per_partition' : 'NONE'}, 
compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
 options={min_threshold=4, max_threshold=32}}, 
compression=org.apache.cassandra.schema.CompressionParams@f3ef4959, 
extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 org.apache.cassandra.db.marshal.UTF8Type, 
org.apache.cassandra.db.marshal.UTF8Type, 
org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | [bmark_spread 
g_spread is_axed oas_spread price size ytw 
z_spread]],partitionKeyColumns=[ColumnDefinition{name=date, 
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
position=0}],clusteringColumns=[ColumnDefinition{name=datetime, 
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 kind=CLUSTERING, position=0}, ColumnDefinition{name=side, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1}, 
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=2}, ColumnDefinition{name=broker, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, 
position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
 type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=datetime, 
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 kind=CLUSTERING, position=0}, ColumnDefinition{name=date, 
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
position=0}, ColumnDefinition{name=oas_spread, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=1}, ColumnDefinition{name=broker, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3}, 
ColumnDefinition{name=is_axed, 
type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType, 
kind=REGULAR, position=-1}, ColumnDefinition{name=price, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=g_spread, type=org.apache.cassandra.db.marshal.FloatType, 
kind=REGULAR, position=-1}, ColumnDefinition{name=size, 
type=org.apache.cassandra.db.marshal.DoubleType, kind=REGULAR, 
position=-1}],droppedColumns={},triggers=[],indexes=[]]]
INFO  [MigrationStage:1] 2015-11-26 15:25:37,440 ColumnFamilyStore.java:381 
- Initializing demo.broker_quotes_by_date
ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033 
CassandraDaemon.java:195 - Exception in thread 
Thread[CompactionExecutor:4,1,main]

[jira] [Created] (CASSANDRA-10779) AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread Thread

2015-11-27 Thread Will Zhang (JIRA)
Will Zhang created CASSANDRA-10779:
--

 Summary: AbstractTracingAwareExecutorService.java:169 - Uncaught 
exception on thread Thread
 Key: CASSANDRA-10779
 URL: https://issues.apache.org/jira/browse/CASSANDRA-10779
 Project: Cassandra
  Issue Type: Bug
 Environment: Windows 7 64-bit, Cassandra v3.0.0, Java 1.8u60
Reporter: Will Zhang


Hi guys,

I encountered the following warning message when I was testing to upgrade from 
v2.2.2 to v3.0.0. 

It looks like a write time-out but in an uncaught exception. Could this be an 
easy fix?

Log file section below. Thank you!

{code}
WARN  [SharedPool-Worker-64] 2015-11-26 14:04:24,678 
AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
Thread[SharedPool-Worker-64,10,main]: {}
org.apache.cassandra.exceptions.WriteTimeoutException: Operation timed out - 
received only 0 responses.
at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:427) 
~[apache-cassandra-3.0.0.jar:3.0.0]
at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:386) 
~[apache-cassandra-3.0.0.jar:3.0.0]
at org.apache.cassandra.db.Mutation.apply(Mutation.java:205) 
~[apache-cassandra-3.0.0.jar:3.0.0]
at 
org.apache.cassandra.db.Keyspace.lambda$apply$59(Keyspace.java:435) 
~[apache-cassandra-3.0.0.jar:3.0.0]
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
~[na:1.8.0_60]
at 
org.apache.cassandra.concurrent.AbstractTracingAwareExecutorService$FutureTask.run(AbstractTracingAwareExecutorService.java:164)
 ~[apache-cassandra-3.0.0.jar:3.0.0]
at 
org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) 
[apache-cassandra-3.0.0.jar:3.0.0]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
INFO  [IndexSummaryManager:1] 2015-11-26 14:41:10,527 
IndexSummaryManager.java:257 - Redistributing index summaries
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[4/4] cassandra git commit: Merge branch 'cassandra-3.1' into trunk

2015-11-27 Thread blerer
Merge branch 'cassandra-3.1' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d00d091c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d00d091c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d00d091c

Branch: refs/heads/trunk
Commit: d00d091c6329c4c3d3b157e2dc3e4eb5ff1ac0d1
Parents: f5e6f4e 17e13e5
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:19:15 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:19:21 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d00d091c/CHANGES.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/d00d091c/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--



[2/4] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread blerer
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c35af2a7
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c35af2a7
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c35af2a7

Branch: refs/heads/trunk
Commit: c35af2a7a16b4df2032c5134abc535d73e561d0b
Parents: b166f5f e7116f2
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:16:29 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:16:29 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/c35af2a7/CHANGES.txt
--
diff --cc CHANGES.txt
index 472ed45,7281bd3..97c0eae
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,5 +1,17 @@@
 -2.2.4
 +3.0.1
 + * Fix SELECT statement with IN restrictions on partition key,
 +   ORDER BY and LIMIT (CASSANDRA-10729)
 + * Improve stress performance over 1k threads (CASSANDRA-7217)
 + * Wait for migration responses to complete before bootstrapping 
(CASSANDRA-10731)
 + * Unable to create a function with argument of type Inet (CASSANDRA-10741)
 + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717)
 + * Correctly preserve deletion info on updated rows when notifying indexers
 +   of single-row deletions (CASSANDRA-10694)
 + * Notify indexers of partition delete during cleanup (CASSANDRA-10685)
 + * Keep the file open in trySkipCache (CASSANDRA-10669)
 + * Updated trigger example (CASSANDRA-10257)
 +Merged from 2.2:
+  * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
   * Reject index queries while the index is building (CASSANDRA-8505)
   * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
   * Fix JSON update with prepared statements (CASSANDRA-10631)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/c35af2a7/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--



[1/4] cassandra git commit: Serialize on disk the proper SSTable compression ratio

2015-11-27 Thread blerer
Repository: cassandra
Updated Branches:
  refs/heads/trunk f5e6f4edd -> d00d091c6


Serialize on disk the proper SSTable compression ratio

patch by Benjamin Lerer; reviewed by Marcus Eriksson for CASSANDRA-10775


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/e7116f22
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/e7116f22
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/e7116f22

Branch: refs/heads/trunk
Commit: e7116f22cccdc91fa1d84e5e910af5c7a4393478
Parents: d44dbe1
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:12:03 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:12:03 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 39ce927..7281bd3 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
  * Fix JSON update with prepared statements (CASSANDRA-10631)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--
diff --git 
a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java 
b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
index 01e939c..d064e69 100644
--- a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
+++ b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
@@ -368,13 +368,11 @@ public class BigTableWriter extends SSTableWriter
 // finalise our state on disk, including renaming
 protected void doPrepare()
 {
-Map metadataComponents = 
finalizeMetadata();
-
 iwriter.prepareToCommit();
 
 // write sstable statistics
 dataFile.setDescriptor(descriptor).prepareToCommit();
-writeMetadata(descriptor, metadataComponents);
+writeMetadata(descriptor, finalizeMetadata());
 
 // save the table of components
 SSTable.appendTOC(descriptor, components);



[3/4] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread blerer
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/17e13e5c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/17e13e5c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/17e13e5c

Branch: refs/heads/trunk
Commit: 17e13e5cf5aaf45c403a96de8d38cda091c20d2e
Parents: 21a7a1c c35af2a
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:17:29 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:17:46 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/17e13e5c/CHANGES.txt
--



[1/3] cassandra git commit: Warn or fail when changing cluster topology live

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.0 c35af2a7a -> 56965fd6f


Warn or fail when changing cluster topology live

patch by Stefania; reviewed by Paulo Motta for CASSANDRA-10243


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7650fc19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7650fc19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7650fc19

Branch: refs/heads/cassandra-3.0
Commit: 7650fc196341bd673626054593f2ce6e895d7783
Parents: 8cd13f1
Author: Stefania 
Authored: Fri Nov 27 13:49:15 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:49:15 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 build.xml   |   1 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++-
 .../cassandra/locator/PropertyFileSnitch.java   |  74 -
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../locator/YamlFileNetworkTopologySnitch.java  | 111 +--
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  32 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 321 +++
 .../YamlFileNetworkTopologySnitchTest.java  | 293 +++--
 14 files changed, 823 insertions(+), 205 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 111852c..a2f7b6e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Warn or fail when changing cluster topology live (CASSANDRA-10243)
  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 54a6b79..cae8dfb 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -32,6 +32,12 @@ New features
 - a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
   implementation is provided, so no changes are required to custom 
implementations.
 
+Operations
+
+- Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+  and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+  GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+
 
 2.1.11
 =

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/build.xml
--
diff --git a/build.xml b/build.xml
index 28a8f74..45bb13f 100644
--- a/build.xml
+++ b/build.xml
@@ -1528,6 +1528,7 @@
   
   
   
+  
   
   
   

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --git a/src/java/org/apache/cassandra/gms/Gossiper.java 
b/src/java/org/apache/cassandra/gms/Gossiper.java
index 2f69d66..09851b2 100644
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@ -256,24 +256,12 @@ public class Gossiper implements 
IFailureDetectionEventListener, GossiperMBean
 subscribers.remove(subscriber);
 }
 
-public Set getLiveMembers()
+public Set getLiveEndpoints()
 {
-Set liveMembers = new HashSet(liveEndpoints);
-if (!liveMembers.contains(FBUtilities.getBroadcastAddress()))
-liveMembers.add(FBUtilities.getBroadcastAddress());
-return liveMembers;
-}
-
-public Set getLiveTokenOwners()
-{
-Set tokenOwners = new HashSet();
-for (InetAddress member : getLiveMembers())
-{
-EndpointState epState = endpointStateMap.get(member);
-if (epState != null && !isDeadState(epState) && 
StorageService.instance.getTokenMetadata().isMember(member))
-tokenOwners.add(member);
-}
-return tokenOwners;
+Set liveEndpoints = new 
HashSet(this.liveEndpoints);
+if (!liveEndpoints.contains(FBUtilities.getBroadcastAddress()))
+liveEndpoints.add(FBUtilities.getBroadcastAddress());
+return liveEndpoints;
 }
 

[1/2] cassandra git commit: Warn or fail when changing cluster topology live

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 e7116f22c -> 432a8a484


Warn or fail when changing cluster topology live

patch by Stefania; reviewed by Paulo Motta for CASSANDRA-10243


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7650fc19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7650fc19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7650fc19

Branch: refs/heads/cassandra-2.2
Commit: 7650fc196341bd673626054593f2ce6e895d7783
Parents: 8cd13f1
Author: Stefania 
Authored: Fri Nov 27 13:49:15 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:49:15 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 build.xml   |   1 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++-
 .../cassandra/locator/PropertyFileSnitch.java   |  74 -
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../locator/YamlFileNetworkTopologySnitch.java  | 111 +--
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  32 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 321 +++
 .../YamlFileNetworkTopologySnitchTest.java  | 293 +++--
 14 files changed, 823 insertions(+), 205 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 111852c..a2f7b6e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Warn or fail when changing cluster topology live (CASSANDRA-10243)
  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 54a6b79..cae8dfb 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -32,6 +32,12 @@ New features
 - a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
   implementation is provided, so no changes are required to custom 
implementations.
 
+Operations
+
+- Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+  and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+  GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+
 
 2.1.11
 =

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/build.xml
--
diff --git a/build.xml b/build.xml
index 28a8f74..45bb13f 100644
--- a/build.xml
+++ b/build.xml
@@ -1528,6 +1528,7 @@
   
   
   
+  
   
   
   

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --git a/src/java/org/apache/cassandra/gms/Gossiper.java 
b/src/java/org/apache/cassandra/gms/Gossiper.java
index 2f69d66..09851b2 100644
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@ -256,24 +256,12 @@ public class Gossiper implements 
IFailureDetectionEventListener, GossiperMBean
 subscribers.remove(subscriber);
 }
 
-public Set getLiveMembers()
+public Set getLiveEndpoints()
 {
-Set liveMembers = new HashSet(liveEndpoints);
-if (!liveMembers.contains(FBUtilities.getBroadcastAddress()))
-liveMembers.add(FBUtilities.getBroadcastAddress());
-return liveMembers;
-}
-
-public Set getLiveTokenOwners()
-{
-Set tokenOwners = new HashSet();
-for (InetAddress member : getLiveMembers())
-{
-EndpointState epState = endpointStateMap.get(member);
-if (epState != null && !isDeadState(epState) && 
StorageService.instance.getTokenMetadata().isMember(member))
-tokenOwners.add(member);
-}
-return tokenOwners;
+Set liveEndpoints = new 
HashSet(this.liveEndpoints);
+if (!liveEndpoints.contains(FBUtilities.getBroadcastAddress()))
+liveEndpoints.add(FBUtilities.getBroadcastAddress());
+return liveEndpoints;
 }
 

[2/4] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/432a8a48
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/432a8a48
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/432a8a48

Branch: refs/heads/cassandra-3.1
Commit: 432a8a484394f6774fc64486229939c07f8af9e2
Parents: e7116f2 7650fc1
Author: Robert Stupp 
Authored: Fri Nov 27 13:50:52 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:50:52 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  30 +-
 .../GossipingPropertyFileSnitchTest.java|  38 +--
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 496 insertions(+), 158 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/CHANGES.txt
--
diff --cc CHANGES.txt
index 7281bd3,a2f7b6e..ce82bd0
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,21 -1,5 +1,22 @@@
 -2.1.12
 +2.2.4
 + * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Warn or fail when changing cluster topology live (CASSANDRA-10243)
   * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/NEWS.txt
--
diff --cc NEWS.txt
index 4cf9c7b,cae8dfb..87e77f4
--- a/NEWS.txt
+++ b/NEWS.txt
@@@ -39,9 -24,22 +39,15 @@@ New feature
  - DTCS option max_sstable_age_days is now deprecated and defaults to 1000 
days.
  - Native protocol server now allows both SSL and non-SSL connections on
the same port.
 -- Switching racks is no longer an allowed operation on a node which has
 -  data. Instead, the node will need to be decommissioned and 
rebootstrapped.
 -  If moving from the SimpleSnitch, make sure the rack containing all 
current
 -  nodes is named "rack1". To override this behavior when manually wiping
 -  the node and bootstrapping, use -Dcassandra.ignore_rack=true.
 -- a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
 -  implementation is provided, so no changes are required to custom 
implementations.
  
+ Operations
+ 
+ - Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+   and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+   GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+ 
  
 -2.1.11
 +2.2.3
  =
  
  Upgrading

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --cc src/java/org/apache/cassandra/gms/Gossiper.java
index 3d0d5fa,09851b2..fadaffc
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@@ -981,10 -984,11 +970,11 @@@ public class 

[1/5] cassandra git commit: Warn or fail when changing cluster topology live

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/trunk d00d091c6 -> 33e7bba12


Warn or fail when changing cluster topology live

patch by Stefania; reviewed by Paulo Motta for CASSANDRA-10243


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7650fc19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7650fc19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7650fc19

Branch: refs/heads/trunk
Commit: 7650fc196341bd673626054593f2ce6e895d7783
Parents: 8cd13f1
Author: Stefania 
Authored: Fri Nov 27 13:49:15 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:49:15 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 build.xml   |   1 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++-
 .../cassandra/locator/PropertyFileSnitch.java   |  74 -
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../locator/YamlFileNetworkTopologySnitch.java  | 111 +--
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  32 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 321 +++
 .../YamlFileNetworkTopologySnitchTest.java  | 293 +++--
 14 files changed, 823 insertions(+), 205 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 111852c..a2f7b6e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Warn or fail when changing cluster topology live (CASSANDRA-10243)
  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 54a6b79..cae8dfb 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -32,6 +32,12 @@ New features
 - a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
   implementation is provided, so no changes are required to custom 
implementations.
 
+Operations
+
+- Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+  and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+  GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+
 
 2.1.11
 =

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/build.xml
--
diff --git a/build.xml b/build.xml
index 28a8f74..45bb13f 100644
--- a/build.xml
+++ b/build.xml
@@ -1528,6 +1528,7 @@
   
   
   
+  
   
   
   

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --git a/src/java/org/apache/cassandra/gms/Gossiper.java 
b/src/java/org/apache/cassandra/gms/Gossiper.java
index 2f69d66..09851b2 100644
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@ -256,24 +256,12 @@ public class Gossiper implements 
IFailureDetectionEventListener, GossiperMBean
 subscribers.remove(subscriber);
 }
 
-public Set getLiveMembers()
+public Set getLiveEndpoints()
 {
-Set liveMembers = new HashSet(liveEndpoints);
-if (!liveMembers.contains(FBUtilities.getBroadcastAddress()))
-liveMembers.add(FBUtilities.getBroadcastAddress());
-return liveMembers;
-}
-
-public Set getLiveTokenOwners()
-{
-Set tokenOwners = new HashSet();
-for (InetAddress member : getLiveMembers())
-{
-EndpointState epState = endpointStateMap.get(member);
-if (epState != null && !isDeadState(epState) && 
StorageService.instance.getTokenMetadata().isMember(member))
-tokenOwners.add(member);
-}
-return tokenOwners;
+Set liveEndpoints = new 
HashSet(this.liveEndpoints);
+if (!liveEndpoints.contains(FBUtilities.getBroadcastAddress()))
+liveEndpoints.add(FBUtilities.getBroadcastAddress());
+return liveEndpoints;
 }
 
 /**
@@ 

cassandra git commit: Warn or fail when changing cluster topology live

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.1 8cd13f138 -> 7650fc196


Warn or fail when changing cluster topology live

patch by Stefania; reviewed by Paulo Motta for CASSANDRA-10243


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7650fc19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7650fc19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7650fc19

Branch: refs/heads/cassandra-2.1
Commit: 7650fc196341bd673626054593f2ce6e895d7783
Parents: 8cd13f1
Author: Stefania 
Authored: Fri Nov 27 13:49:15 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:49:15 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 build.xml   |   1 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++-
 .../cassandra/locator/PropertyFileSnitch.java   |  74 -
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../locator/YamlFileNetworkTopologySnitch.java  | 111 +--
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  32 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 321 +++
 .../YamlFileNetworkTopologySnitchTest.java  | 293 +++--
 14 files changed, 823 insertions(+), 205 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 111852c..a2f7b6e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Warn or fail when changing cluster topology live (CASSANDRA-10243)
  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 54a6b79..cae8dfb 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -32,6 +32,12 @@ New features
 - a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
   implementation is provided, so no changes are required to custom 
implementations.
 
+Operations
+
+- Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+  and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+  GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+
 
 2.1.11
 =

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/build.xml
--
diff --git a/build.xml b/build.xml
index 28a8f74..45bb13f 100644
--- a/build.xml
+++ b/build.xml
@@ -1528,6 +1528,7 @@
   
   
   
+  
   
   
   

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --git a/src/java/org/apache/cassandra/gms/Gossiper.java 
b/src/java/org/apache/cassandra/gms/Gossiper.java
index 2f69d66..09851b2 100644
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@ -256,24 +256,12 @@ public class Gossiper implements 
IFailureDetectionEventListener, GossiperMBean
 subscribers.remove(subscriber);
 }
 
-public Set getLiveMembers()
+public Set getLiveEndpoints()
 {
-Set liveMembers = new HashSet(liveEndpoints);
-if (!liveMembers.contains(FBUtilities.getBroadcastAddress()))
-liveMembers.add(FBUtilities.getBroadcastAddress());
-return liveMembers;
-}
-
-public Set getLiveTokenOwners()
-{
-Set tokenOwners = new HashSet();
-for (InetAddress member : getLiveMembers())
-{
-EndpointState epState = endpointStateMap.get(member);
-if (epState != null && !isDeadState(epState) && 
StorageService.instance.getTokenMetadata().isMember(member))
-tokenOwners.add(member);
-}
-return tokenOwners;
+Set liveEndpoints = new 
HashSet(this.liveEndpoints);
+if (!liveEndpoints.contains(FBUtilities.getBroadcastAddress()))
+liveEndpoints.add(FBUtilities.getBroadcastAddress());
+return liveEndpoints;
 }
 

[3/4] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/56965fd6
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/56965fd6
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/56965fd6

Branch: refs/heads/cassandra-3.1
Commit: 56965fd6ff94e79d0f00ae9eac2e9bda48c69129
Parents: c35af2a 432a8a4
Author: Robert Stupp 
Authored: Fri Nov 27 13:53:20 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:53:20 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |   8 +-
 .../cassandra/service/StorageService.java   |  28 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 493 insertions(+), 154 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/CHANGES.txt
--
diff --cc CHANGES.txt
index 97c0eae,ce82bd0..592cff8
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -19,7 -7,16 +19,8 @@@ Merged from 2.2
   * Fix SimpleDateType type compatibility (CASSANDRA-10027)
   * (Hadoop) fix splits calculation (CASSANDRA-10640)
   * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 - * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 - * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 - * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 - * Expose phi values from failure detector via JMX and tweak debug
 -   and trace logging (CASSANDRA-9526)
 - * Fix RangeNamesQueryPager (CASSANDRA-10509)
 - * Deprecate Pig support (CASSANDRA-10542)
 - * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
  Merged from 2.1:
+  * Warn or fail when changing cluster topology live (CASSANDRA-10243)
   * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/NEWS.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/gms/Gossiper.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/CassandraDaemon.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/MigrationManager.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/StorageProxy.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/StorageService.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/test/unit/org/apache/cassandra/locator/GossipingPropertyFileSnitchTest.java
--



[4/5] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread snazy
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b5fb5737
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b5fb5737
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b5fb5737

Branch: refs/heads/trunk
Commit: b5fb5737a0c127584d945acb8f1322bf05dea69f
Parents: 17e13e5 56965fd
Author: Robert Stupp 
Authored: Fri Nov 27 13:55:58 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:55:58 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |   8 +-
 .../cassandra/service/StorageService.java   |  28 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 493 insertions(+), 154 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b5fb5737/CHANGES.txt
--



[3/5] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/56965fd6
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/56965fd6
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/56965fd6

Branch: refs/heads/trunk
Commit: 56965fd6ff94e79d0f00ae9eac2e9bda48c69129
Parents: c35af2a 432a8a4
Author: Robert Stupp 
Authored: Fri Nov 27 13:53:20 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:53:20 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |   8 +-
 .../cassandra/service/StorageService.java   |  28 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 493 insertions(+), 154 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/CHANGES.txt
--
diff --cc CHANGES.txt
index 97c0eae,ce82bd0..592cff8
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -19,7 -7,16 +19,8 @@@ Merged from 2.2
   * Fix SimpleDateType type compatibility (CASSANDRA-10027)
   * (Hadoop) fix splits calculation (CASSANDRA-10640)
   * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 - * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 - * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 - * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 - * Expose phi values from failure detector via JMX and tweak debug
 -   and trace logging (CASSANDRA-9526)
 - * Fix RangeNamesQueryPager (CASSANDRA-10509)
 - * Deprecate Pig support (CASSANDRA-10542)
 - * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
  Merged from 2.1:
+  * Warn or fail when changing cluster topology live (CASSANDRA-10243)
   * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/NEWS.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/gms/Gossiper.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/CassandraDaemon.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/MigrationManager.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/StorageProxy.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/StorageService.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/test/unit/org/apache/cassandra/locator/GossipingPropertyFileSnitchTest.java
--



[3/3] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/56965fd6
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/56965fd6
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/56965fd6

Branch: refs/heads/cassandra-3.0
Commit: 56965fd6ff94e79d0f00ae9eac2e9bda48c69129
Parents: c35af2a 432a8a4
Author: Robert Stupp 
Authored: Fri Nov 27 13:53:20 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:53:20 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |   8 +-
 .../cassandra/service/StorageService.java   |  28 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 493 insertions(+), 154 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/CHANGES.txt
--
diff --cc CHANGES.txt
index 97c0eae,ce82bd0..592cff8
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -19,7 -7,16 +19,8 @@@ Merged from 2.2
   * Fix SimpleDateType type compatibility (CASSANDRA-10027)
   * (Hadoop) fix splits calculation (CASSANDRA-10640)
   * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 - * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 - * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 - * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 - * Expose phi values from failure detector via JMX and tweak debug
 -   and trace logging (CASSANDRA-9526)
 - * Fix RangeNamesQueryPager (CASSANDRA-10509)
 - * Deprecate Pig support (CASSANDRA-10542)
 - * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
  Merged from 2.1:
+  * Warn or fail when changing cluster topology live (CASSANDRA-10243)
   * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/NEWS.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/gms/Gossiper.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/CassandraDaemon.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/MigrationManager.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/StorageProxy.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/src/java/org/apache/cassandra/service/StorageService.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/56965fd6/test/unit/org/apache/cassandra/locator/GossipingPropertyFileSnitchTest.java
--



[2/2] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/432a8a48
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/432a8a48
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/432a8a48

Branch: refs/heads/cassandra-2.2
Commit: 432a8a484394f6774fc64486229939c07f8af9e2
Parents: e7116f2 7650fc1
Author: Robert Stupp 
Authored: Fri Nov 27 13:50:52 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:50:52 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  30 +-
 .../GossipingPropertyFileSnitchTest.java|  38 +--
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 496 insertions(+), 158 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/CHANGES.txt
--
diff --cc CHANGES.txt
index 7281bd3,a2f7b6e..ce82bd0
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,21 -1,5 +1,22 @@@
 -2.1.12
 +2.2.4
 + * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Warn or fail when changing cluster topology live (CASSANDRA-10243)
   * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/NEWS.txt
--
diff --cc NEWS.txt
index 4cf9c7b,cae8dfb..87e77f4
--- a/NEWS.txt
+++ b/NEWS.txt
@@@ -39,9 -24,22 +39,15 @@@ New feature
  - DTCS option max_sstable_age_days is now deprecated and defaults to 1000 
days.
  - Native protocol server now allows both SSL and non-SSL connections on
the same port.
 -- Switching racks is no longer an allowed operation on a node which has
 -  data. Instead, the node will need to be decommissioned and 
rebootstrapped.
 -  If moving from the SimpleSnitch, make sure the rack containing all 
current
 -  nodes is named "rack1". To override this behavior when manually wiping
 -  the node and bootstrapping, use -Dcassandra.ignore_rack=true.
 -- a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
 -  implementation is provided, so no changes are required to custom 
implementations.
  
+ Operations
+ 
+ - Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+   and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+   GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+ 
  
 -2.1.11
 +2.2.3
  =
  
  Upgrading

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --cc src/java/org/apache/cassandra/gms/Gossiper.java
index 3d0d5fa,09851b2..fadaffc
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@@ -981,10 -984,11 +970,11 @@@ public class 

[2/3] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/432a8a48
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/432a8a48
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/432a8a48

Branch: refs/heads/cassandra-3.0
Commit: 432a8a484394f6774fc64486229939c07f8af9e2
Parents: e7116f2 7650fc1
Author: Robert Stupp 
Authored: Fri Nov 27 13:50:52 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:50:52 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  30 +-
 .../GossipingPropertyFileSnitchTest.java|  38 +--
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 496 insertions(+), 158 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/CHANGES.txt
--
diff --cc CHANGES.txt
index 7281bd3,a2f7b6e..ce82bd0
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,21 -1,5 +1,22 @@@
 -2.1.12
 +2.2.4
 + * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Warn or fail when changing cluster topology live (CASSANDRA-10243)
   * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/NEWS.txt
--
diff --cc NEWS.txt
index 4cf9c7b,cae8dfb..87e77f4
--- a/NEWS.txt
+++ b/NEWS.txt
@@@ -39,9 -24,22 +39,15 @@@ New feature
  - DTCS option max_sstable_age_days is now deprecated and defaults to 1000 
days.
  - Native protocol server now allows both SSL and non-SSL connections on
the same port.
 -- Switching racks is no longer an allowed operation on a node which has
 -  data. Instead, the node will need to be decommissioned and 
rebootstrapped.
 -  If moving from the SimpleSnitch, make sure the rack containing all 
current
 -  nodes is named "rack1". To override this behavior when manually wiping
 -  the node and bootstrapping, use -Dcassandra.ignore_rack=true.
 -- a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
 -  implementation is provided, so no changes are required to custom 
implementations.
  
+ Operations
+ 
+ - Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+   and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+   GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+ 
  
 -2.1.11
 +2.2.3
  =
  
  Upgrading

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --cc src/java/org/apache/cassandra/gms/Gossiper.java
index 3d0d5fa,09851b2..fadaffc
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@@ -981,10 -984,11 +970,11 @@@ public class 

[jira] [Updated] (CASSANDRA-10778) CompactionExecutor writing to old index files

2015-11-27 Thread Will Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Will Zhang updated CASSANDRA-10778:
---
Description: 
Hi,

I have been running some test for upgrading from v2.2.2 to v3.0.0. 

I encountered the following `ERROR` in the `system.log` when I was 
*creating/dropping materialized views*. I did some searches online but couldn't 
find anything useful so filing this. The log seem to suggest that it is 
bug-like.

Any thoughts on this would be appreciated.

Main error line in log:

{code}
ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033 CassandraDaemon.java:195 - 
Exception in thread Thread[CompactionExecutor:4,1,main]
java.lang.AssertionError: We read old index files but we should never write 
them
{code}

Longer log:

{code}
INFO  [SharedPool-Worker-2] 2015-11-26 15:25:37,152 
MigrationManager.java:336 - Create new view: 
org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
 IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT NULL 
AND broker IS NOT 
NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
 read_repair_chance=0.0, dclocal_read_repair_chance=0.1, 
bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000, 
default_time_to_live=0, memtable_flush_period_in_ms=0, min_index_interval=128, 
max_index_interval=2048, speculative_retry=99PERCENTILE, caching={'keys' : 
'ALL', 'rows_per_partition' : 'NONE'}, 
compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
 options={min_threshold=4, max_threshold=32}}, 
compression=org.apache.cassandra.schema.CompressionParams@f3ef4959, 
extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 org.apache.cassandra.db.marshal.UTF8Type, 
org.apache.cassandra.db.marshal.UTF8Type, 
org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | [bmark_spread 
g_spread is_axed oas_spread price size ytw 
z_spread]],partitionKeyColumns=[ColumnDefinition{name=date, 
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
position=0}],clusteringColumns=[ColumnDefinition{name=datetime, 
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 kind=CLUSTERING, position=0}, ColumnDefinition{name=side, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1}, 
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=2}, ColumnDefinition{name=broker, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, 
position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
 type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=datetime, 
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 kind=CLUSTERING, position=0}, ColumnDefinition{name=date, 
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
position=0}, ColumnDefinition{name=oas_spread, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=1}, ColumnDefinition{name=broker, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3}, 
ColumnDefinition{name=is_axed, 
type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType, 
kind=REGULAR, position=-1}, ColumnDefinition{name=price, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=g_spread, type=org.apache.cassandra.db.marshal.FloatType, 
kind=REGULAR, position=-1}, ColumnDefinition{name=size, 
type=org.apache.cassandra.db.marshal.DoubleType, kind=REGULAR, 
position=-1}],droppedColumns={},triggers=[],indexes=[]]]
INFO  [MigrationStage:1] 2015-11-26 15:25:37,440 ColumnFamilyStore.java:381 
- Initializing demo.broker_quotes_by_date
ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033 
CassandraDaemon.java:195 - Exception in thread 
Thread[CompactionExecutor:4,1,main]
java.lang.AssertionError: We read old index files but we should never write 
them
at 

[2/3] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d44dbe19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d44dbe19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d44dbe19

Branch: refs/heads/cassandra-3.0
Commit: d44dbe1929b3746f6f931ef5c6499073ed3bbaeb
Parents: f8fc031 8cd13f1
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:16 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:16 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d44dbe19/CHANGES.txt
--
diff --cc CHANGES.txt
index 63305d6,111852c..39ce927
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,20 -1,5 +1,21 @@@
 -2.1.12
 +2.2.4
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
   * Force encoding when computing statement ids (CASSANDRA-10755)



[2/2] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d44dbe19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d44dbe19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d44dbe19

Branch: refs/heads/cassandra-2.2
Commit: d44dbe1929b3746f6f931ef5c6499073ed3bbaeb
Parents: f8fc031 8cd13f1
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:16 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:16 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d44dbe19/CHANGES.txt
--
diff --cc CHANGES.txt
index 63305d6,111852c..39ce927
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,20 -1,5 +1,21 @@@
 -2.1.12
 +2.2.4
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
   * Force encoding when computing statement ids (CASSANDRA-10755)



cassandra git commit: Status command in debian/ubuntu init script doesn't work

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.1 4ecbbc082 -> 8cd13f138


Status command in debian/ubuntu init script doesn't work

patch by Ruggero Marchei; reviewed by Michael Shuler for CASSANDRA-10213


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/8cd13f13
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/8cd13f13
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/8cd13f13

Branch: refs/heads/cassandra-2.1
Commit: 8cd13f1381dff81aa5dfe0f6b630fa8198aa0d2b
Parents: 4ecbbc0
Author: Ruggero Marchei 
Authored: Fri Nov 27 12:57:49 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:57:49 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 4adcf4f..111852c 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
  * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/debian/init
--
diff --git a/debian/init b/debian/init
index aff54e1..72417ae 100644
--- a/debian/init
+++ b/debian/init
@@ -47,7 +47,7 @@ FD_LIMIT=10
 # process is not running but the pidfile exists (to match the exit codes for
 # the "status" command; see LSB core spec 3.1, section 20.2)
 #
-CMD_PATT="cassandra.+CassandraDaemon"
+CMD_PATT="Dcassandra-pidfile=.*cassandra\.pid"
 is_running()
 {
 if [ -f $PIDFILE ]; then



cassandra git commit: Serialize on disk the proper SSTable compression ratio

2015-11-27 Thread blerer
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 d44dbe192 -> e7116f22c


Serialize on disk the proper SSTable compression ratio

patch by Benjamin Lerer; reviewed by Marcus Eriksson for CASSANDRA-10775


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/e7116f22
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/e7116f22
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/e7116f22

Branch: refs/heads/cassandra-2.2
Commit: e7116f22cccdc91fa1d84e5e910af5c7a4393478
Parents: d44dbe1
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:12:03 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:12:03 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 39ce927..7281bd3 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
  * Fix JSON update with prepared statements (CASSANDRA-10631)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--
diff --git 
a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java 
b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
index 01e939c..d064e69 100644
--- a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
+++ b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
@@ -368,13 +368,11 @@ public class BigTableWriter extends SSTableWriter
 // finalise our state on disk, including renaming
 protected void doPrepare()
 {
-Map metadataComponents = 
finalizeMetadata();
-
 iwriter.prepareToCommit();
 
 // write sstable statistics
 dataFile.setDescriptor(descriptor).prepareToCommit();
-writeMetadata(descriptor, metadataComponents);
+writeMetadata(descriptor, finalizeMetadata());
 
 // save the table of components
 SSTable.appendTOC(descriptor, components);



[3/3] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread blerer
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/17e13e5c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/17e13e5c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/17e13e5c

Branch: refs/heads/cassandra-3.1
Commit: 17e13e5cf5aaf45c403a96de8d38cda091c20d2e
Parents: 21a7a1c c35af2a
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:17:29 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:17:46 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/17e13e5c/CHANGES.txt
--



[2/3] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread blerer
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c35af2a7
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c35af2a7
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c35af2a7

Branch: refs/heads/cassandra-3.1
Commit: c35af2a7a16b4df2032c5134abc535d73e561d0b
Parents: b166f5f e7116f2
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:16:29 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:16:29 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/c35af2a7/CHANGES.txt
--
diff --cc CHANGES.txt
index 472ed45,7281bd3..97c0eae
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,5 +1,17 @@@
 -2.2.4
 +3.0.1
 + * Fix SELECT statement with IN restrictions on partition key,
 +   ORDER BY and LIMIT (CASSANDRA-10729)
 + * Improve stress performance over 1k threads (CASSANDRA-7217)
 + * Wait for migration responses to complete before bootstrapping 
(CASSANDRA-10731)
 + * Unable to create a function with argument of type Inet (CASSANDRA-10741)
 + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717)
 + * Correctly preserve deletion info on updated rows when notifying indexers
 +   of single-row deletions (CASSANDRA-10694)
 + * Notify indexers of partition delete during cleanup (CASSANDRA-10685)
 + * Keep the file open in trySkipCache (CASSANDRA-10669)
 + * Updated trigger example (CASSANDRA-10257)
 +Merged from 2.2:
+  * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
   * Reject index queries while the index is building (CASSANDRA-8505)
   * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
   * Fix JSON update with prepared statements (CASSANDRA-10631)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/c35af2a7/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--



[1/3] cassandra git commit: Serialize on disk the proper SSTable compression ratio

2015-11-27 Thread blerer
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.1 21a7a1c09 -> 17e13e5cf


Serialize on disk the proper SSTable compression ratio

patch by Benjamin Lerer; reviewed by Marcus Eriksson for CASSANDRA-10775


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/e7116f22
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/e7116f22
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/e7116f22

Branch: refs/heads/cassandra-3.1
Commit: e7116f22cccdc91fa1d84e5e910af5c7a4393478
Parents: d44dbe1
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:12:03 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:12:03 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 39ce927..7281bd3 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
  * Fix JSON update with prepared statements (CASSANDRA-10631)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--
diff --git 
a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java 
b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
index 01e939c..d064e69 100644
--- a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
+++ b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
@@ -368,13 +368,11 @@ public class BigTableWriter extends SSTableWriter
 // finalise our state on disk, including renaming
 protected void doPrepare()
 {
-Map metadataComponents = 
finalizeMetadata();
-
 iwriter.prepareToCommit();
 
 // write sstable statistics
 dataFile.setDescriptor(descriptor).prepareToCommit();
-writeMetadata(descriptor, metadataComponents);
+writeMetadata(descriptor, finalizeMetadata());
 
 // save the table of components
 SSTable.appendTOC(descriptor, components);



[1/2] cassandra git commit: Serialize on disk the proper SSTable compression ratio

2015-11-27 Thread blerer
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.0 b166f5f3f -> c35af2a7a


Serialize on disk the proper SSTable compression ratio

patch by Benjamin Lerer; reviewed by Marcus Eriksson for CASSANDRA-10775


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/e7116f22
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/e7116f22
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/e7116f22

Branch: refs/heads/cassandra-3.0
Commit: e7116f22cccdc91fa1d84e5e910af5c7a4393478
Parents: d44dbe1
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:12:03 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:12:03 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 39ce927..7281bd3 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
  * Fix JSON update with prepared statements (CASSANDRA-10631)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/e7116f22/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--
diff --git 
a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java 
b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
index 01e939c..d064e69 100644
--- a/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
+++ b/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
@@ -368,13 +368,11 @@ public class BigTableWriter extends SSTableWriter
 // finalise our state on disk, including renaming
 protected void doPrepare()
 {
-Map metadataComponents = 
finalizeMetadata();
-
 iwriter.prepareToCommit();
 
 // write sstable statistics
 dataFile.setDescriptor(descriptor).prepareToCommit();
-writeMetadata(descriptor, metadataComponents);
+writeMetadata(descriptor, finalizeMetadata());
 
 // save the table of components
 SSTable.appendTOC(descriptor, components);



[jira] [Created] (CASSANDRA-10780) Exception encountered during startup

2015-11-27 Thread mlowicki (JIRA)
mlowicki created CASSANDRA-10780:


 Summary: Exception encountered during startup
 Key: CASSANDRA-10780
 URL: https://issues.apache.org/jira/browse/CASSANDRA-10780
 Project: Cassandra
  Issue Type: Bug
 Environment: C* 2.1.11 on Debian Wheezy
Reporter: mlowicki


{code}
ERROR [main] 2015-11-27 12:39:42,659 CassandraDaemon.java:579 - Exception 
encountered during startup
org.apache.cassandra.io.FSReadError: java.lang.NullPointerException
at 
org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:663)
 ~[apache-cassandra-2.1.11.jar:2.1.11]
at 
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:306) 
[apache-cassandra-2.1.11.jar:2.1.11]
at 
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:562) 
[apache-cassandra-2.1.11.jar:2.1.11]
at 
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:651) 
[apache-cassandra-2.1.11.jar:2.1.11]
Caused by: java.lang.NullPointerException: null
at 
org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:655)
 ~[apache-cassandra-2.1.11.jar:2.1.11]
... 3 common frames omitted
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10780) Exception encountered during startup

2015-11-27 Thread mlowicki (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

mlowicki updated CASSANDRA-10780:
-
Reproduced In: 2.1.11

> Exception encountered during startup
> 
>
> Key: CASSANDRA-10780
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10780
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.1.11 on Debian Wheezy
>Reporter: mlowicki
>
> {code}
> ERROR [main] 2015-11-27 12:39:42,659 CassandraDaemon.java:579 - Exception 
> encountered during startup
> org.apache.cassandra.io.FSReadError: java.lang.NullPointerException
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:663)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:306) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:562)
>  [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:651) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> Caused by: java.lang.NullPointerException: null
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:655)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> ... 3 common frames omitted
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10778) CompactionExecutor writing to old index files

2015-11-27 Thread Will Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Will Zhang updated CASSANDRA-10778:
---
Description: 
Hi,

I have been running some test for upgrading from v2.2.2 to v3.0.0. I 
encountered the following `ERROR` in the `system.log`. I did some searches 
online but couldn't find anything useful so filing this. The log seem to 
suggest that it is bug-like.

Any thoughts on this would be appreciated.

{code}
INFO  [SharedPool-Worker-2] 2015-11-26 15:25:37,152 
MigrationManager.java:336 - Create new view: 
org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
 IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT NULL 
AND broker IS NOT 
NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
 read_repair_chance=0.0, dclocal_read_repair_chance=0.1, 
bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000, 
default_time_to_live=0, memtable_flush_period_in_ms=0, min_index_interval=128, 
max_index_interval=2048, speculative_retry=99PERCENTILE, caching={'keys' : 
'ALL', 'rows_per_partition' : 'NONE'}, 
compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
 options={min_threshold=4, max_threshold=32}}, 
compression=org.apache.cassandra.schema.CompressionParams@f3ef4959, 
extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 org.apache.cassandra.db.marshal.UTF8Type, 
org.apache.cassandra.db.marshal.UTF8Type, 
org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | [bmark_spread 
g_spread is_axed oas_spread price size ytw 
z_spread]],partitionKeyColumns=[ColumnDefinition{name=date, 
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
position=0}],clusteringColumns=[ColumnDefinition{name=datetime, 
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 kind=CLUSTERING, position=0}, ColumnDefinition{name=side, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1}, 
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=2}, ColumnDefinition{name=broker, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, 
position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
 type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=datetime, 
type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
 kind=CLUSTERING, position=0}, ColumnDefinition{name=date, 
type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
position=0}, ColumnDefinition{name=oas_spread, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type, 
kind=CLUSTERING, position=1}, ColumnDefinition{name=broker, 
type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3}, 
ColumnDefinition{name=is_axed, 
type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType, 
kind=REGULAR, position=-1}, ColumnDefinition{name=price, 
type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
ColumnDefinition{name=g_spread, type=org.apache.cassandra.db.marshal.FloatType, 
kind=REGULAR, position=-1}, ColumnDefinition{name=size, 
type=org.apache.cassandra.db.marshal.DoubleType, kind=REGULAR, 
position=-1}],droppedColumns={},triggers=[],indexes=[]]]
INFO  [MigrationStage:1] 2015-11-26 15:25:37,440 ColumnFamilyStore.java:381 
- Initializing demo.broker_quotes_by_date
ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033 
CassandraDaemon.java:195 - Exception in thread 
Thread[CompactionExecutor:4,1,main]
java.lang.AssertionError: We read old index files but we should never write 
them
at 
org.apache.cassandra.db.RowIndexEntry$Serializer.serialize(RowIndexEntry.java:130)
 ~[apache-cassandra-3.0.0.jar:3.0.0]
at 
org.apache.cassandra.service.CacheService$KeyCacheSerializer.serialize(CacheService.java:466)
 ~[apache-cassandra-3.0.0.jar:3.0.0]
at 

[jira] [Resolved] (CASSANDRA-10775) SSTable compression ratio is not serialized properly

2015-11-27 Thread Benjamin Lerer (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin Lerer resolved CASSANDRA-10775.

   Resolution: Fixed
Fix Version/s: (was: 3.0.x)
   (was: 3.x)
   3.1
   3.0.1
   2.2.4

Thanks for the review.

Committed into 2.2 at e7116f22cccdc91fa1d84e5e910af5c7a4393478 and merged into 
3.0, 3.1 and trunk

> SSTable compression ratio is not serialized properly
> 
>
> Key: CASSANDRA-10775
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10775
> Project: Cassandra
>  Issue Type: Bug
>  Components: Local Write-Read Paths
>Reporter: Benjamin Lerer
>Assignee: Benjamin Lerer
> Fix For: 2.2.4, 3.0.1, 3.1
>
> Attachments: 10775-2.2.txt
>
>
> While reviewing CASSANDRA-10225, I found out that the compression ratio 
> returned by the {{StatsMetadata}} for some compressed sstables was - 1 
> (NO_COMPRESSION_RATIO). 
> After investigation it seems that the wrong compression ratio was serialized 
> to disk. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[1/4] cassandra git commit: Warn or fail when changing cluster topology live

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.1 17e13e5cf -> b5fb5737a


Warn or fail when changing cluster topology live

patch by Stefania; reviewed by Paulo Motta for CASSANDRA-10243


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7650fc19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7650fc19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7650fc19

Branch: refs/heads/cassandra-3.1
Commit: 7650fc196341bd673626054593f2ce6e895d7783
Parents: 8cd13f1
Author: Stefania 
Authored: Fri Nov 27 13:49:15 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:49:15 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 build.xml   |   1 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++-
 .../cassandra/locator/PropertyFileSnitch.java   |  74 -
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../locator/YamlFileNetworkTopologySnitch.java  | 111 +--
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  32 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 321 +++
 .../YamlFileNetworkTopologySnitchTest.java  | 293 +++--
 14 files changed, 823 insertions(+), 205 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 111852c..a2f7b6e 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Warn or fail when changing cluster topology live (CASSANDRA-10243)
  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 54a6b79..cae8dfb 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -32,6 +32,12 @@ New features
 - a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
   implementation is provided, so no changes are required to custom 
implementations.
 
+Operations
+
+- Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+  and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+  GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+
 
 2.1.11
 =

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/build.xml
--
diff --git a/build.xml b/build.xml
index 28a8f74..45bb13f 100644
--- a/build.xml
+++ b/build.xml
@@ -1528,6 +1528,7 @@
   
   
   
+  
   
   
   

http://git-wip-us.apache.org/repos/asf/cassandra/blob/7650fc19/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --git a/src/java/org/apache/cassandra/gms/Gossiper.java 
b/src/java/org/apache/cassandra/gms/Gossiper.java
index 2f69d66..09851b2 100644
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@ -256,24 +256,12 @@ public class Gossiper implements 
IFailureDetectionEventListener, GossiperMBean
 subscribers.remove(subscriber);
 }
 
-public Set getLiveMembers()
+public Set getLiveEndpoints()
 {
-Set liveMembers = new HashSet(liveEndpoints);
-if (!liveMembers.contains(FBUtilities.getBroadcastAddress()))
-liveMembers.add(FBUtilities.getBroadcastAddress());
-return liveMembers;
-}
-
-public Set getLiveTokenOwners()
-{
-Set tokenOwners = new HashSet();
-for (InetAddress member : getLiveMembers())
-{
-EndpointState epState = endpointStateMap.get(member);
-if (epState != null && !isDeadState(epState) && 
StorageService.instance.getTokenMetadata().isMember(member))
-tokenOwners.add(member);
-}
-return tokenOwners;
+Set liveEndpoints = new 
HashSet(this.liveEndpoints);
+if (!liveEndpoints.contains(FBUtilities.getBroadcastAddress()))
+liveEndpoints.add(FBUtilities.getBroadcastAddress());
+return liveEndpoints;
 }
 

[4/4] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread snazy
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b5fb5737
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b5fb5737
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b5fb5737

Branch: refs/heads/cassandra-3.1
Commit: b5fb5737a0c127584d945acb8f1322bf05dea69f
Parents: 17e13e5 56965fd
Author: Robert Stupp 
Authored: Fri Nov 27 13:55:58 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:55:58 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |   8 +-
 .../cassandra/service/StorageService.java   |  28 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 493 insertions(+), 154 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b5fb5737/CHANGES.txt
--



[2/5] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/432a8a48
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/432a8a48
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/432a8a48

Branch: refs/heads/trunk
Commit: 432a8a484394f6774fc64486229939c07f8af9e2
Parents: e7116f2 7650fc1
Author: Robert Stupp 
Authored: Fri Nov 27 13:50:52 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:50:52 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |  10 +-
 .../cassandra/service/StorageService.java   |  30 +-
 .../GossipingPropertyFileSnitchTest.java|  38 +--
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 496 insertions(+), 158 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/CHANGES.txt
--
diff --cc CHANGES.txt
index 7281bd3,a2f7b6e..ce82bd0
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,21 -1,5 +1,22 @@@
 -2.1.12
 +2.2.4
 + * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Warn or fail when changing cluster topology live (CASSANDRA-10243)
   * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/NEWS.txt
--
diff --cc NEWS.txt
index 4cf9c7b,cae8dfb..87e77f4
--- a/NEWS.txt
+++ b/NEWS.txt
@@@ -39,9 -24,22 +39,15 @@@ New feature
  - DTCS option max_sstable_age_days is now deprecated and defaults to 1000 
days.
  - Native protocol server now allows both SSL and non-SSL connections on
the same port.
 -- Switching racks is no longer an allowed operation on a node which has
 -  data. Instead, the node will need to be decommissioned and 
rebootstrapped.
 -  If moving from the SimpleSnitch, make sure the rack containing all 
current
 -  nodes is named "rack1". To override this behavior when manually wiping
 -  the node and bootstrapping, use -Dcassandra.ignore_rack=true.
 -- a new validate(key, cf) method is added to PerRowSecondaryIndex. A 
default
 -  implementation is provided, so no changes are required to custom 
implementations.
  
+ Operations
+ 
+ - Changing rack or dc of live nodes is no longer possible for 
PropertyFileSnitch
+   and YamlFileNetworkTopologySnitch. Reloading the configuration file of
+   GossipingPropertyFileSnitch has been disabled, CASSANDRA-10243.
+ 
  
 -2.1.11
 +2.2.3
  =
  
  Upgrading

http://git-wip-us.apache.org/repos/asf/cassandra/blob/432a8a48/src/java/org/apache/cassandra/gms/Gossiper.java
--
diff --cc src/java/org/apache/cassandra/gms/Gossiper.java
index 3d0d5fa,09851b2..fadaffc
--- a/src/java/org/apache/cassandra/gms/Gossiper.java
+++ b/src/java/org/apache/cassandra/gms/Gossiper.java
@@@ -981,10 -984,11 +970,11 @@@ public class Gossiper 

[5/5] cassandra git commit: Merge branch 'cassandra-3.1' into trunk

2015-11-27 Thread snazy
Merge branch 'cassandra-3.1' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/33e7bba1
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/33e7bba1
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/33e7bba1

Branch: refs/heads/trunk
Commit: 33e7bba126c9d7cd0555448cc49b56119bef06d6
Parents: d00d091 b5fb573
Author: Robert Stupp 
Authored: Fri Nov 27 13:57:12 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 13:57:12 2015 +0100

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 src/java/org/apache/cassandra/gms/Gossiper.java |  28 +-
 .../locator/GossipingPropertyFileSnitch.java| 107 ++
 .../cassandra/locator/PropertyFileSnitch.java   |  74 +++-
 .../cassandra/locator/SnitchProperties.java |   5 +
 .../cassandra/service/CassandraDaemon.java  |  17 +-
 .../cassandra/service/MigrationManager.java |   4 +-
 .../apache/cassandra/service/StorageProxy.java  |   8 +-
 .../cassandra/service/StorageService.java   |  28 +-
 .../GossipingPropertyFileSnitchTest.java|  35 +-
 .../locator/PropertyFileSnitchTest.java | 334 +++
 12 files changed, 493 insertions(+), 154 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/33e7bba1/CHANGES.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/33e7bba1/NEWS.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/33e7bba1/src/java/org/apache/cassandra/service/CassandraDaemon.java
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/33e7bba1/src/java/org/apache/cassandra/service/StorageProxy.java
--



[jira] [Updated] (CASSANDRA-10243) Warn or fail when changing cluster topology live

2015-11-27 Thread Robert Stupp (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Stupp updated CASSANDRA-10243:
-
Fix Version/s: (was: 2.2.x)
   (was: 2.1.x)
   2.2.4
   2.1.12

> Warn or fail when changing cluster topology live
> 
>
> Key: CASSANDRA-10243
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10243
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Tools
>Reporter: Jonathan Ellis
>Assignee: Stefania
>Priority: Critical
> Fix For: 2.1.12, 2.2.4, 3.0.1, 3.1, 3.2
>
>
> Moving a node from one rack to another in the snitch, while it is alive, is 
> almost always the wrong thing to do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10776) Prepare of statements after table creation fail with unconfigured column family

2015-11-27 Thread Alan Boudreault (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alan Boudreault updated CASSANDRA-10776:

Component/s: CQL

> Prepare of statements after table creation fail with unconfigured column 
> family
> ---
>
> Key: CASSANDRA-10776
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10776
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Adam Dougal
>
> Cassandra 2.1.8
> We have multiple app instances trying to create the same table using IF NOT 
> EXISTS.
> We check for schema agreement via the Java Driver before and after every 
> statement.
> After creating the table we then prepare statements and we sometimes get:
> {code}
> com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured 
> columnfamily locks
>   at 
> com.datastax.driver.core.exceptions.InvalidQueryException.copy(InvalidQueryException.java:50)
>  ~[cassandra-driver-core-2.1.8.jar:na]
>   at 
> com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)
>  ~[cassandra-driver-core-2.1.8.jar:na]
>   at 
> com.datastax.driver.core.AbstractSession.prepare(AbstractSession.java:79) 
> ~[cassandra-driver-core-2.1.8.jar:na]
>   at 
> uk.sky.cirrus.locking.CassandraLockingMechanism.init(CassandraLockingMechanism.java:69)
>  ~[main/:na]
>   at uk.sky.cirrus.locking.Lock.acquire(Lock.java:35) [main/:na]
>   at uk.sky.cirrus.CqlMigratorImpl.migrate(CqlMigratorImpl.java:83) 
> [main/:na]
>   at 
> uk.sky.cirrus.locking.LockVerificationTest.lambda$shouldManageContentionsForSchemaMigrate$0(LockVerificationTest.java:90)
>  [test/:na]
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  ~[na:1.8.0_60]
>   at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_60]
> {code}
> Looking at the server logs we get:
> {code}
> ava.lang.RuntimeException: 
> org.apache.cassandra.exceptions.ConfigurationException: Column family ID 
> mismatch (found 90bbb372-9446-11e5-b1ca-8119a6964819; expected 
> 90b87f20-9446-11e5-b1ca-8119a6964819)
>   at org.apache.cassandra.config.CFMetaData.reload(CFMetaData.java:1145) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefsTables.updateColumnFamily(DefsTables.java:422) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefsTables.mergeColumnFamilies(DefsTables.java:295) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefsTables.mergeSchemaInternal(DefsTables.java:194) 
> ~[main/:na]
>   at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:166) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefinitionsUpdateVerbHandler$1.runMayThrow(DefinitionsUpdateVerbHandler.java:49)
>  ~[main/:na]
>   at 
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) 
> ~[main/:na]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_60]
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_60]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
> {code}
> We found this issue which is marked as resolved:
> https://issues.apache.org/jira/browse/CASSANDRA-8387
> Does the IF NOT EXISTS just check the local node?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10776) Prepare of statements after table creation fail with unconfigured column family

2015-11-27 Thread Alan Boudreault (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alan Boudreault updated CASSANDRA-10776:

Component/s: (was: CQL)

> Prepare of statements after table creation fail with unconfigured column 
> family
> ---
>
> Key: CASSANDRA-10776
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10776
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Adam Dougal
>
> Cassandra 2.1.8
> We have multiple app instances trying to create the same table using IF NOT 
> EXISTS.
> We check for schema agreement via the Java Driver before and after every 
> statement.
> After creating the table we then prepare statements and we sometimes get:
> {code}
> com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured 
> columnfamily locks
>   at 
> com.datastax.driver.core.exceptions.InvalidQueryException.copy(InvalidQueryException.java:50)
>  ~[cassandra-driver-core-2.1.8.jar:na]
>   at 
> com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)
>  ~[cassandra-driver-core-2.1.8.jar:na]
>   at 
> com.datastax.driver.core.AbstractSession.prepare(AbstractSession.java:79) 
> ~[cassandra-driver-core-2.1.8.jar:na]
>   at 
> uk.sky.cirrus.locking.CassandraLockingMechanism.init(CassandraLockingMechanism.java:69)
>  ~[main/:na]
>   at uk.sky.cirrus.locking.Lock.acquire(Lock.java:35) [main/:na]
>   at uk.sky.cirrus.CqlMigratorImpl.migrate(CqlMigratorImpl.java:83) 
> [main/:na]
>   at 
> uk.sky.cirrus.locking.LockVerificationTest.lambda$shouldManageContentionsForSchemaMigrate$0(LockVerificationTest.java:90)
>  [test/:na]
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  ~[na:1.8.0_60]
>   at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_60]
> {code}
> Looking at the server logs we get:
> {code}
> ava.lang.RuntimeException: 
> org.apache.cassandra.exceptions.ConfigurationException: Column family ID 
> mismatch (found 90bbb372-9446-11e5-b1ca-8119a6964819; expected 
> 90b87f20-9446-11e5-b1ca-8119a6964819)
>   at org.apache.cassandra.config.CFMetaData.reload(CFMetaData.java:1145) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefsTables.updateColumnFamily(DefsTables.java:422) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefsTables.mergeColumnFamilies(DefsTables.java:295) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefsTables.mergeSchemaInternal(DefsTables.java:194) 
> ~[main/:na]
>   at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:166) 
> ~[main/:na]
>   at 
> org.apache.cassandra.db.DefinitionsUpdateVerbHandler$1.runMayThrow(DefinitionsUpdateVerbHandler.java:49)
>  ~[main/:na]
>   at 
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) 
> ~[main/:na]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_60]
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
> ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  ~[na:1.8.0_60]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_60]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
> {code}
> We found this issue which is marked as resolved:
> https://issues.apache.org/jira/browse/CASSANDRA-8387
> Does the IF NOT EXISTS just check the local node?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[1/4] cassandra git commit: Show CQL help in cqlsh in web browser

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/trunk 33e7bba12 -> 306d882fe


Show CQL help in cqlsh in web browser

patch by Robert Stupp; reviewed by Paulo Motta for CASSANDRA-7225


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/0ee8895b
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/0ee8895b
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/0ee8895b

Branch: refs/heads/trunk
Commit: 0ee8895b27c2aa18260c73ec5c1941e48fbeaf75
Parents: 432a8a4
Author: Robert Stupp 
Authored: Fri Nov 27 15:24:51 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:24:51 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   61 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1060 -
 6 files changed, 176 insertions(+), 973 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index ce82bd0..af1a186 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
  * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/bin/cqlsh.py
--
diff --git a/bin/cqlsh.py b/bin/cqlsh.py
index 28054ba..e7dc121 100644
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@ -45,6 +45,7 @@ import sys
 import time
 import traceback
 import warnings
+import webbrowser
 from contextlib import contextmanager
 from functools import partial
 from glob import glob
@@ -71,6 +72,31 @@ CQL_LIB_PREFIX = 'cassandra-driver-internal-only-'
 
 CASSANDRA_PATH = os.path.join(os.path.dirname(os.path.realpath(__file__)), 
'..')
 
+if os.path.exists(CASSANDRA_PATH + '/doc/cql3/CQL.html'):
+# default location of local CQL.html
+CASSANDRA_CQL_HTML = 'file://' + CASSANDRA_PATH + '/doc/cql3/CQL.html'
+elif os.path.exists('/usr/share/doc/cassandra/CQL.html'):
+# fallback to package file
+CASSANDRA_CQL_HTML = 'file:///usr/share/doc/cassandra/CQL.html'
+else:
+# fallback to online version
+CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-2.2.html'
+
+# On Linux, the Python webbrowser module uses the 'xdg-open' executable
+# to open a file/URL. But that only works, if the current session has been
+# opened from _within_ a desktop environment. I.e. 'xdg-open' will fail,
+# if the session's been opened via ssh to a remote box.
+#
+# Use 'python' to get some information about the detected browsers.
+# >>> import webbrowser
+# >>> webbrowser._tryorder
+# >>> webbrowser._browser
+#
+if webbrowser._tryorder[0] == 'xdg-open' and os.environ.get('XDG_DATA_DIRS', 
'') == '':
+# only on Linux (some OS with xdg-open)
+webbrowser._tryorder.remove('xdg-open')
+webbrowser._tryorder.append('xdg-open')
+
 # use bundled libs for python-cql and thrift, if available. if there
 # is a ../lib dir, use bundled libs there preferentially.
 ZIPLIB_DIRS = [os.path.join(CASSANDRA_PATH, 'lib')]
@@ -164,6 +190,9 @@ parser.add_option("-C", "--color", action='store_true', 
dest='color',
   help='Always use color output')
 parser.add_option("--no-color", action='store_false', dest='color',
   help='Never use color output')
+parser.add_option("--browser", dest='browser', help="""The browser to use to 
display CQL help, where BROWSER can be:
+- one of the supported 
browsers in https://docs.python.org/2/library/webbrowser.html.
+- browser path followed by 
%s, example: /usr/bin/google-chrome-stable %s""")
 parser.add_option('--ssl', action='store_true', help='Use SSL', default=False)
 parser.add_option("-u", "--username", help="Authenticate as user.")
 parser.add_option("-p", "--password", help="Authenticate using password.")
@@ -630,7 +659,7 @@ class Shell(cmd.Cmd):
 
 def __init__(self, hostname, port, color=False,
  username=None, password=None, encoding=None, stdin=None, 
tty=True,
- completekey=DEFAULT_COMPLETEKEY, use_conn=None,
+ completekey=DEFAULT_COMPLETEKEY, browser=None, use_conn=None,
  cqlver=DEFAULT_CQLVER, keyspace=None,
  tracing_enabled=False, 

[2/3] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9a2fd8cc
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9a2fd8cc
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9a2fd8cc

Branch: refs/heads/cassandra-3.1
Commit: 9a2fd8ccf3a98831a6b30b13987d70753ee8523a
Parents: 56965fd 0ee8895
Author: Robert Stupp 
Authored: Fri Nov 27 15:26:02 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:26:02 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   62 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1078 -
 6 files changed, 188 insertions(+), 980 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/CHANGES.txt
--
diff --cc CHANGES.txt
index 592cff8,af1a186..0bb05d9
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,5 +1,17 @@@
 -2.2.4
 +3.0.1
 + * Fix SELECT statement with IN restrictions on partition key,
 +   ORDER BY and LIMIT (CASSANDRA-10729)
 + * Improve stress performance over 1k threads (CASSANDRA-7217)
 + * Wait for migration responses to complete before bootstrapping 
(CASSANDRA-10731)
 + * Unable to create a function with argument of type Inet (CASSANDRA-10741)
 + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717)
 + * Correctly preserve deletion info on updated rows when notifying indexers
 +   of single-row deletions (CASSANDRA-10694)
 + * Notify indexers of partition delete during cleanup (CASSANDRA-10685)
 + * Keep the file open in trySkipCache (CASSANDRA-10669)
 + * Updated trigger example (CASSANDRA-10257)
 +Merged from 2.2:
+  * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
   * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
   * Reject index queries while the index is building (CASSANDRA-8505)
   * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/bin/cqlsh.py
--
diff --cc bin/cqlsh.py
index d05a84b,e7dc121..6b87d9f
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@@ -71,6 -72,31 +72,32 @@@ CQL_LIB_PREFIX = 'cassandra-driver-inte
  
  CASSANDRA_PATH = os.path.join(os.path.dirname(os.path.realpath(__file__)), 
'..')
  
++# default location of local CQL.html
+ if os.path.exists(CASSANDRA_PATH + '/doc/cql3/CQL.html'):
+ # default location of local CQL.html
+ CASSANDRA_CQL_HTML = 'file://' + CASSANDRA_PATH + '/doc/cql3/CQL.html'
+ elif os.path.exists('/usr/share/doc/cassandra/CQL.html'):
+ # fallback to package file
+ CASSANDRA_CQL_HTML = 'file:///usr/share/doc/cassandra/CQL.html'
+ else:
+ # fallback to online version
 -CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-2.2.html'
++CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-3.0.html'
+ 
+ # On Linux, the Python webbrowser module uses the 'xdg-open' executable
+ # to open a file/URL. But that only works, if the current session has been
+ # opened from _within_ a desktop environment. I.e. 'xdg-open' will fail,
+ # if the session's been opened via ssh to a remote box.
+ #
+ # Use 'python' to get some information about the detected browsers.
+ # >>> import webbrowser
+ # >>> webbrowser._tryorder
+ # >>> webbrowser._browser
+ #
+ if webbrowser._tryorder[0] == 'xdg-open' and os.environ.get('XDG_DATA_DIRS', 
'') == '':
+ # only on Linux (some OS with xdg-open)
+ webbrowser._tryorder.remove('xdg-open')
+ webbrowser._tryorder.append('xdg-open')
+ 
  # use bundled libs for python-cql and thrift, if available. if there
  # is a ../lib dir, use bundled libs there preferentially.
  ZIPLIB_DIRS = [os.path.join(CASSANDRA_PATH, 'lib')]

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/build.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/pylib/cqlshlib/helptopics.py
--
diff --cc pylib/cqlshlib/helptopics.py
index b5cf09a,c2eebe3..347b17d
--- a/pylib/cqlshlib/helptopics.py
+++ b/pylib/cqlshlib/helptopics.py
@@@ -16,1026 -16,140 +16,152 @@@
  
  from .cql3handling import simple_cql_types
  
- 
- class CQLHelpTopics(object):
--
+ class CQL3HelpTopics(object):
 -
  def get_help_topics(self):
  return [t[5:] for t in dir(self) if t.startswith('help_')]
  
- def print_help_topic(self, topic):
-   

cassandra git commit: Show CQL help in cqlsh in web browser

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 432a8a484 -> 0ee8895b2


Show CQL help in cqlsh in web browser

patch by Robert Stupp; reviewed by Paulo Motta for CASSANDRA-7225


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/0ee8895b
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/0ee8895b
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/0ee8895b

Branch: refs/heads/cassandra-2.2
Commit: 0ee8895b27c2aa18260c73ec5c1941e48fbeaf75
Parents: 432a8a4
Author: Robert Stupp 
Authored: Fri Nov 27 15:24:51 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:24:51 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   61 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1060 -
 6 files changed, 176 insertions(+), 973 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index ce82bd0..af1a186 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
  * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/bin/cqlsh.py
--
diff --git a/bin/cqlsh.py b/bin/cqlsh.py
index 28054ba..e7dc121 100644
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@ -45,6 +45,7 @@ import sys
 import time
 import traceback
 import warnings
+import webbrowser
 from contextlib import contextmanager
 from functools import partial
 from glob import glob
@@ -71,6 +72,31 @@ CQL_LIB_PREFIX = 'cassandra-driver-internal-only-'
 
 CASSANDRA_PATH = os.path.join(os.path.dirname(os.path.realpath(__file__)), 
'..')
 
+if os.path.exists(CASSANDRA_PATH + '/doc/cql3/CQL.html'):
+# default location of local CQL.html
+CASSANDRA_CQL_HTML = 'file://' + CASSANDRA_PATH + '/doc/cql3/CQL.html'
+elif os.path.exists('/usr/share/doc/cassandra/CQL.html'):
+# fallback to package file
+CASSANDRA_CQL_HTML = 'file:///usr/share/doc/cassandra/CQL.html'
+else:
+# fallback to online version
+CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-2.2.html'
+
+# On Linux, the Python webbrowser module uses the 'xdg-open' executable
+# to open a file/URL. But that only works, if the current session has been
+# opened from _within_ a desktop environment. I.e. 'xdg-open' will fail,
+# if the session's been opened via ssh to a remote box.
+#
+# Use 'python' to get some information about the detected browsers.
+# >>> import webbrowser
+# >>> webbrowser._tryorder
+# >>> webbrowser._browser
+#
+if webbrowser._tryorder[0] == 'xdg-open' and os.environ.get('XDG_DATA_DIRS', 
'') == '':
+# only on Linux (some OS with xdg-open)
+webbrowser._tryorder.remove('xdg-open')
+webbrowser._tryorder.append('xdg-open')
+
 # use bundled libs for python-cql and thrift, if available. if there
 # is a ../lib dir, use bundled libs there preferentially.
 ZIPLIB_DIRS = [os.path.join(CASSANDRA_PATH, 'lib')]
@@ -164,6 +190,9 @@ parser.add_option("-C", "--color", action='store_true', 
dest='color',
   help='Always use color output')
 parser.add_option("--no-color", action='store_false', dest='color',
   help='Never use color output')
+parser.add_option("--browser", dest='browser', help="""The browser to use to 
display CQL help, where BROWSER can be:
+- one of the supported 
browsers in https://docs.python.org/2/library/webbrowser.html.
+- browser path followed by 
%s, example: /usr/bin/google-chrome-stable %s""")
 parser.add_option('--ssl', action='store_true', help='Use SSL', default=False)
 parser.add_option("-u", "--username", help="Authenticate as user.")
 parser.add_option("-p", "--password", help="Authenticate using password.")
@@ -630,7 +659,7 @@ class Shell(cmd.Cmd):
 
 def __init__(self, hostname, port, color=False,
  username=None, password=None, encoding=None, stdin=None, 
tty=True,
- completekey=DEFAULT_COMPLETEKEY, use_conn=None,
+ completekey=DEFAULT_COMPLETEKEY, browser=None, use_conn=None,
  cqlver=DEFAULT_CQLVER, keyspace=None,
  

[2/2] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9a2fd8cc
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9a2fd8cc
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9a2fd8cc

Branch: refs/heads/cassandra-3.0
Commit: 9a2fd8ccf3a98831a6b30b13987d70753ee8523a
Parents: 56965fd 0ee8895
Author: Robert Stupp 
Authored: Fri Nov 27 15:26:02 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:26:02 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   62 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1078 -
 6 files changed, 188 insertions(+), 980 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/CHANGES.txt
--
diff --cc CHANGES.txt
index 592cff8,af1a186..0bb05d9
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,5 +1,17 @@@
 -2.2.4
 +3.0.1
 + * Fix SELECT statement with IN restrictions on partition key,
 +   ORDER BY and LIMIT (CASSANDRA-10729)
 + * Improve stress performance over 1k threads (CASSANDRA-7217)
 + * Wait for migration responses to complete before bootstrapping 
(CASSANDRA-10731)
 + * Unable to create a function with argument of type Inet (CASSANDRA-10741)
 + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717)
 + * Correctly preserve deletion info on updated rows when notifying indexers
 +   of single-row deletions (CASSANDRA-10694)
 + * Notify indexers of partition delete during cleanup (CASSANDRA-10685)
 + * Keep the file open in trySkipCache (CASSANDRA-10669)
 + * Updated trigger example (CASSANDRA-10257)
 +Merged from 2.2:
+  * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
   * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
   * Reject index queries while the index is building (CASSANDRA-8505)
   * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/bin/cqlsh.py
--
diff --cc bin/cqlsh.py
index d05a84b,e7dc121..6b87d9f
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@@ -71,6 -72,31 +72,32 @@@ CQL_LIB_PREFIX = 'cassandra-driver-inte
  
  CASSANDRA_PATH = os.path.join(os.path.dirname(os.path.realpath(__file__)), 
'..')
  
++# default location of local CQL.html
+ if os.path.exists(CASSANDRA_PATH + '/doc/cql3/CQL.html'):
+ # default location of local CQL.html
+ CASSANDRA_CQL_HTML = 'file://' + CASSANDRA_PATH + '/doc/cql3/CQL.html'
+ elif os.path.exists('/usr/share/doc/cassandra/CQL.html'):
+ # fallback to package file
+ CASSANDRA_CQL_HTML = 'file:///usr/share/doc/cassandra/CQL.html'
+ else:
+ # fallback to online version
 -CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-2.2.html'
++CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-3.0.html'
+ 
+ # On Linux, the Python webbrowser module uses the 'xdg-open' executable
+ # to open a file/URL. But that only works, if the current session has been
+ # opened from _within_ a desktop environment. I.e. 'xdg-open' will fail,
+ # if the session's been opened via ssh to a remote box.
+ #
+ # Use 'python' to get some information about the detected browsers.
+ # >>> import webbrowser
+ # >>> webbrowser._tryorder
+ # >>> webbrowser._browser
+ #
+ if webbrowser._tryorder[0] == 'xdg-open' and os.environ.get('XDG_DATA_DIRS', 
'') == '':
+ # only on Linux (some OS with xdg-open)
+ webbrowser._tryorder.remove('xdg-open')
+ webbrowser._tryorder.append('xdg-open')
+ 
  # use bundled libs for python-cql and thrift, if available. if there
  # is a ../lib dir, use bundled libs there preferentially.
  ZIPLIB_DIRS = [os.path.join(CASSANDRA_PATH, 'lib')]

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/build.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/pylib/cqlshlib/helptopics.py
--
diff --cc pylib/cqlshlib/helptopics.py
index b5cf09a,c2eebe3..347b17d
--- a/pylib/cqlshlib/helptopics.py
+++ b/pylib/cqlshlib/helptopics.py
@@@ -16,1026 -16,140 +16,152 @@@
  
  from .cql3handling import simple_cql_types
  
- 
- class CQLHelpTopics(object):
--
+ class CQL3HelpTopics(object):
 -
  def get_help_topics(self):
  return [t[5:] for t in dir(self) if t.startswith('help_')]
  
- def print_help_topic(self, topic):
-   

[1/3] cassandra git commit: Show CQL help in cqlsh in web browser

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.1 b5fb5737a -> 918bc0116


Show CQL help in cqlsh in web browser

patch by Robert Stupp; reviewed by Paulo Motta for CASSANDRA-7225


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/0ee8895b
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/0ee8895b
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/0ee8895b

Branch: refs/heads/cassandra-3.1
Commit: 0ee8895b27c2aa18260c73ec5c1941e48fbeaf75
Parents: 432a8a4
Author: Robert Stupp 
Authored: Fri Nov 27 15:24:51 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:24:51 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   61 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1060 -
 6 files changed, 176 insertions(+), 973 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index ce82bd0..af1a186 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
  * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/bin/cqlsh.py
--
diff --git a/bin/cqlsh.py b/bin/cqlsh.py
index 28054ba..e7dc121 100644
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@ -45,6 +45,7 @@ import sys
 import time
 import traceback
 import warnings
+import webbrowser
 from contextlib import contextmanager
 from functools import partial
 from glob import glob
@@ -71,6 +72,31 @@ CQL_LIB_PREFIX = 'cassandra-driver-internal-only-'
 
 CASSANDRA_PATH = os.path.join(os.path.dirname(os.path.realpath(__file__)), 
'..')
 
+if os.path.exists(CASSANDRA_PATH + '/doc/cql3/CQL.html'):
+# default location of local CQL.html
+CASSANDRA_CQL_HTML = 'file://' + CASSANDRA_PATH + '/doc/cql3/CQL.html'
+elif os.path.exists('/usr/share/doc/cassandra/CQL.html'):
+# fallback to package file
+CASSANDRA_CQL_HTML = 'file:///usr/share/doc/cassandra/CQL.html'
+else:
+# fallback to online version
+CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-2.2.html'
+
+# On Linux, the Python webbrowser module uses the 'xdg-open' executable
+# to open a file/URL. But that only works, if the current session has been
+# opened from _within_ a desktop environment. I.e. 'xdg-open' will fail,
+# if the session's been opened via ssh to a remote box.
+#
+# Use 'python' to get some information about the detected browsers.
+# >>> import webbrowser
+# >>> webbrowser._tryorder
+# >>> webbrowser._browser
+#
+if webbrowser._tryorder[0] == 'xdg-open' and os.environ.get('XDG_DATA_DIRS', 
'') == '':
+# only on Linux (some OS with xdg-open)
+webbrowser._tryorder.remove('xdg-open')
+webbrowser._tryorder.append('xdg-open')
+
 # use bundled libs for python-cql and thrift, if available. if there
 # is a ../lib dir, use bundled libs there preferentially.
 ZIPLIB_DIRS = [os.path.join(CASSANDRA_PATH, 'lib')]
@@ -164,6 +190,9 @@ parser.add_option("-C", "--color", action='store_true', 
dest='color',
   help='Always use color output')
 parser.add_option("--no-color", action='store_false', dest='color',
   help='Never use color output')
+parser.add_option("--browser", dest='browser', help="""The browser to use to 
display CQL help, where BROWSER can be:
+- one of the supported 
browsers in https://docs.python.org/2/library/webbrowser.html.
+- browser path followed by 
%s, example: /usr/bin/google-chrome-stable %s""")
 parser.add_option('--ssl', action='store_true', help='Use SSL', default=False)
 parser.add_option("-u", "--username", help="Authenticate as user.")
 parser.add_option("-p", "--password", help="Authenticate using password.")
@@ -630,7 +659,7 @@ class Shell(cmd.Cmd):
 
 def __init__(self, hostname, port, color=False,
  username=None, password=None, encoding=None, stdin=None, 
tty=True,
- completekey=DEFAULT_COMPLETEKEY, use_conn=None,
+ completekey=DEFAULT_COMPLETEKEY, browser=None, use_conn=None,
  cqlver=DEFAULT_CQLVER, keyspace=None,
  

[4/4] cassandra git commit: Merge branch 'cassandra-3.1' into trunk

2015-11-27 Thread snazy
Merge branch 'cassandra-3.1' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/306d882f
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/306d882f
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/306d882f

Branch: refs/heads/trunk
Commit: 306d882fe3d997a5ddc2b21ed60ca24c5e71c7bc
Parents: 33e7bba 918bc01
Author: Robert Stupp 
Authored: Fri Nov 27 15:26:13 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:26:13 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   62 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1078 -
 6 files changed, 188 insertions(+), 980 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/306d882f/CHANGES.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/306d882f/build.xml
--



[3/4] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread snazy
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/918bc011
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/918bc011
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/918bc011

Branch: refs/heads/trunk
Commit: 918bc0116db701976ad9d0847b3b5c6a051fbbd8
Parents: b5fb573 9a2fd8c
Author: Robert Stupp 
Authored: Fri Nov 27 15:26:08 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:26:08 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   62 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1078 -
 6 files changed, 188 insertions(+), 980 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/918bc011/CHANGES.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/918bc011/build.xml
--



[2/4] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9a2fd8cc
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9a2fd8cc
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9a2fd8cc

Branch: refs/heads/trunk
Commit: 9a2fd8ccf3a98831a6b30b13987d70753ee8523a
Parents: 56965fd 0ee8895
Author: Robert Stupp 
Authored: Fri Nov 27 15:26:02 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:26:02 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   62 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1078 -
 6 files changed, 188 insertions(+), 980 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/CHANGES.txt
--
diff --cc CHANGES.txt
index 592cff8,af1a186..0bb05d9
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,5 +1,17 @@@
 -2.2.4
 +3.0.1
 + * Fix SELECT statement with IN restrictions on partition key,
 +   ORDER BY and LIMIT (CASSANDRA-10729)
 + * Improve stress performance over 1k threads (CASSANDRA-7217)
 + * Wait for migration responses to complete before bootstrapping 
(CASSANDRA-10731)
 + * Unable to create a function with argument of type Inet (CASSANDRA-10741)
 + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717)
 + * Correctly preserve deletion info on updated rows when notifying indexers
 +   of single-row deletions (CASSANDRA-10694)
 + * Notify indexers of partition delete during cleanup (CASSANDRA-10685)
 + * Keep the file open in trySkipCache (CASSANDRA-10669)
 + * Updated trigger example (CASSANDRA-10257)
 +Merged from 2.2:
+  * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
   * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
   * Reject index queries while the index is building (CASSANDRA-8505)
   * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/bin/cqlsh.py
--
diff --cc bin/cqlsh.py
index d05a84b,e7dc121..6b87d9f
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@@ -71,6 -72,31 +72,32 @@@ CQL_LIB_PREFIX = 'cassandra-driver-inte
  
  CASSANDRA_PATH = os.path.join(os.path.dirname(os.path.realpath(__file__)), 
'..')
  
++# default location of local CQL.html
+ if os.path.exists(CASSANDRA_PATH + '/doc/cql3/CQL.html'):
+ # default location of local CQL.html
+ CASSANDRA_CQL_HTML = 'file://' + CASSANDRA_PATH + '/doc/cql3/CQL.html'
+ elif os.path.exists('/usr/share/doc/cassandra/CQL.html'):
+ # fallback to package file
+ CASSANDRA_CQL_HTML = 'file:///usr/share/doc/cassandra/CQL.html'
+ else:
+ # fallback to online version
 -CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-2.2.html'
++CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-3.0.html'
+ 
+ # On Linux, the Python webbrowser module uses the 'xdg-open' executable
+ # to open a file/URL. But that only works, if the current session has been
+ # opened from _within_ a desktop environment. I.e. 'xdg-open' will fail,
+ # if the session's been opened via ssh to a remote box.
+ #
+ # Use 'python' to get some information about the detected browsers.
+ # >>> import webbrowser
+ # >>> webbrowser._tryorder
+ # >>> webbrowser._browser
+ #
+ if webbrowser._tryorder[0] == 'xdg-open' and os.environ.get('XDG_DATA_DIRS', 
'') == '':
+ # only on Linux (some OS with xdg-open)
+ webbrowser._tryorder.remove('xdg-open')
+ webbrowser._tryorder.append('xdg-open')
+ 
  # use bundled libs for python-cql and thrift, if available. if there
  # is a ../lib dir, use bundled libs there preferentially.
  ZIPLIB_DIRS = [os.path.join(CASSANDRA_PATH, 'lib')]

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/build.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9a2fd8cc/pylib/cqlshlib/helptopics.py
--
diff --cc pylib/cqlshlib/helptopics.py
index b5cf09a,c2eebe3..347b17d
--- a/pylib/cqlshlib/helptopics.py
+++ b/pylib/cqlshlib/helptopics.py
@@@ -16,1026 -16,140 +16,152 @@@
  
  from .cql3handling import simple_cql_types
  
- 
- class CQLHelpTopics(object):
--
+ class CQL3HelpTopics(object):
 -
  def get_help_topics(self):
  return [t[5:] for t in dir(self) if t.startswith('help_')]
  
- def print_help_topic(self, topic):
- 

[3/3] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread snazy
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/918bc011
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/918bc011
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/918bc011

Branch: refs/heads/cassandra-3.1
Commit: 918bc0116db701976ad9d0847b3b5c6a051fbbd8
Parents: b5fb573 9a2fd8c
Author: Robert Stupp 
Authored: Fri Nov 27 15:26:08 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:26:08 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   62 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1078 -
 6 files changed, 188 insertions(+), 980 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/918bc011/CHANGES.txt
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/918bc011/build.xml
--



[1/2] cassandra git commit: Show CQL help in cqlsh in web browser

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.0 56965fd6f -> 9a2fd8ccf


Show CQL help in cqlsh in web browser

patch by Robert Stupp; reviewed by Paulo Motta for CASSANDRA-7225


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/0ee8895b
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/0ee8895b
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/0ee8895b

Branch: refs/heads/cassandra-3.0
Commit: 0ee8895b27c2aa18260c73ec5c1941e48fbeaf75
Parents: 432a8a4
Author: Robert Stupp 
Authored: Fri Nov 27 15:24:51 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 15:24:51 2015 +0100

--
 CHANGES.txt  |1 +
 bin/cqlsh.py |   61 ++-
 build.xml|7 +-
 conf/cqlshrc.sample  |   17 +
 debian/rules |3 +-
 pylib/cqlshlib/helptopics.py | 1060 -
 6 files changed, 176 insertions(+), 973 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index ce82bd0..af1a186 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
  * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
  * Reject index queries while the index is building (CASSANDRA-8505)
  * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/0ee8895b/bin/cqlsh.py
--
diff --git a/bin/cqlsh.py b/bin/cqlsh.py
index 28054ba..e7dc121 100644
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@ -45,6 +45,7 @@ import sys
 import time
 import traceback
 import warnings
+import webbrowser
 from contextlib import contextmanager
 from functools import partial
 from glob import glob
@@ -71,6 +72,31 @@ CQL_LIB_PREFIX = 'cassandra-driver-internal-only-'
 
 CASSANDRA_PATH = os.path.join(os.path.dirname(os.path.realpath(__file__)), 
'..')
 
+if os.path.exists(CASSANDRA_PATH + '/doc/cql3/CQL.html'):
+# default location of local CQL.html
+CASSANDRA_CQL_HTML = 'file://' + CASSANDRA_PATH + '/doc/cql3/CQL.html'
+elif os.path.exists('/usr/share/doc/cassandra/CQL.html'):
+# fallback to package file
+CASSANDRA_CQL_HTML = 'file:///usr/share/doc/cassandra/CQL.html'
+else:
+# fallback to online version
+CASSANDRA_CQL_HTML = 'https://cassandra.apache.org/doc/cql3/CQL-2.2.html'
+
+# On Linux, the Python webbrowser module uses the 'xdg-open' executable
+# to open a file/URL. But that only works, if the current session has been
+# opened from _within_ a desktop environment. I.e. 'xdg-open' will fail,
+# if the session's been opened via ssh to a remote box.
+#
+# Use 'python' to get some information about the detected browsers.
+# >>> import webbrowser
+# >>> webbrowser._tryorder
+# >>> webbrowser._browser
+#
+if webbrowser._tryorder[0] == 'xdg-open' and os.environ.get('XDG_DATA_DIRS', 
'') == '':
+# only on Linux (some OS with xdg-open)
+webbrowser._tryorder.remove('xdg-open')
+webbrowser._tryorder.append('xdg-open')
+
 # use bundled libs for python-cql and thrift, if available. if there
 # is a ../lib dir, use bundled libs there preferentially.
 ZIPLIB_DIRS = [os.path.join(CASSANDRA_PATH, 'lib')]
@@ -164,6 +190,9 @@ parser.add_option("-C", "--color", action='store_true', 
dest='color',
   help='Always use color output')
 parser.add_option("--no-color", action='store_false', dest='color',
   help='Never use color output')
+parser.add_option("--browser", dest='browser', help="""The browser to use to 
display CQL help, where BROWSER can be:
+- one of the supported 
browsers in https://docs.python.org/2/library/webbrowser.html.
+- browser path followed by 
%s, example: /usr/bin/google-chrome-stable %s""")
 parser.add_option('--ssl', action='store_true', help='Use SSL', default=False)
 parser.add_option("-u", "--username", help="Authenticate as user.")
 parser.add_option("-p", "--password", help="Authenticate using password.")
@@ -630,7 +659,7 @@ class Shell(cmd.Cmd):
 
 def __init__(self, hostname, port, color=False,
  username=None, password=None, encoding=None, stdin=None, 
tty=True,
- completekey=DEFAULT_COMPLETEKEY, use_conn=None,
+ completekey=DEFAULT_COMPLETEKEY, browser=None, use_conn=None,
  cqlver=DEFAULT_CQLVER, keyspace=None,
  

[jira] [Commented] (CASSANDRA-10718) Group pending compactions based on table

2015-11-27 Thread Marcus Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029921#comment-15029921
 ] 

Marcus Eriksson commented on CASSANDRA-10718:
-

[~tusharice] have a look at the current compactionstats nodetool command, it is 
in {{CompactionStats.java}}

> Group pending compactions based on table
> 
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Marcus Eriksson
>Priority: Minor
>  Labels: lhf
> Fix For: 3.x
>
>
> Currently we only give a global number on how many compactions are pending, 
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-7225) show CQL help in cqlsh in web browser

2015-11-27 Thread Robert Stupp (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Stupp updated CASSANDRA-7225:

Summary: show CQL help in cqlsh in web browser  (was: cqlsh help for CQL3 
is often incorrect and should be modernized)

> show CQL help in cqlsh in web browser
> -
>
> Key: CASSANDRA-7225
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7225
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website, Tools
>Reporter: Robert Stupp
>Assignee: Robert Stupp
>Priority: Trivial
>  Labels: cqlsh, doc-impacting
> Fix For: 3.2, 2.2.x
>
> Attachments: 7225-add-cql-docs-to-debian-package.patch, 
> 7225-cqlhelp.txt, EXPAND.pdf
>
>
> Just a small line of text in cqlsh "help" command indicates that < is <= and 
> > is >= in CQL.
> This is confusing to many people (including me :) ) because I did not expect 
> < to return the "equals" portion.
> Please allow distinct behaviours for <, <=, > and >= in CQL queries. Maybe in 
> combination with CASSANDRA-5184 and/or CASSANDRA-4914 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[1/2] cassandra git commit: Status command in debian/ubuntu init script doesn't work

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 f8fc0311b -> d44dbe192


Status command in debian/ubuntu init script doesn't work

patch by Ruggero Marchei; reviewed by Michael Shuler for CASSANDRA-10213


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/8cd13f13
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/8cd13f13
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/8cd13f13

Branch: refs/heads/cassandra-2.2
Commit: 8cd13f1381dff81aa5dfe0f6b630fa8198aa0d2b
Parents: 4ecbbc0
Author: Ruggero Marchei 
Authored: Fri Nov 27 12:57:49 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:57:49 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 4adcf4f..111852c 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
  * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/debian/init
--
diff --git a/debian/init b/debian/init
index aff54e1..72417ae 100644
--- a/debian/init
+++ b/debian/init
@@ -47,7 +47,7 @@ FD_LIMIT=10
 # process is not running but the pidfile exists (to match the exit codes for
 # the "status" command; see LSB core spec 3.1, section 20.2)
 #
-CMD_PATT="cassandra.+CassandraDaemon"
+CMD_PATT="Dcassandra-pidfile=.*cassandra\.pid"
 is_running()
 {
 if [ -f $PIDFILE ]; then



[1/3] cassandra git commit: Status command in debian/ubuntu init script doesn't work

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.0 c7724e6b3 -> b166f5f3f


Status command in debian/ubuntu init script doesn't work

patch by Ruggero Marchei; reviewed by Michael Shuler for CASSANDRA-10213


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/8cd13f13
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/8cd13f13
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/8cd13f13

Branch: refs/heads/cassandra-3.0
Commit: 8cd13f1381dff81aa5dfe0f6b630fa8198aa0d2b
Parents: 4ecbbc0
Author: Ruggero Marchei 
Authored: Fri Nov 27 12:57:49 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:57:49 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 4adcf4f..111852c 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
  * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/debian/init
--
diff --git a/debian/init b/debian/init
index aff54e1..72417ae 100644
--- a/debian/init
+++ b/debian/init
@@ -47,7 +47,7 @@ FD_LIMIT=10
 # process is not running but the pidfile exists (to match the exit codes for
 # the "status" command; see LSB core spec 3.1, section 20.2)
 #
-CMD_PATT="cassandra.+CassandraDaemon"
+CMD_PATT="Dcassandra-pidfile=.*cassandra\.pid"
 is_running()
 {
 if [ -f $PIDFILE ]; then



[3/3] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b166f5f3
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b166f5f3
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b166f5f3

Branch: refs/heads/cassandra-3.0
Commit: b166f5f3fe3f460a878cd9d3bc37e69ffdada513
Parents: c7724e6 d44dbe1
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:46 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:46 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b166f5f3/CHANGES.txt
--
diff --cc CHANGES.txt
index 252972c,39ce927..472ed45
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -18,7 -6,16 +18,8 @@@ Merged from 2.2
   * Fix SimpleDateType type compatibility (CASSANDRA-10027)
   * (Hadoop) fix splits calculation (CASSANDRA-10640)
   * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 - * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 - * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 - * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 - * Expose phi values from failure detector via JMX and tweak debug
 -   and trace logging (CASSANDRA-9526)
 - * Fix RangeNamesQueryPager (CASSANDRA-10509)
 - * Deprecate Pig support (CASSANDRA-10542)
 - * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
  Merged from 2.1:
+  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
   * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/b166f5f3/debian/init
--



[3/4] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b166f5f3
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b166f5f3
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b166f5f3

Branch: refs/heads/cassandra-3.1
Commit: b166f5f3fe3f460a878cd9d3bc37e69ffdada513
Parents: c7724e6 d44dbe1
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:46 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:46 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b166f5f3/CHANGES.txt
--
diff --cc CHANGES.txt
index 252972c,39ce927..472ed45
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -18,7 -6,16 +18,8 @@@ Merged from 2.2
   * Fix SimpleDateType type compatibility (CASSANDRA-10027)
   * (Hadoop) fix splits calculation (CASSANDRA-10640)
   * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 - * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 - * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 - * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 - * Expose phi values from failure detector via JMX and tweak debug
 -   and trace logging (CASSANDRA-9526)
 - * Fix RangeNamesQueryPager (CASSANDRA-10509)
 - * Deprecate Pig support (CASSANDRA-10542)
 - * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
  Merged from 2.1:
+  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
   * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/b166f5f3/debian/init
--



[3/5] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread snazy
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b166f5f3
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b166f5f3
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b166f5f3

Branch: refs/heads/trunk
Commit: b166f5f3fe3f460a878cd9d3bc37e69ffdada513
Parents: c7724e6 d44dbe1
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:46 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:46 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b166f5f3/CHANGES.txt
--
diff --cc CHANGES.txt
index 252972c,39ce927..472ed45
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -18,7 -6,16 +18,8 @@@ Merged from 2.2
   * Fix SimpleDateType type compatibility (CASSANDRA-10027)
   * (Hadoop) fix splits calculation (CASSANDRA-10640)
   * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 - * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 - * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 - * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 - * Expose phi values from failure detector via JMX and tweak debug
 -   and trace logging (CASSANDRA-9526)
 - * Fix RangeNamesQueryPager (CASSANDRA-10509)
 - * Deprecate Pig support (CASSANDRA-10542)
 - * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
  Merged from 2.1:
+  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
   * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/b166f5f3/debian/init
--



[4/4] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread snazy
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/21a7a1c0
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/21a7a1c0
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/21a7a1c0

Branch: refs/heads/cassandra-3.1
Commit: 21a7a1c0912e50a09ed9efcbe65f25e6e353a17d
Parents: 55bf08a b166f5f
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:57 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:57 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/21a7a1c0/CHANGES.txt
--



[1/4] cassandra git commit: Status command in debian/ubuntu init script doesn't work

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.1 55bf08a5a -> 21a7a1c09


Status command in debian/ubuntu init script doesn't work

patch by Ruggero Marchei; reviewed by Michael Shuler for CASSANDRA-10213


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/8cd13f13
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/8cd13f13
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/8cd13f13

Branch: refs/heads/cassandra-3.1
Commit: 8cd13f1381dff81aa5dfe0f6b630fa8198aa0d2b
Parents: 4ecbbc0
Author: Ruggero Marchei 
Authored: Fri Nov 27 12:57:49 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:57:49 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 4adcf4f..111852c 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
  * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/debian/init
--
diff --git a/debian/init b/debian/init
index aff54e1..72417ae 100644
--- a/debian/init
+++ b/debian/init
@@ -47,7 +47,7 @@ FD_LIMIT=10
 # process is not running but the pidfile exists (to match the exit codes for
 # the "status" command; see LSB core spec 3.1, section 20.2)
 #
-CMD_PATT="cassandra.+CassandraDaemon"
+CMD_PATT="Dcassandra-pidfile=.*cassandra\.pid"
 is_running()
 {
 if [ -f $PIDFILE ]; then



[2/5] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d44dbe19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d44dbe19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d44dbe19

Branch: refs/heads/trunk
Commit: d44dbe1929b3746f6f931ef5c6499073ed3bbaeb
Parents: f8fc031 8cd13f1
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:16 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:16 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d44dbe19/CHANGES.txt
--
diff --cc CHANGES.txt
index 63305d6,111852c..39ce927
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,20 -1,5 +1,21 @@@
 -2.1.12
 +2.2.4
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
   * Force encoding when computing statement ids (CASSANDRA-10755)



[4/5] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.1

2015-11-27 Thread snazy
Merge branch 'cassandra-3.0' into cassandra-3.1


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/21a7a1c0
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/21a7a1c0
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/21a7a1c0

Branch: refs/heads/trunk
Commit: 21a7a1c0912e50a09ed9efcbe65f25e6e353a17d
Parents: 55bf08a b166f5f
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:57 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:57 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/21a7a1c0/CHANGES.txt
--



[5/5] cassandra git commit: Merge branch 'cassandra-3.1' into trunk

2015-11-27 Thread snazy
Merge branch 'cassandra-3.1' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f5e6f4ed
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f5e6f4ed
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f5e6f4ed

Branch: refs/heads/trunk
Commit: f5e6f4edd6dccf0061847d6fc17ad01eccae2756
Parents: 0401f57 21a7a1c
Author: Robert Stupp 
Authored: Fri Nov 27 12:59:01 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:59:01 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f5e6f4ed/CHANGES.txt
--



[1/5] cassandra git commit: Status command in debian/ubuntu init script doesn't work

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/trunk 0401f5797 -> f5e6f4edd


Status command in debian/ubuntu init script doesn't work

patch by Ruggero Marchei; reviewed by Michael Shuler for CASSANDRA-10213


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/8cd13f13
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/8cd13f13
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/8cd13f13

Branch: refs/heads/trunk
Commit: 8cd13f1381dff81aa5dfe0f6b630fa8198aa0d2b
Parents: 4ecbbc0
Author: Ruggero Marchei 
Authored: Fri Nov 27 12:57:49 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:57:49 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 4adcf4f..111852c 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
  * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
  * Force encoding when computing statement ids (CASSANDRA-10755)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/8cd13f13/debian/init
--
diff --git a/debian/init b/debian/init
index aff54e1..72417ae 100644
--- a/debian/init
+++ b/debian/init
@@ -47,7 +47,7 @@ FD_LIMIT=10
 # process is not running but the pidfile exists (to match the exit codes for
 # the "status" command; see LSB core spec 3.1, section 20.2)
 #
-CMD_PATT="cassandra.+CassandraDaemon"
+CMD_PATT="Dcassandra-pidfile=.*cassandra\.pid"
 is_running()
 {
 if [ -f $PIDFILE ]; then



[2/4] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2

2015-11-27 Thread snazy
Merge branch 'cassandra-2.1' into cassandra-2.2


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d44dbe19
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d44dbe19
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d44dbe19

Branch: refs/heads/cassandra-3.1
Commit: d44dbe1929b3746f6f931ef5c6499073ed3bbaeb
Parents: f8fc031 8cd13f1
Author: Robert Stupp 
Authored: Fri Nov 27 12:58:16 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 12:58:16 2015 +0100

--
 CHANGES.txt | 1 +
 debian/init | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/d44dbe19/CHANGES.txt
--
diff --cc CHANGES.txt
index 63305d6,111852c..39ce927
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,20 -1,5 +1,21 @@@
 -2.1.12
 +2.2.4
 + * Reject index queries while the index is building (CASSANDRA-8505)
 + * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
 + * Fix JSON update with prepared statements (CASSANDRA-10631)
 + * Don't do anticompaction after subrange repair (CASSANDRA-10422)
 + * Fix SimpleDateType type compatibility (CASSANDRA-10027)
 + * (Hadoop) fix splits calculation (CASSANDRA-10640)
 + * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
 + * (cqlsh) show partial trace if incomplete after max_trace_wait 
(CASSANDRA-7645)
 + * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
 + * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
 + * Expose phi values from failure detector via JMX and tweak debug
 +   and trace logging (CASSANDRA-9526)
 + * Fix RangeNamesQueryPager (CASSANDRA-10509)
 + * Deprecate Pig support (CASSANDRA-10542)
 + * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
 +Merged from 2.1:
+  * Status command in debian/ubuntu init script doesn't work (CASSANDRA-10213)
   * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing 
KS (CASSANDRA-10658)
   * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
   * Force encoding when computing statement ids (CASSANDRA-10755)



[2/2] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2015-11-27 Thread blerer
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c35af2a7
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c35af2a7
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c35af2a7

Branch: refs/heads/cassandra-3.0
Commit: c35af2a7a16b4df2032c5134abc535d73e561d0b
Parents: b166f5f e7116f2
Author: Benjamin Lerer 
Authored: Fri Nov 27 13:16:29 2015 +0100
Committer: Benjamin Lerer 
Committed: Fri Nov 27 13:16:29 2015 +0100

--
 CHANGES.txt  | 1 +
 .../apache/cassandra/io/sstable/format/big/BigTableWriter.java   | 4 +---
 2 files changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/c35af2a7/CHANGES.txt
--
diff --cc CHANGES.txt
index 472ed45,7281bd3..97c0eae
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,16 -1,5 +1,17 @@@
 -2.2.4
 +3.0.1
 + * Fix SELECT statement with IN restrictions on partition key,
 +   ORDER BY and LIMIT (CASSANDRA-10729)
 + * Improve stress performance over 1k threads (CASSANDRA-7217)
 + * Wait for migration responses to complete before bootstrapping 
(CASSANDRA-10731)
 + * Unable to create a function with argument of type Inet (CASSANDRA-10741)
 + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717)
 + * Correctly preserve deletion info on updated rows when notifying indexers
 +   of single-row deletions (CASSANDRA-10694)
 + * Notify indexers of partition delete during cleanup (CASSANDRA-10685)
 + * Keep the file open in trySkipCache (CASSANDRA-10669)
 + * Updated trigger example (CASSANDRA-10257)
 +Merged from 2.2:
+  * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
   * Reject index queries while the index is building (CASSANDRA-8505)
   * CQL.textile syntax incorrectly includes optional keyspace for aggregate 
SFUNC and FINALFUNC (CASSANDRA-10747)
   * Fix JSON update with prepared statements (CASSANDRA-10631)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/c35af2a7/src/java/org/apache/cassandra/io/sstable/format/big/BigTableWriter.java
--



[jira] [Commented] (CASSANDRA-10758) Dropping an index does not invalidate prepared statements anymore

2015-11-27 Thread Sylvain Lebresne (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029862#comment-15029862
 ] 

Sylvain Lebresne commented on CASSANDRA-10758:
--

bq. Had you got something more in mind?

Not particularly. My sentence should really be read "I'm tired of looking at 
fixing stuff that are not directly related to the issue" and I hadn't really 
looked at how to fix it at all tbh. But the fix does is trivial so good and +1 
on the patch, modulo clean CI (which doesn't seem to have been started yet).

> Dropping an index does not invalidate prepared statements anymore
> -
>
> Key: CASSANDRA-10758
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10758
> Project: Cassandra
>  Issue Type: Bug
>  Components: CQL
>Reporter: Sylvain Lebresne
>Assignee: Sam Tunnicliffe
>  Labels: secondary_index
> Fix For: 3.0.1, 3.1
>
>
> When we drop an index, we should invalidate ({{SELECT}}) statements on the 
> base table as those may involve the index (and, for instance, validating an 
> index exists is done a preparation time in {{SELECT}}, so a {{SELECT}} does 
> potentially become invalid if an index is dropped). As far as I can tell, 
> this is properly done in pre-3.0, because {{CFMetaData.apply}} will return 
> {{true}} which will trigger the statements invalidations. And that is 
> because, before 3.0, index definitions are part of the {{ColumnDefinition}} 
> of the base table and thus dropping an index is (rightfullly in a way) 
> considered by {{CFMetaData}} as a change to the table columns. In 3.0 
> however, as indexes has been moved out of {{ColumnDefinition}}, 
> {{CFMetaData.apply}} returns {{false}} in that case and statements are not 
> invalidated.
> I'll note that the changes to {{CQLTester}} done in CASSANDRA-10631 actually 
> expose this problem (but indirectly so we should create a purpose built tests 
> for this).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9474) Validate dc information on startup

2015-11-27 Thread Robert Stupp (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029870#comment-15029870
 ] 

Robert Stupp commented on CASSANDRA-9474:
-

Can you provide an updated text for NEWS.txt?
2.2, 3.0 and 3.1 also need to be rebased.

> Validate dc information on startup
> --
>
> Key: CASSANDRA-9474
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9474
> Project: Cassandra
>  Issue Type: Improvement
> Environment: Cassandra 2.1.5
>Reporter: Marcus Olsson
>Assignee: Marcus Olsson
> Fix For: 3.1, 3.2, 2.1.x, 2.2.x, 3.0.x
>
> Attachments: CASSANDRA-9474-2.2.patch, CASSANDRA-9474-dtest.patch, 
> CASSANDRA-9474-trunk.patch, cassandra-2.1-9474.patch, 
> cassandra-2.1-dc_rack_healthcheck.patch
>
>
> When using GossipingPropertyFileSnitch it is possible to change the data 
> center and rack of a live node by changing the cassandra-rackdc.properties 
> file. Should this really be possible? In the documentation at 
> http://docs.datastax.com/en/cassandra/2.1/cassandra/initialize/initializeMultipleDS.html
>  it's stated that you should ??Choose the name carefully; renaming a data 
> center is not possible??, but with this functionality it doesn't seem 
> impossible(maybe a bit hard with changing replication etc.).
> This functionality was introduced by CASSANDRA-5897 so I'm guessing there is 
> some use case for this?
> Personally I would want the DC/rack settings to be as restricted as the 
> cluster name, otherwise if a node could just join another data center without 
> removing it's local information couldn't it mess up the token ranges? And 
> suddenly the old data center/rack would loose 1 replica of all the data that 
> the node contains.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-7225) cqlsh help for CQL3 is often incorrect and should be modernized

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029871#comment-15029871
 ] 

Paulo Motta commented on CASSANDRA-7225:


Awesome, thanks! Marking as ready to commit.

> cqlsh help for CQL3 is often incorrect and should be modernized
> ---
>
> Key: CASSANDRA-7225
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7225
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website, Tools
>Reporter: Robert Stupp
>Assignee: Robert Stupp
>Priority: Trivial
>  Labels: cqlsh, doc-impacting
> Fix For: 3.2, 2.2.x
>
> Attachments: 7225-add-cql-docs-to-debian-package.patch, 
> 7225-cqlhelp.txt, EXPAND.pdf
>
>
> Just a small line of text in cqlsh "help" command indicates that < is <= and 
> > is >= in CQL.
> This is confusing to many people (including me :) ) because I did not expect 
> < to return the "equals" portion.
> Please allow distinct behaviours for <, <=, > and >= in CQL queries. Maybe in 
> combination with CASSANDRA-5184 and/or CASSANDRA-4914 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10779) AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread Thread

2015-11-27 Thread Sylvain Lebresne (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sylvain Lebresne updated CASSANDRA-10779:
-
Component/s: Coordination

> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread
> --
>
> Key: CASSANDRA-10779
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10779
> Project: Cassandra
>  Issue Type: Bug
>  Components: Coordination
> Environment: Windows 7 64-bit, Cassandra v3.0.0, Java 1.8u60
>Reporter: Will Zhang
> Fix For: 3.0.1, 3.1
>
>
> Hi guys,
> I encountered the following warning message when I was testing to upgrade 
> from v2.2.2 to v3.0.0. 
> It looks like a write time-out but in an uncaught exception. Could this be an 
> easy fix?
> Log file section below. Thank you!
> {code}
>   WARN  [SharedPool-Worker-64] 2015-11-26 14:04:24,678 
> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread[SharedPool-Worker-64,10,main]: {}
> org.apache.cassandra.exceptions.WriteTimeoutException: Operation timed out - 
> received only 0 responses.
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:427) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:386) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Mutation.apply(Mutation.java:205) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.db.Keyspace.lambda$apply$59(Keyspace.java:435) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_60]
>   at 
> org.apache.cassandra.concurrent.AbstractTracingAwareExecutorService$FutureTask.run(AbstractTracingAwareExecutorService.java:164)
>  ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) 
> [apache-cassandra-3.0.0.jar:3.0.0]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
>   INFO  [IndexSummaryManager:1] 2015-11-26 14:41:10,527 
> IndexSummaryManager.java:257 - Redistributing index summaries
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10779) AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread Thread

2015-11-27 Thread Sylvain Lebresne (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sylvain Lebresne updated CASSANDRA-10779:
-
Assignee: Carl Yeksigian

> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread
> --
>
> Key: CASSANDRA-10779
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10779
> Project: Cassandra
>  Issue Type: Bug
>  Components: Coordination
> Environment: Windows 7 64-bit, Cassandra v3.0.0, Java 1.8u60
>Reporter: Will Zhang
>Assignee: Carl Yeksigian
> Fix For: 3.0.1, 3.1
>
>
> Hi guys,
> I encountered the following warning message when I was testing to upgrade 
> from v2.2.2 to v3.0.0. 
> It looks like a write time-out but in an uncaught exception. Could this be an 
> easy fix?
> Log file section below. Thank you!
> {code}
>   WARN  [SharedPool-Worker-64] 2015-11-26 14:04:24,678 
> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread[SharedPool-Worker-64,10,main]: {}
> org.apache.cassandra.exceptions.WriteTimeoutException: Operation timed out - 
> received only 0 responses.
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:427) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:386) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Mutation.apply(Mutation.java:205) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.db.Keyspace.lambda$apply$59(Keyspace.java:435) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_60]
>   at 
> org.apache.cassandra.concurrent.AbstractTracingAwareExecutorService$FutureTask.run(AbstractTracingAwareExecutorService.java:164)
>  ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) 
> [apache-cassandra-3.0.0.jar:3.0.0]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
>   INFO  [IndexSummaryManager:1] 2015-11-26 14:41:10,527 
> IndexSummaryManager.java:257 - Redistributing index summaries
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10779) AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread Thread

2015-11-27 Thread Sylvain Lebresne (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029890#comment-15029890
 ] 

Sylvain Lebresne commented on CASSANDRA-10779:
--

Assigning to [~carlyeks] since that's Materialized Views related. It does sound 
like the write timeout should be somehow propagated to the original method 
call, but that's incompatible with dealing with that case (where you can't 
acquire the lock right away) asynchronously, so not sure what's the best 
solution here.

> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread
> --
>
> Key: CASSANDRA-10779
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10779
> Project: Cassandra
>  Issue Type: Bug
>  Components: Coordination
> Environment: Windows 7 64-bit, Cassandra v3.0.0, Java 1.8u60
>Reporter: Will Zhang
> Fix For: 3.0.1, 3.1
>
>
> Hi guys,
> I encountered the following warning message when I was testing to upgrade 
> from v2.2.2 to v3.0.0. 
> It looks like a write time-out but in an uncaught exception. Could this be an 
> easy fix?
> Log file section below. Thank you!
> {code}
>   WARN  [SharedPool-Worker-64] 2015-11-26 14:04:24,678 
> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread[SharedPool-Worker-64,10,main]: {}
> org.apache.cassandra.exceptions.WriteTimeoutException: Operation timed out - 
> received only 0 responses.
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:427) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:386) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Mutation.apply(Mutation.java:205) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.db.Keyspace.lambda$apply$59(Keyspace.java:435) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_60]
>   at 
> org.apache.cassandra.concurrent.AbstractTracingAwareExecutorService$FutureTask.run(AbstractTracingAwareExecutorService.java:164)
>  ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) 
> [apache-cassandra-3.0.0.jar:3.0.0]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
>   INFO  [IndexSummaryManager:1] 2015-11-26 14:41:10,527 
> IndexSummaryManager.java:257 - Redistributing index summaries
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9748) Can't see other nodes when using multiple network interfaces

2015-11-27 Thread Roman Bielik (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029903#comment-15029903
 ] 

Roman Bielik commented on CASSANDRA-9748:
-

Thank you, for me this feature is really important and I would be glad if it 
could be backported to the 3.x branch as well (for future compatibility). 

> Can't see other nodes when using multiple network interfaces
> 
>
> Key: CASSANDRA-9748
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9748
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Streaming and Messaging
> Environment: Cassandra 2.0.16; multi-DC configuration
>Reporter: Roman Bielik
>Assignee: Paulo Motta
>Priority: Minor
>  Labels: docs-impacting
> Fix For: 2.1.x, 2.2.x, 3.0.x
>
> Attachments: system_node1.log, system_node2.log
>
>
> The idea is to setup a multi-DC environment across 2 different networks based 
> on the following configuration recommendations:
> http://docs.datastax.com/en/cassandra/2.0/cassandra/configuration/configMultiNetworks.html
> Each node has 2 network interfaces. One used as a private network (DC1: 
> 10.0.1.x and DC2: 10.0.2.x). The second one a "public" network where all 
> nodes can see each other (this one has a higher latency). 
> Using the following settings in cassandra.yaml:
> *seeds:* public IP (same as used in broadcast_address)
> *listen_address:* private IP
> *broadcast_address:* public IP
> *rpc_address:* 0.0.0.0
> *endpoint_snitch:* GossipingPropertyFileSnitch
> _(tried different combinations with no luck)_
> No firewall and no SSL/encryption used.
> The problem is that nodes do not see each other (a gossip problem I guess). 
> The nodetool ring/status shows only the local node but not the other ones 
> (even from the same DC).
> When I set listen_address to public IP, then everything works fine, but that 
> is not the required configuration.
> _Note: Not using EC2 cloud!_
> netstat -anp | grep -E "(7199|9160|9042|7000)"
> tcp0  0 0.0.0.0:71990.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9160   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9042   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:7000   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 127.0.0.1:7199  127.0.0.1:52874 
> ESTABLISHED 3587/java   
> tcp0  0 10.0.1.1:7199   10.0.1.1:39650  
> ESTABLISHED 3587/java 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10780) Exception encountered during startup

2015-11-27 Thread Alan Boudreault (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029904#comment-15029904
 ] 

Alan Boudreault commented on CASSANDRA-10780:
-

[~mlowicki] Do you have this exception on each startup? Can you provide the 
complete system.log using the loglevel debug?  

> Exception encountered during startup
> 
>
> Key: CASSANDRA-10780
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10780
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.1.11 on Debian Wheezy
>Reporter: mlowicki
>
> {code}
> ERROR [main] 2015-11-27 12:39:42,659 CassandraDaemon.java:579 - Exception 
> encountered during startup
> org.apache.cassandra.io.FSReadError: java.lang.NullPointerException
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:663)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:306) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:562)
>  [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:651) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> Caused by: java.lang.NullPointerException: null
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:655)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> ... 3 common frames omitted
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10780) Exception encountered during startup

2015-11-27 Thread Marcus Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029910#comment-15029910
 ] 

Marcus Eriksson commented on CASSANDRA-10780:
-

this is a duplicate of CASSANDRA-10501

> Exception encountered during startup
> 
>
> Key: CASSANDRA-10780
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10780
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.1.11 on Debian Wheezy
>Reporter: mlowicki
>
> {code}
> ERROR [main] 2015-11-27 12:39:42,659 CassandraDaemon.java:579 - Exception 
> encountered during startup
> org.apache.cassandra.io.FSReadError: java.lang.NullPointerException
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:663)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:306) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:562)
>  [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:651) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> Caused by: java.lang.NullPointerException: null
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:655)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> ... 3 common frames omitted
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (CASSANDRA-10780) Exception encountered during startup

2015-11-27 Thread Marcus Eriksson (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson resolved CASSANDRA-10780.
-
Resolution: Duplicate

> Exception encountered during startup
> 
>
> Key: CASSANDRA-10780
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10780
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.1.11 on Debian Wheezy
>Reporter: mlowicki
>
> {code}
> ERROR [main] 2015-11-27 12:39:42,659 CassandraDaemon.java:579 - Exception 
> encountered during startup
> org.apache.cassandra.io.FSReadError: java.lang.NullPointerException
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:663)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:306) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:562)
>  [apache-cassandra-2.1.11.jar:2.1.11]
> at 
> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:651) 
> [apache-cassandra-2.1.11.jar:2.1.11]
> Caused by: java.lang.NullPointerException: null
> at 
> org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers(ColumnFamilyStore.java:655)
>  ~[apache-cassandra-2.1.11.jar:2.1.11]
> ... 3 common frames omitted
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10778) CompactionExecutor writing to old index files

2015-11-27 Thread Sylvain Lebresne (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sylvain Lebresne updated CASSANDRA-10778:
-
Fix Version/s: 3.1
   3.0.1

> CompactionExecutor writing to old index files
> -
>
> Key: CASSANDRA-10778
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10778
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
> Environment: Windows 7 64-bit, Cassandra 3.0.0, Java 1.8u60
>Reporter: Will Zhang
>  Labels: error
> Fix For: 3.0.1, 3.1
>
>
> Hi,
> I have been running some test for upgrading from v2.2.2 to v3.0.0. 
> I encountered the following `ERROR` in the `system.log` when I was 
> *creating/dropping materialized views*. I did some searches online but 
> couldn't find anything useful so filing this. The log seem to suggest that it 
> is bug-like.
> Any thoughts on this would be appreciated.
> Main error line in log:
> {code}
> ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033 CassandraDaemon.java:195 
> - Exception in thread Thread[CompactionExecutor:4,1,main]
> java.lang.AssertionError: We read old index files but we should never 
> write them
> {code}
> Longer log:
> {code}
> INFO  [SharedPool-Worker-2] 2015-11-26 15:25:37,152 
> MigrationManager.java:336 - Create new view: 
> org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
>  IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT 
> NULL AND broker IS NOT 
> NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
>  read_repair_chance=0.0, dclocal_read_repair_chance=0.1, 
> bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000, 
> default_time_to_live=0, memtable_flush_period_in_ms=0, 
> min_index_interval=128, max_index_interval=2048, 
> speculative_retry=99PERCENTILE, caching={'keys' : 'ALL', 'rows_per_partition' 
> : 'NONE'}, 
> compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
>  options={min_threshold=4, max_threshold=32}}, 
> compression=org.apache.cassandra.schema.CompressionParams@f3ef4959, 
> extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  org.apache.cassandra.db.marshal.UTF8Type, 
> org.apache.cassandra.db.marshal.UTF8Type, 
> org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | 
> [bmark_spread g_spread is_axed oas_spread price size ytw 
> z_spread]],partitionKeyColumns=[ColumnDefinition{name=date, 
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
> position=0}],clusteringColumns=[ColumnDefinition{name=datetime, 
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  kind=CLUSTERING, position=0}, ColumnDefinition{name=side, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1}, 
> ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
> kind=CLUSTERING, position=2}, ColumnDefinition{name=broker, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, 
> position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
>  type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=datetime, 
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  kind=CLUSTERING, position=0}, ColumnDefinition{name=date, 
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
> position=0}, ColumnDefinition{name=oas_spread, 
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
> kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread, 
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type, 
> kind=CLUSTERING, position=1}, ColumnDefinition{name=broker, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3}, 
> ColumnDefinition{name=is_axed, 
> type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType, 
> kind=REGULAR, position=-1}, ColumnDefinition{name=price, 
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> 

[jira] [Commented] (CASSANDRA-10778) CompactionExecutor writing to old index files

2015-11-27 Thread Sylvain Lebresne (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029884#comment-15029884
 ] 

Sylvain Lebresne commented on CASSANDRA-10778:
--

The reason is that the method to serialize old format index entries is not 
implemented (hence the assertion), which was mistakenly though ok as we never 
write old format sstables, but as the stack shows, we still potentially dump 
the key cache for old format sstables and that requires this serialization 
method after all.

We just need to add the code to do it, which shouldn't be too hard, but I think 
we also need to add a unit test to test serialization/deserialization for all 
format version we read.

Now, for those affected, the error isn't catastrophic. It means the key cache 
hasn't be saved properly and that means you'll have a cold key cache on 
startup. I'll also note that running {{upgradesstables}} will remove that 
problem by the virtue of converting all sstables to the new format right away. 
In fact, I'd definitively recommend running {{upgradesstables}} when upgrading 
nodes on 3.0 if at all practical.

> CompactionExecutor writing to old index files
> -
>
> Key: CASSANDRA-10778
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10778
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
> Environment: Windows 7 64-bit, Cassandra 3.0.0, Java 1.8u60
>Reporter: Will Zhang
>  Labels: error
> Fix For: 3.0.1, 3.1
>
>
> Hi,
> I have been running some test for upgrading from v2.2.2 to v3.0.0. 
> I encountered the following `ERROR` in the `system.log` when I was 
> *creating/dropping materialized views*. I did some searches online but 
> couldn't find anything useful so filing this. The log seem to suggest that it 
> is bug-like.
> Any thoughts on this would be appreciated.
> Main error line in log:
> {code}
> ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033 CassandraDaemon.java:195 
> - Exception in thread Thread[CompactionExecutor:4,1,main]
> java.lang.AssertionError: We read old index files but we should never 
> write them
> {code}
> Longer log:
> {code}
> INFO  [SharedPool-Worker-2] 2015-11-26 15:25:37,152 
> MigrationManager.java:336 - Create new view: 
> org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
>  IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT 
> NULL AND broker IS NOT 
> NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
>  read_repair_chance=0.0, dclocal_read_repair_chance=0.1, 
> bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000, 
> default_time_to_live=0, memtable_flush_period_in_ms=0, 
> min_index_interval=128, max_index_interval=2048, 
> speculative_retry=99PERCENTILE, caching={'keys' : 'ALL', 'rows_per_partition' 
> : 'NONE'}, 
> compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
>  options={min_threshold=4, max_threshold=32}}, 
> compression=org.apache.cassandra.schema.CompressionParams@f3ef4959, 
> extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  org.apache.cassandra.db.marshal.UTF8Type, 
> org.apache.cassandra.db.marshal.UTF8Type, 
> org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | 
> [bmark_spread g_spread is_axed oas_spread price size ytw 
> z_spread]],partitionKeyColumns=[ColumnDefinition{name=date, 
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
> position=0}],clusteringColumns=[ColumnDefinition{name=datetime, 
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  kind=CLUSTERING, position=0}, ColumnDefinition{name=side, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1}, 
> ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
> kind=CLUSTERING, position=2}, ColumnDefinition{name=broker, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, 
> position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
>  type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=datetime, 
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  kind=CLUSTERING, position=0}, ColumnDefinition{name=date, 
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
> 

[jira] [Updated] (CASSANDRA-10778) CompactionExecutor writing to old index files

2015-11-27 Thread Sylvain Lebresne (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sylvain Lebresne updated CASSANDRA-10778:
-
Assignee: Ariel Weisberg

> CompactionExecutor writing to old index files
> -
>
> Key: CASSANDRA-10778
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10778
> Project: Cassandra
>  Issue Type: Bug
>  Components: Compaction
> Environment: Windows 7 64-bit, Cassandra 3.0.0, Java 1.8u60
>Reporter: Will Zhang
>Assignee: Ariel Weisberg
>  Labels: error
> Fix For: 3.0.1, 3.1
>
>
> Hi,
> I have been running some test for upgrading from v2.2.2 to v3.0.0. 
> I encountered the following `ERROR` in the `system.log` when I was 
> *creating/dropping materialized views*. I did some searches online but 
> couldn't find anything useful so filing this. The log seem to suggest that it 
> is bug-like.
> Any thoughts on this would be appreciated.
> Main error line in log:
> {code}
> ERROR [CompactionExecutor:4] 2015-11-26 15:40:56,033 CassandraDaemon.java:195 
> - Exception in thread Thread[CompactionExecutor:4,1,main]
> java.lang.AssertionError: We read old index files but we should never 
> write them
> {code}
> Longer log:
> {code}
> INFO  [SharedPool-Worker-2] 2015-11-26 15:25:37,152 
> MigrationManager.java:336 - Create new view: 
> org.apache.cassandra.config.ViewDefinition@1b7fc5e6[ksName=demo,viewName=broker_quotes_by_date,baseTableId=bf928280-3c23-11e5-a4ba-07dc7eba8ee2,baseTableName=broker_quotes,includeAllColumns=true,whereClause=date
>  IS NOT NULL AND datetime IS NOT NULL AND isin IS NOT NULL AND side IS NOT 
> NULL AND broker IS NOT 
> NULL,metadata=org.apache.cassandra.config.CFMetaData@49123522[cfId=f19cb8f0-9451-11e5-af90-6916ca23ea25,ksName=demo,cfName=broker_quotes_by_date,flags=[COMPOUND],params=TableParams{comment=,
>  read_repair_chance=0.0, dclocal_read_repair_chance=0.1, 
> bloom_filter_fp_chance=0.01, crc_check_chance=1.0, gc_grace_seconds=864000, 
> default_time_to_live=0, memtable_flush_period_in_ms=0, 
> min_index_interval=128, max_index_interval=2048, 
> speculative_retry=99PERCENTILE, caching={'keys' : 'ALL', 'rows_per_partition' 
> : 'NONE'}, 
> compaction=CompactionParams{class=org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,
>  options={min_threshold=4, max_threshold=32}}, 
> compression=org.apache.cassandra.schema.CompressionParams@f3ef4959, 
> extensions={}},comparator=comparator(org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  org.apache.cassandra.db.marshal.UTF8Type, 
> org.apache.cassandra.db.marshal.UTF8Type, 
> org.apache.cassandra.db.marshal.UTF8Type),partitionColumns=[[] | 
> [bmark_spread g_spread is_axed oas_spread price size ytw 
> z_spread]],partitionKeyColumns=[ColumnDefinition{name=date, 
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
> position=0}],clusteringColumns=[ColumnDefinition{name=datetime, 
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  kind=CLUSTERING, position=0}, ColumnDefinition{name=side, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=1}, 
> ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
> kind=CLUSTERING, position=2}, ColumnDefinition{name=broker, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, 
> position=3}],keyValidator=org.apache.cassandra.db.marshal.TimestampType,columnMetadata=[ColumnDefinition{name=z_spread,
>  type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=datetime, 
> type=org.apache.cassandra.db.marshal.ReversedType(org.apache.cassandra.db.marshal.TimestampType),
>  kind=CLUSTERING, position=0}, ColumnDefinition{name=date, 
> type=org.apache.cassandra.db.marshal.TimestampType, kind=PARTITION_KEY, 
> position=0}, ColumnDefinition{name=oas_spread, 
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=isin, type=org.apache.cassandra.db.marshal.UTF8Type, 
> kind=CLUSTERING, position=2}, ColumnDefinition{name=bmark_spread, 
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=side, type=org.apache.cassandra.db.marshal.UTF8Type, 
> kind=CLUSTERING, position=1}, ColumnDefinition{name=broker, 
> type=org.apache.cassandra.db.marshal.UTF8Type, kind=CLUSTERING, position=3}, 
> ColumnDefinition{name=is_axed, 
> type=org.apache.cassandra.db.marshal.BooleanType, kind=REGULAR, position=-1}, 
> ColumnDefinition{name=ytw, type=org.apache.cassandra.db.marshal.FloatType, 
> kind=REGULAR, position=-1}, ColumnDefinition{name=price, 
> type=org.apache.cassandra.db.marshal.FloatType, kind=REGULAR, position=-1}, 
> 

[jira] [Updated] (CASSANDRA-10779) AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread Thread

2015-11-27 Thread Sylvain Lebresne (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sylvain Lebresne updated CASSANDRA-10779:
-
Fix Version/s: 3.1
   3.0.1

> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread
> --
>
> Key: CASSANDRA-10779
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10779
> Project: Cassandra
>  Issue Type: Bug
>  Components: Coordination
> Environment: Windows 7 64-bit, Cassandra v3.0.0, Java 1.8u60
>Reporter: Will Zhang
> Fix For: 3.0.1, 3.1
>
>
> Hi guys,
> I encountered the following warning message when I was testing to upgrade 
> from v2.2.2 to v3.0.0. 
> It looks like a write time-out but in an uncaught exception. Could this be an 
> easy fix?
> Log file section below. Thank you!
> {code}
>   WARN  [SharedPool-Worker-64] 2015-11-26 14:04:24,678 
> AbstractTracingAwareExecutorService.java:169 - Uncaught exception on thread 
> Thread[SharedPool-Worker-64,10,main]: {}
> org.apache.cassandra.exceptions.WriteTimeoutException: Operation timed out - 
> received only 0 responses.
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:427) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:386) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at org.apache.cassandra.db.Mutation.apply(Mutation.java:205) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.db.Keyspace.lambda$apply$59(Keyspace.java:435) 
> ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> ~[na:1.8.0_60]
>   at 
> org.apache.cassandra.concurrent.AbstractTracingAwareExecutorService$FutureTask.run(AbstractTracingAwareExecutorService.java:164)
>  ~[apache-cassandra-3.0.0.jar:3.0.0]
>   at 
> org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) 
> [apache-cassandra-3.0.0.jar:3.0.0]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
>   INFO  [IndexSummaryManager:1] 2015-11-26 14:41:10,527 
> IndexSummaryManager.java:257 - Redistributing index summaries
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10243) Warn or fail when changing cluster topology live

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030266#comment-15030266
 ] 

Paulo Motta commented on CASSANDRA-10243:
-

[~Stefania] After CASSANDRA-9474 is merged, the rack startup failure message 
will change to {{Cannot start node if snitch's rack (rack2) differs from 
previous rack (rack1). Please fix the snitch configuration, decommission and 
rebootstrap this node or use the flag -Dcassandra.ignore_rack=true}}, can you 
please update that on 
{{replication_test.py:SnitchConfigurationUpdateTest.test_cannot_restart_with_different_rack}}
 before submitting the PR? Thanks!

> Warn or fail when changing cluster topology live
> 
>
> Key: CASSANDRA-10243
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10243
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Tools
>Reporter: Jonathan Ellis
>Assignee: Stefania
>Priority: Critical
> Fix For: 2.1.12, 2.2.4, 3.0.1, 3.1, 3.2
>
>
> Moving a node from one rack to another in the snitch, while it is alive, is 
> almost always the wrong thing to do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (CASSANDRA-10718) Group pending compactions based on table

2015-11-27 Thread Tushar Agrawal (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tushar Agrawal reassigned CASSANDRA-10718:
--

Assignee: Tushar Agrawal

> Group pending compactions based on table
> 
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Marcus Eriksson
>Assignee: Tushar Agrawal
>Priority: Minor
>  Labels: lhf
> Fix For: 3.x
>
>
> Currently we only give a global number on how many compactions are pending, 
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10777) LegacySSTableTest Test-case failure, Issue with test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db file read on BIG ENDian systems

2015-11-27 Thread Nirav Thakkar (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030368#comment-15030368
 ] 

Nirav Thakkar commented on CASSANDRA-10777:
---

Sorry, but we dont have AWS instance which can be used, But We noticed couple 
of difference in the file, if we use BIG-ENDian system as compared to 
LITTLE-ENDian system.  I am attaching the screenshots of the files, one is the 
IndexSummary which is used for the TestCase. Similar difference is found if we 
create a keyspace and use "flush keyspace" to obtain the SSTable Files. 

The issue in the Test-case is while reading data as an integer, the value comes 
out to be very large, and we subtract 32 and check if its zero,and hence the 
assertion fails on BE system.

> LegacySSTableTest Test-case failure,  Issue with 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db  
> file read on BIG ENDian systems
> 
>
> Key: CASSANDRA-10777
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10777
> Project: Cassandra
>  Issue Type: Bug
> Environment: OS:RHEL7 and BIG ENDian system
>Reporter: Nirav Thakkar
> Attachments: IndexSummaryBE.jpg, IndexSummaryLE.jpg
>
>
> I am building Cassandra 2.2.3 on BigEndian System. Cassandra builds 
> successfully. However there are quite a few test case failures. One of the 
> failing test case is LegacySSTableTest. This test case reads the file 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db
> Are these existing test data files, specific to Little Endian systems?
> I have observed differences in values read on a LE Vs BE systems.
> I use the following command to run the test case. ant test 
> -Dtest.name=LegacySSTableTest
> I get the following error:
> [junit] - Standard Error -
> [junit] Failed to read jb
> [junit] -  ---
> [junit] Testcase: 
> testStreaming(org.apache.cassandra.io.sstable.LegacySSTableTest): FAILED
> [junit] null
> [junit] junit.framework.AssertionFailedError
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary.(IndexSummary.java:80)
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary$IndexSummarySerializer.deserialize(IndexSummary.java:317)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.loadSummary(SSTableReader.java:877)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:730)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:692)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:480)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:376)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:371)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:363)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:115)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:110)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10777) LegacySSTableTest Test-case failure, Issue with test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db file read on BIG ENDian systems

2015-11-27 Thread Nirav Thakkar (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nirav Thakkar updated CASSANDRA-10777:
--
Attachment: IndexSummaryLE.jpg
IndexSummaryBE.jpg

The values on LE and BE for reading as integer has some variation.

> LegacySSTableTest Test-case failure,  Issue with 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db  
> file read on BIG ENDian systems
> 
>
> Key: CASSANDRA-10777
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10777
> Project: Cassandra
>  Issue Type: Bug
> Environment: OS:RHEL7 and BIG ENDian system
>Reporter: Nirav Thakkar
> Attachments: IndexSummaryBE.jpg, IndexSummaryLE.jpg
>
>
> I am building Cassandra 2.2.3 on BigEndian System. Cassandra builds 
> successfully. However there are quite a few test case failures. One of the 
> failing test case is LegacySSTableTest. This test case reads the file 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db
> Are these existing test data files, specific to Little Endian systems?
> I have observed differences in values read on a LE Vs BE systems.
> I use the following command to run the test case. ant test 
> -Dtest.name=LegacySSTableTest
> I get the following error:
> [junit] - Standard Error -
> [junit] Failed to read jb
> [junit] -  ---
> [junit] Testcase: 
> testStreaming(org.apache.cassandra.io.sstable.LegacySSTableTest): FAILED
> [junit] null
> [junit] junit.framework.AssertionFailedError
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary.(IndexSummary.java:80)
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary$IndexSummarySerializer.deserialize(IndexSummary.java:317)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.loadSummary(SSTableReader.java:877)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:730)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:692)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:480)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:376)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:371)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:363)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:115)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:110)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-7904) Repair hangs

2015-11-27 Thread Anuj Wadehra (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anuj Wadehra updated CASSANDRA-7904:

Attachment: Repair_DEBUG_On_OutboundTcpConnection.txt

Repair logs. DEBUG Enabled on OutboundTcpConnection.java. 

> Repair hangs
> 
>
> Key: CASSANDRA-7904
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7904
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.0.10, ubuntu 14.04, Java HotSpot(TM) 64-Bit Server, 
> java version "1.7.0_45"
>Reporter: Duncan Sands
> Attachments: Repair_DEBUG_On_OutboundTcpConnection.txt, 
> ls-172.18.68.138, ls-192.168.21.13, ls-192.168.60.134, ls-192.168.60.136
>
>
> Cluster of 22 nodes spread over 4 data centres.  Not used on the weekend, so 
> repair is run on all nodes (in a staggered fashion) on the weekend.  Nodetool 
> options: -par -pr.  There is usually some overlap in the repairs: repair on 
> one node may well still be running when repair is started on the next node.  
> Repair hangs for some of the nodes almost every weekend.  It hung last 
> weekend, here are the details:
> In the whole cluster, only one node had an exception since C* was last 
> restarted.  This node is 192.168.60.136 and the exception is harmless: a 
> client disconnected abruptly.
> tpstats
>   4 nodes have a non-zero value for "active" or "pending" in 
> AntiEntropySessions.  These nodes all have Active => 1 and Pending => 1.  The 
> nodes are:
>   192.168.21.13 (data centre R)
>   192.168.60.134 (data centre A)
>   192.168.60.136 (data centre A)
>   172.18.68.138 (data centre Z)
> compactionstats:
>   No compactions.  All nodes have:
> pending tasks: 0
> Active compaction remaining time :n/a
> netstats:
>   All except one node have nothing.  One node (192.168.60.131, not one of the 
> nodes listed in the tpstats section above) has (note the Responses Pending 
> value of 1):
> Mode: NORMAL
> Not sending any streams.
> Read Repair Statistics:
> Attempted: 4233
> Mismatch (Blocking): 0
> Mismatch (Background): 243
> Pool NameActive   Pending  Completed
> Commandsn/a 0   34785445
> Responses   n/a 1   38567167
> Repair sessions
>   I looked for repair sessions that failed to complete.  On 3 of the 4 nodes 
> mentioned in tpstats above I found that they had sent merkle tree requests 
> and got responses from all but one node.  In the log file for the node that 
> failed to respond there is no sign that it ever received the request.  On 1 
> node (172.18.68.138) it looks like responses were received from every node, 
> some streaming was done, and then... nothing.  Details:
>   Node 192.168.21.13 (data centre R):
> Sent merkle trees to /172.18.33.24, /192.168.60.140, /192.168.60.142, 
> /172.18.68.139, /172.18.68.138, /172.18.33.22, /192.168.21.13 for table 
> brokers, never got a response from /172.18.68.139.  On /172.18.68.139, just 
> before this time it sent a response for the same repair session but a 
> different table, and there is no record of it receiving a request for table 
> brokers.
>   Node 192.168.60.134 (data centre A):
> Sent merkle trees to /172.18.68.139, /172.18.68.138, /192.168.60.132, 
> /192.168.21.14, /192.168.60.134 for table swxess_outbound, never got a 
> response from /172.18.68.138.  On /172.18.68.138, just before this time it 
> sent a response for the same repair session but a different table, and there 
> is no record of it receiving a request for table swxess_outbound.
>   Node 192.168.60.136 (data centre A):
> Sent merkle trees to /192.168.60.142, /172.18.68.139, /192.168.60.136 for 
> table rollups7200, never got a response from /172.18.68.139.  This repair 
> session is never mentioned in the /172.18.68.139 log.
>   Node 172.18.68.138 (data centre Z):
> The issue here seems to be repair session 
> #a55c16e1-35eb-11e4-8e7e-51c077eaf311.  It got responses for all its merkle 
> tree requests, did some streaming, but seems to have stopped after finishing 
> with one table (rollups60).  I found it as follows: it is the only repair for 
> which there is no "session completed successfully" message in the log.
> Some log file snippets are attached.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-7904) Repair hangs

2015-11-27 Thread Yuki Morishita (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030227#comment-15030227
 ] 

Yuki Morishita commented on CASSANDRA-7904:
---

CASSANDRA-10113 may be your case.

> Repair hangs
> 
>
> Key: CASSANDRA-7904
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7904
> Project: Cassandra
>  Issue Type: Bug
> Environment: C* 2.0.10, ubuntu 14.04, Java HotSpot(TM) 64-Bit Server, 
> java version "1.7.0_45"
>Reporter: Duncan Sands
> Attachments: Repair_DEBUG_On_OutboundTcpConnection.txt, 
> ls-172.18.68.138, ls-192.168.21.13, ls-192.168.60.134, ls-192.168.60.136
>
>
> Cluster of 22 nodes spread over 4 data centres.  Not used on the weekend, so 
> repair is run on all nodes (in a staggered fashion) on the weekend.  Nodetool 
> options: -par -pr.  There is usually some overlap in the repairs: repair on 
> one node may well still be running when repair is started on the next node.  
> Repair hangs for some of the nodes almost every weekend.  It hung last 
> weekend, here are the details:
> In the whole cluster, only one node had an exception since C* was last 
> restarted.  This node is 192.168.60.136 and the exception is harmless: a 
> client disconnected abruptly.
> tpstats
>   4 nodes have a non-zero value for "active" or "pending" in 
> AntiEntropySessions.  These nodes all have Active => 1 and Pending => 1.  The 
> nodes are:
>   192.168.21.13 (data centre R)
>   192.168.60.134 (data centre A)
>   192.168.60.136 (data centre A)
>   172.18.68.138 (data centre Z)
> compactionstats:
>   No compactions.  All nodes have:
> pending tasks: 0
> Active compaction remaining time :n/a
> netstats:
>   All except one node have nothing.  One node (192.168.60.131, not one of the 
> nodes listed in the tpstats section above) has (note the Responses Pending 
> value of 1):
> Mode: NORMAL
> Not sending any streams.
> Read Repair Statistics:
> Attempted: 4233
> Mismatch (Blocking): 0
> Mismatch (Background): 243
> Pool NameActive   Pending  Completed
> Commandsn/a 0   34785445
> Responses   n/a 1   38567167
> Repair sessions
>   I looked for repair sessions that failed to complete.  On 3 of the 4 nodes 
> mentioned in tpstats above I found that they had sent merkle tree requests 
> and got responses from all but one node.  In the log file for the node that 
> failed to respond there is no sign that it ever received the request.  On 1 
> node (172.18.68.138) it looks like responses were received from every node, 
> some streaming was done, and then... nothing.  Details:
>   Node 192.168.21.13 (data centre R):
> Sent merkle trees to /172.18.33.24, /192.168.60.140, /192.168.60.142, 
> /172.18.68.139, /172.18.68.138, /172.18.33.22, /192.168.21.13 for table 
> brokers, never got a response from /172.18.68.139.  On /172.18.68.139, just 
> before this time it sent a response for the same repair session but a 
> different table, and there is no record of it receiving a request for table 
> brokers.
>   Node 192.168.60.134 (data centre A):
> Sent merkle trees to /172.18.68.139, /172.18.68.138, /192.168.60.132, 
> /192.168.21.14, /192.168.60.134 for table swxess_outbound, never got a 
> response from /172.18.68.138.  On /172.18.68.138, just before this time it 
> sent a response for the same repair session but a different table, and there 
> is no record of it receiving a request for table swxess_outbound.
>   Node 192.168.60.136 (data centre A):
> Sent merkle trees to /192.168.60.142, /172.18.68.139, /192.168.60.136 for 
> table rollups7200, never got a response from /172.18.68.139.  This repair 
> session is never mentioned in the /172.18.68.139 log.
>   Node 172.18.68.138 (data centre Z):
> The issue here seems to be repair session 
> #a55c16e1-35eb-11e4-8e7e-51c077eaf311.  It got responses for all its merkle 
> tree requests, did some streaming, but seems to have stopped after finishing 
> with one table (rollups60).  I found it as follows: it is the only repair for 
> which there is no "session completed successfully" message in the log.
> Some log file snippets are attached.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10753) Fix completion problems breaking clqshlib tests

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030277#comment-15030277
 ] 

Paulo Motta commented on CASSANDRA-10753:
-

Submitted cassci runs for {{stef1927-10753-2.2-dtest}} and 
{{stef1927-10753-3.0-dtest}}.

> Fix completion problems breaking clqshlib tests
> ---
>
> Key: CASSANDRA-10753
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10753
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Stefania
>Assignee: Stefania
> Fix For: 3.0.x
>
>
> The recent changes in the python driver APIs have caused some completion 
> problems as indicated by 2 of these failing tests:
> http://cassci.datastax.com/job/trunk_cqlshlib/579/testReport/
> The third failing test, {{test_timestamp_output}}, has been failing for some 
> time due to uncertainty on what to do regarding timezone conversion but it 
> too can be changed to reflect the fact that we convert the timestamp to UTC.
> Finally, {{max_window_size_seconds}} was recently added to the compaction 
> properties and this caused 2 more tests to fail. It cannot be seen on Jenkins 
> because of the relative import problem introduced by CASSANDRA-9304. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9474) Validate dc information on startup

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030290#comment-15030290
 ] 

Paulo Motta commented on CASSANDRA-9474:


Rebased and updated NEWS.txt. Resubmitted tests.

> Validate dc information on startup
> --
>
> Key: CASSANDRA-9474
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9474
> Project: Cassandra
>  Issue Type: Improvement
> Environment: Cassandra 2.1.5
>Reporter: Marcus Olsson
>Assignee: Marcus Olsson
> Fix For: 3.1, 3.2, 2.1.x, 2.2.x, 3.0.x
>
> Attachments: CASSANDRA-9474-2.2.patch, CASSANDRA-9474-dtest.patch, 
> CASSANDRA-9474-trunk.patch, cassandra-2.1-9474.patch, 
> cassandra-2.1-dc_rack_healthcheck.patch
>
>
> When using GossipingPropertyFileSnitch it is possible to change the data 
> center and rack of a live node by changing the cassandra-rackdc.properties 
> file. Should this really be possible? In the documentation at 
> http://docs.datastax.com/en/cassandra/2.1/cassandra/initialize/initializeMultipleDS.html
>  it's stated that you should ??Choose the name carefully; renaming a data 
> center is not possible??, but with this functionality it doesn't seem 
> impossible(maybe a bit hard with changing replication etc.).
> This functionality was introduced by CASSANDRA-5897 so I'm guessing there is 
> some use case for this?
> Personally I would want the DC/rack settings to be as restricted as the 
> cluster name, otherwise if a node could just join another data center without 
> removing it's local information couldn't it mess up the token ranges? And 
> suddenly the old data center/rack would loose 1 replica of all the data that 
> the node contains.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10774) Fail stream session if receiver cannot process data

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030340#comment-15030340
 ] 

Paulo Motta commented on CASSANDRA-10774:
-

I was able to confirm the suspicion by injecting an exception on the 
{{OnCompletionRunnable}} of the receiving node during a ccm testing bootstrap 
session. On 2.1 and 2.2, the bootstrap hangs indefinitely, while on 3.0 the 
bootstrap succeeds even with a failure during processing.

Simple fix is to wrap the {{OnCompletionRunnable.run()}} in a try-catch block, 
and fail the stream session in case an exception is catch. Otherwise the stream 
receive task is completed as usual. I tested with a similar scenario as before 
and the bootstrap fails as expected in 2.1, 2.2 and 3.0.

Below are branches and test results:
||2.1||2.2||3.0||3.1||trunk||
|[branch|https://github.com/apache/cassandra/compare/cassandra-2.1...pauloricardomg:2.1-10774]|[branch|https://github.com/apache/cassandra/compare/cassandra-2.2...pauloricardomg:2.2-10774]|[branch|https://github.com/apache/cassandra/compare/cassandra-3.0...pauloricardomg:3.0-10774]|[branch|https://github.com/apache/cassandra/compare/cassandra-3.1...pauloricardomg:3.1-10774]|[branch|https://github.com/apache/cassandra/compare/trunk...pauloricardomg:trunk-10774]|
|[testall|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-2.1-10774-testall/lastCompletedBuild/testReport/]|[testall|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-2.2-10774-testall/lastCompletedBuild/testReport/]|[testall|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-3.0-10774-testall/lastCompletedBuild/testReport/]|[testall|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-3.1-10774-testall/lastCompletedBuild/testReport/]|[testall|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-trunk-10774-testall/lastCompletedBuild/testReport/]|
|[dtest|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-2.1-10774-dtest/lastCompletedBuild/testReport/]|[dtest|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-2.2-10774-dtest/lastCompletedBuild/testReport/]|[dtest|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-3.0-10774-dtest/lastCompletedBuild/testReport/]|[dtest|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-3.1-10774-dtest/lastCompletedBuild/testReport/]|[dtest|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-trunk-10774-dtest/lastCompletedBuild/testReport/]|

> Fail stream session if receiver cannot process data
> ---
>
> Key: CASSANDRA-10774
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10774
> Project: Cassandra
>  Issue Type: Bug
>  Components: Streaming and Messaging
>Reporter: Paulo Motta
>Assignee: Paulo Motta
>Priority: Critical
>
> [~tjake] on CASSANDRA-10674:
> {quote}
> I think the underlying issue here is streaming failures only account for 
> problems during the file send. Not any subsequent errors.
> We should probably add an acknowledgement to the streaming operation that it 
> was processed by the receiver correctly.
> {quote}
> It seems the stream receive task (and thus the stream sesssion) is only 
> completed on 
> [2.1|https://github.com/apache/cassandra/blob/cassandra-2.1/src/java/org/apache/cassandra/streaming/StreamReceiveTask.java#L175]
>  and 
> [2.2|https://github.com/apache/cassandra/blob/cassandra-2.2/src/java/org/apache/cassandra/streaming/StreamReceiveTask.java#L171]
>  after the files are processed (otherwise it just hangs), but on 
> [3.0|https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/streaming/StreamReceiveTask.java#L231]
>  it's always completed even if there was a failure, what seems more critical. 
> In any case, we should probably fail the stream session if there is a problem 
> while processing the received data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (CASSANDRA-10777) LegacySSTableTest Test-case failure, Issue with test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db file read on BIG ENDian systems

2015-11-27 Thread Nirav Thakkar (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030368#comment-15030368
 ] 

Nirav Thakkar edited comment on CASSANDRA-10777 at 11/28/15 4:39 AM:
-

Sorry, but we dont have AWS instance which can be used, But We noticed couple 
of difference in the file, if we use BIG-ENDian system as compared to 
LITTLE-ENDian system.  I am attaching the screenshots of the file- 
IndexSummary(LE and BE) which is used for the TestCase. There is small 
difference(BE vs LE) in the files if we create a keyspace and use "flush 
keyspace" to obtain the SSTable Files. 

The issue in the Test-case is while reading data as an integer, the value comes 
out to be very large, and we subtract 32 and check if its zero,and hence the 
assertion fails on BE system.


was (Author: nirav):
Sorry, but we dont have AWS instance which can be used, But We noticed couple 
of difference in the file, if we use BIG-ENDian system as compared to 
LITTLE-ENDian system.  I am attaching the screenshots of the files, one is the 
IndexSummary which is used for the TestCase. Similar difference is found if we 
create a keyspace and use "flush keyspace" to obtain the SSTable Files. 

The issue in the Test-case is while reading data as an integer, the value comes 
out to be very large, and we subtract 32 and check if its zero,and hence the 
assertion fails on BE system.

> LegacySSTableTest Test-case failure,  Issue with 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db  
> file read on BIG ENDian systems
> 
>
> Key: CASSANDRA-10777
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10777
> Project: Cassandra
>  Issue Type: Bug
> Environment: OS:RHEL7 and BIG ENDian system
>Reporter: Nirav Thakkar
> Attachments: IndexSummaryBE.jpg, IndexSummaryLE.jpg
>
>
> I am building Cassandra 2.2.3 on BigEndian System. Cassandra builds 
> successfully. However there are quite a few test case failures. One of the 
> failing test case is LegacySSTableTest. This test case reads the file 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db
> Are these existing test data files, specific to Little Endian systems?
> I have observed differences in values read on a LE Vs BE systems.
> I use the following command to run the test case. ant test 
> -Dtest.name=LegacySSTableTest
> I get the following error:
> [junit] - Standard Error -
> [junit] Failed to read jb
> [junit] -  ---
> [junit] Testcase: 
> testStreaming(org.apache.cassandra.io.sstable.LegacySSTableTest): FAILED
> [junit] null
> [junit] junit.framework.AssertionFailedError
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary.(IndexSummary.java:80)
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary$IndexSummarySerializer.deserialize(IndexSummary.java:317)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.loadSummary(SSTableReader.java:877)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:730)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:692)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:480)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:376)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:371)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:363)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:115)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:110)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (CASSANDRA-10777) LegacySSTableTest Test-case failure, Issue with test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db file read on BIG ENDian systems

2015-11-27 Thread Nirav Thakkar (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030368#comment-15030368
 ] 

Nirav Thakkar edited comment on CASSANDRA-10777 at 11/28/15 6:45 AM:
-

Sorry, but we dont have AWS instance which can be used.  I am attaching the 
screenshots of the file- Standard-jb-Summary(LE and BE) which is used for the 
TestCase. The issue in the Test-case is while reading data as an integer, the 
value comes out to be very large, which is not the case with LE(please see the 
highlighted part in the attachment),and hence the assertion fails on BE system. 

Also we created a sample table, and created SSTables using "flush keyspace", 
and we observed difference in the file Standard-jb-Summary, for BE compared to 
LE. Please check the attachment for the difference, we observed.



was (Author: nirav):
Sorry, but we dont have AWS instance which can be used, But We noticed couple 
of difference in the file, if we use BIG-ENDian system as compared to 
LITTLE-ENDian system.  I am attaching the screenshots of the file- 
IndexSummary(LE and BE) which is used for the TestCase. There is small 
difference(BE vs LE) in the files if we create a keyspace and use "flush 
keyspace" to obtain the SSTable Files. 

The issue in the Test-case is while reading data as an integer, the value comes 
out to be very large, and we subtract 32 and check if its zero,and hence the 
assertion fails on BE system.

> LegacySSTableTest Test-case failure,  Issue with 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db  
> file read on BIG ENDian systems
> 
>
> Key: CASSANDRA-10777
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10777
> Project: Cassandra
>  Issue Type: Bug
> Environment: OS:RHEL7 and BIG ENDian system
>Reporter: Nirav Thakkar
> Attachments: IndexSummaryBE.jpg, IndexSummaryLE.jpg
>
>
> I am building Cassandra 2.2.3 on BigEndian System. Cassandra builds 
> successfully. However there are quite a few test case failures. One of the 
> failing test case is LegacySSTableTest. This test case reads the file 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db
> Are these existing test data files, specific to Little Endian systems?
> I have observed differences in values read on a LE Vs BE systems.
> I use the following command to run the test case. ant test 
> -Dtest.name=LegacySSTableTest
> I get the following error:
> [junit] - Standard Error -
> [junit] Failed to read jb
> [junit] -  ---
> [junit] Testcase: 
> testStreaming(org.apache.cassandra.io.sstable.LegacySSTableTest): FAILED
> [junit] null
> [junit] junit.framework.AssertionFailedError
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary.(IndexSummary.java:80)
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary$IndexSummarySerializer.deserialize(IndexSummary.java:317)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.loadSummary(SSTableReader.java:877)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:730)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:692)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:480)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:376)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:371)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:363)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:115)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:110)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-10777) LegacySSTableTest Test-case failure, Issue with test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db file read on BIG ENDian systems

2015-11-27 Thread Nirav Thakkar (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nirav Thakkar updated CASSANDRA-10777:
--
Attachment: SampleTable_Summary.db_LE.jpg
SampleTable_Summary.db_BE.jpg

Though the tables contain the same values, there is difference in the SSTable 
Summary file on BE and LE.

> LegacySSTableTest Test-case failure,  Issue with 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db  
> file read on BIG ENDian systems
> 
>
> Key: CASSANDRA-10777
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10777
> Project: Cassandra
>  Issue Type: Bug
> Environment: OS:RHEL7 and BIG ENDian system
>Reporter: Nirav Thakkar
> Attachments: IndexSummaryBE.jpg, IndexSummaryLE.jpg, 
> SampleTable_Summary.db_BE.jpg, SampleTable_Summary.db_LE.jpg
>
>
> I am building Cassandra 2.2.3 on BigEndian System. Cassandra builds 
> successfully. However there are quite a few test case failures. One of the 
> failing test case is LegacySSTableTest. This test case reads the file 
> test\data\legacy-sstables\jb\Keyspace1\Keyspace1-Standard1-jb-0-Summary.db
> Are these existing test data files, specific to Little Endian systems?
> I have observed differences in values read on a LE Vs BE systems.
> I use the following command to run the test case. ant test 
> -Dtest.name=LegacySSTableTest
> I get the following error:
> [junit] - Standard Error -
> [junit] Failed to read jb
> [junit] -  ---
> [junit] Testcase: 
> testStreaming(org.apache.cassandra.io.sstable.LegacySSTableTest): FAILED
> [junit] null
> [junit] junit.framework.AssertionFailedError
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary.(IndexSummary.java:80)
> [junit] at 
> org.apache.cassandra.io.sstable.IndexSummary$IndexSummarySerializer.deserialize(IndexSummary.java:317)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.loadSummary(SSTableReader.java:877)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:730)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:692)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:480)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:376)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:371)
> [junit] at 
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:363)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:115)
> [junit] at 
> org.apache.cassandra.io.sstable.LegacySSTableTest.testStreaming(LegacySSTableTest.java:110)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9748) Can't see other nodes when using multiple network interfaces

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029971#comment-15029971
 ] 

Paulo Motta commented on CASSANDRA-9748:


[~RomanB] meanwhile would you mind trying the new patch with the 
{{listen_on_broadcast_address}} option enabled following the instructions on 
[configuring multiple 
networks|http://docs.datastax.com/en/cassandra/2.0/cassandra/configuration/configMultiNetworks.html]
 and check if that also works?

> Can't see other nodes when using multiple network interfaces
> 
>
> Key: CASSANDRA-9748
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9748
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Streaming and Messaging
> Environment: Cassandra 2.0.16; multi-DC configuration
>Reporter: Roman Bielik
>Assignee: Paulo Motta
>Priority: Minor
>  Labels: docs-impacting
> Fix For: 2.1.x, 2.2.x, 3.0.x
>
> Attachments: system_node1.log, system_node2.log
>
>
> The idea is to setup a multi-DC environment across 2 different networks based 
> on the following configuration recommendations:
> http://docs.datastax.com/en/cassandra/2.0/cassandra/configuration/configMultiNetworks.html
> Each node has 2 network interfaces. One used as a private network (DC1: 
> 10.0.1.x and DC2: 10.0.2.x). The second one a "public" network where all 
> nodes can see each other (this one has a higher latency). 
> Using the following settings in cassandra.yaml:
> *seeds:* public IP (same as used in broadcast_address)
> *listen_address:* private IP
> *broadcast_address:* public IP
> *rpc_address:* 0.0.0.0
> *endpoint_snitch:* GossipingPropertyFileSnitch
> _(tried different combinations with no luck)_
> No firewall and no SSL/encryption used.
> The problem is that nodes do not see each other (a gossip problem I guess). 
> The nodetool ring/status shows only the local node but not the other ones 
> (even from the same DC).
> When I set listen_address to public IP, then everything works fine, but that 
> is not the required configuration.
> _Note: Not using EC2 cloud!_
> netstat -anp | grep -E "(7199|9160|9042|7000)"
> tcp0  0 0.0.0.0:71990.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9160   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9042   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:7000   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 127.0.0.1:7199  127.0.0.1:52874 
> ESTABLISHED 3587/java   
> tcp0  0 10.0.1.1:7199   10.0.1.1:39650  
> ESTABLISHED 3587/java 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9748) Can't see other nodes when using multiple network interfaces

2015-11-27 Thread Paulo Motta (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029976#comment-15029976
 ] 

Paulo Motta commented on CASSANDRA-9748:


Don't forget to enable the {{prefer_local}} option of the 
{{GossipingPropertyFileSnitch}} (that is not mentioned in those docs 
unfortunately), the {{local_address}} option is not needed anymore.

> Can't see other nodes when using multiple network interfaces
> 
>
> Key: CASSANDRA-9748
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9748
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Streaming and Messaging
> Environment: Cassandra 2.0.16; multi-DC configuration
>Reporter: Roman Bielik
>Assignee: Paulo Motta
>Priority: Minor
>  Labels: docs-impacting
> Fix For: 2.1.x, 2.2.x, 3.0.x
>
> Attachments: system_node1.log, system_node2.log
>
>
> The idea is to setup a multi-DC environment across 2 different networks based 
> on the following configuration recommendations:
> http://docs.datastax.com/en/cassandra/2.0/cassandra/configuration/configMultiNetworks.html
> Each node has 2 network interfaces. One used as a private network (DC1: 
> 10.0.1.x and DC2: 10.0.2.x). The second one a "public" network where all 
> nodes can see each other (this one has a higher latency). 
> Using the following settings in cassandra.yaml:
> *seeds:* public IP (same as used in broadcast_address)
> *listen_address:* private IP
> *broadcast_address:* public IP
> *rpc_address:* 0.0.0.0
> *endpoint_snitch:* GossipingPropertyFileSnitch
> _(tried different combinations with no luck)_
> No firewall and no SSL/encryption used.
> The problem is that nodes do not see each other (a gossip problem I guess). 
> The nodetool ring/status shows only the local node but not the other ones 
> (even from the same DC).
> When I set listen_address to public IP, then everything works fine, but that 
> is not the required configuration.
> _Note: Not using EC2 cloud!_
> netstat -anp | grep -E "(7199|9160|9042|7000)"
> tcp0  0 0.0.0.0:71990.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9160   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9042   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:7000   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 127.0.0.1:7199  127.0.0.1:52874 
> ESTABLISHED 3587/java   
> tcp0  0 10.0.1.1:7199   10.0.1.1:39650  
> ESTABLISHED 3587/java 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-9748) Can't see other nodes when using multiple network interfaces

2015-11-27 Thread Roman Bielik (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029980#comment-15029980
 ] 

Roman Bielik commented on CASSANDRA-9748:
-

Will do - early next week and will let you know the results. Thank you!

> Can't see other nodes when using multiple network interfaces
> 
>
> Key: CASSANDRA-9748
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9748
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Streaming and Messaging
> Environment: Cassandra 2.0.16; multi-DC configuration
>Reporter: Roman Bielik
>Assignee: Paulo Motta
>Priority: Minor
>  Labels: docs-impacting
> Fix For: 2.1.x, 2.2.x, 3.0.x
>
> Attachments: system_node1.log, system_node2.log
>
>
> The idea is to setup a multi-DC environment across 2 different networks based 
> on the following configuration recommendations:
> http://docs.datastax.com/en/cassandra/2.0/cassandra/configuration/configMultiNetworks.html
> Each node has 2 network interfaces. One used as a private network (DC1: 
> 10.0.1.x and DC2: 10.0.2.x). The second one a "public" network where all 
> nodes can see each other (this one has a higher latency). 
> Using the following settings in cassandra.yaml:
> *seeds:* public IP (same as used in broadcast_address)
> *listen_address:* private IP
> *broadcast_address:* public IP
> *rpc_address:* 0.0.0.0
> *endpoint_snitch:* GossipingPropertyFileSnitch
> _(tried different combinations with no luck)_
> No firewall and no SSL/encryption used.
> The problem is that nodes do not see each other (a gossip problem I guess). 
> The nodetool ring/status shows only the local node but not the other ones 
> (even from the same DC).
> When I set listen_address to public IP, then everything works fine, but that 
> is not the required configuration.
> _Note: Not using EC2 cloud!_
> netstat -anp | grep -E "(7199|9160|9042|7000)"
> tcp0  0 0.0.0.0:71990.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9160   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:9042   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 10.0.1.1:7000   0.0.0.0:*   
> LISTEN  3587/java   
> tcp0  0 127.0.0.1:7199  127.0.0.1:52874 
> ESTABLISHED 3587/java   
> tcp0  0 10.0.1.1:7199   10.0.1.1:39650  
> ESTABLISHED 3587/java 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CASSANDRA-10781) Connection Timed Out When PasswordAuthenticator Enabled on Cubieboard

2015-11-27 Thread Xiangyu Zhang (JIRA)
Xiangyu Zhang created CASSANDRA-10781:
-

 Summary: Connection Timed Out When PasswordAuthenticator Enabled 
on Cubieboard
 Key: CASSANDRA-10781
 URL: https://issues.apache.org/jira/browse/CASSANDRA-10781
 Project: Cassandra
  Issue Type: Bug
 Environment: Working Environment: Cubie-board A80, running Ubuntu 
Linaro 14.04 (which is download from 
http://dl.cubieboard.org/model/cc-a80/Image/ubuntu-linaro)
Cassandra version: Version 2.1.7 (from 
http://downloads.datastax.com/community/dsc-cassandra-2.1.7-bin.tar.gz)
Also tested with 2.2.3 version
Reporter: Xiangyu Zhang


Connect using default username and password ./cqlsh 192.168.10.26 -u cassandra 
-p cassandra), it will timed out:Connection error: ('Unable to connect to any 
servers', {'192.168.10.26': OperationTimedOut('errors=Timed out creating 
connection, last_host=None',)}). This happens when PasswordAuthenticator is 
enabled. When it is disabled, database can be connected. Might be some 
dependency issue that causing the authentication timed out, checked that 
openssl properly installed. Is there a possible way to track down why the 
authentication timed out?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-10658) Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS

2015-11-27 Thread Marcus Eriksson (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029684#comment-15029684
 ] 

Marcus Eriksson commented on CASSANDRA-10658:
-

ok, +1

> Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS
> ---
>
> Key: CASSANDRA-10658
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10658
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Robert Stupp
>Assignee: Robert Stupp
>Priority: Minor
> Fix For: 2.1.x, 2.2.x, 3.0.x
>
>
> 2.1, 2.2 and 3.0 incorrectly throws {{InvalidRequestException}} on 
> non-existing keyspace for {{DROP TYPE IF EXISTS}}
> 3.0 incorrectly throws {{ConfigurationException}} for {{DROP AGGREGATE IF 
> EXISTS}} with type arguments.
> 3.0 incorrectly throws {{ConfigurationException}} for {{DROP FUNCTION IF 
> EXISTS}} with type arguments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


cassandra git commit: Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS

2015-11-27 Thread snazy
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.1 b8a8004d8 -> 4ecbbc082


Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS

patch by Robert Stupp; reviewed by Marcus Eriksson for CASSANDRA-10658


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/4ecbbc08
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/4ecbbc08
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/4ecbbc08

Branch: refs/heads/cassandra-2.1
Commit: 4ecbbc08206fc5cd2e91520a5b99ef890f1da75d
Parents: b8a8004
Author: Robert Stupp 
Authored: Fri Nov 27 10:42:38 2015 +0100
Committer: Robert Stupp 
Committed: Fri Nov 27 10:42:38 2015 +0100

--
 CHANGES.txt |  1 +
 .../cql3/statements/DropTypeStatement.java  | 10 --
 .../cql3/validation/entities/TypeTest.java  | 10 ++
 .../cql3/validation/operations/DropTest.java| 37 
 4 files changed, 56 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/4ecbbc08/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 48f4e89..4adcf4f 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 2.1.12
+ * Some DROP ... IF EXISTS incorrectly result in exceptions on non-existing KS 
(CASSANDRA-10658)
  * DeletionTime.compareTo wrong in rare cases (CASSANDRA-10749)
  * Force encoding when computing statement ids (CASSANDRA-10755)
  * Properly reject counters as map keys (CASSANDRA-10760)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/4ecbbc08/src/java/org/apache/cassandra/cql3/statements/DropTypeStatement.java
--
diff --git 
a/src/java/org/apache/cassandra/cql3/statements/DropTypeStatement.java 
b/src/java/org/apache/cassandra/cql3/statements/DropTypeStatement.java
index 94edd01..bc6005d 100644
--- a/src/java/org/apache/cassandra/cql3/statements/DropTypeStatement.java
+++ b/src/java/org/apache/cassandra/cql3/statements/DropTypeStatement.java
@@ -54,7 +54,12 @@ public class DropTypeStatement extends 
SchemaAlteringStatement
 {
 KSMetaData ksm = Schema.instance.getKSMetaData(name.getKeyspace());
 if (ksm == null)
-throw new InvalidRequestException(String.format("Cannot drop type 
in unknown keyspace %s", name.getKeyspace()));
+{
+if (ifExists)
+return;
+else
+throw new InvalidRequestException(String.format("Cannot drop 
type in unknown keyspace %s", name.getKeyspace()));
+}
 
 UserType old = ksm.userTypes.getType(name.getUserTypeName());
 if (old == null)
@@ -140,7 +145,8 @@ public class DropTypeStatement extends 
SchemaAlteringStatement
 public boolean announceMigration(boolean isLocalOnly) throws 
InvalidRequestException, ConfigurationException
 {
 KSMetaData ksm = Schema.instance.getKSMetaData(name.getKeyspace());
-assert ksm != null;
+if (ksm == null)
+return false; // do not assert (otherwise IF EXISTS case fails)
 
 UserType toDrop = ksm.userTypes.getType(name.getUserTypeName());
 // Can be null with ifExists

http://git-wip-us.apache.org/repos/asf/cassandra/blob/4ecbbc08/test/unit/org/apache/cassandra/cql3/validation/entities/TypeTest.java
--
diff --git 
a/test/unit/org/apache/cassandra/cql3/validation/entities/TypeTest.java 
b/test/unit/org/apache/cassandra/cql3/validation/entities/TypeTest.java
index f27cca8..f23ce35 100644
--- a/test/unit/org/apache/cassandra/cql3/validation/entities/TypeTest.java
+++ b/test/unit/org/apache/cassandra/cql3/validation/entities/TypeTest.java
@@ -28,6 +28,16 @@ import static org.junit.Assert.fail;
 public class TypeTest extends CQLTester
 {
 @Test
+public void testNonExistingOnes() throws Throwable
+{
+assertInvalidMessage("No user type named", "DROP TYPE " + KEYSPACE + 
".type_does_not_exist");
+assertInvalidMessage("Cannot drop type in unknown keyspace", "DROP 
TYPE keyspace_does_not_exist.type_does_not_exist");
+
+execute("DROP TYPE IF EXISTS " + KEYSPACE + ".type_does_not_exist");
+execute("DROP TYPE IF EXISTS 
keyspace_does_not_exist.type_does_not_exist");
+}
+
+@Test
 public void testNowToUUIDCompatibility() throws Throwable
 {
 createTable("CREATE TABLE %s (a int, b uuid, PRIMARY KEY (a, b))");

http://git-wip-us.apache.org/repos/asf/cassandra/blob/4ecbbc08/test/unit/org/apache/cassandra/cql3/validation/operations/DropTest.java
--
diff 

  1   2   >