[jira] [Commented] (CASSANDRA-10448) "Unknown type 0" Stream failure on Repair
[
https://issues.apache.org/jira/browse/CASSANDRA-10448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054078#comment-15054078
]
Omri Iluz commented on CASSANDRA-10448:
---
Restart did not help, same errors.
I will rerun the repair with your patch to generate more logs.
> "Unknown type 0" Stream failure on Repair
> -
>
> Key: CASSANDRA-10448
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10448
> Project: Cassandra
> Issue Type: Bug
> Components: Streaming and Messaging
> Environment: Cassandra 2.2.2
> 5 Nodes in Google Compute Engine
> Java 1.8.0_60
>Reporter: Omri Iluz
>Assignee: Yuki Morishita
> Fix For: 2.2.x
>
> Attachments: apache-cassandra-2.2.4-SNAPSHOT.jar, casslogs.txt,
> receiversystem.log, sendersystem.log
>
>
> While running repair after upgrading to 2.2.2 I am getting many stream fail
> errors:
> {noformat}
> [2015-10-05 23:52:30,353] Repair session 4c181051-6bbb-11e5-acdb-d9a8bbd39330
> for range (59694553044959221,86389982480621619] failed with error [repair
> #4c181051-6bbb-11e5-acdb-d9a8bbd39330 on px/acti
> vities, (59694553044959221,86389982480621619]] Sync failed between
> /10.240.81.104 and /10.240.134.221 (progress: 4%)
> {noformat}
> Logs from both sides of the stream:
> Sides 1 -
> {noformat}
> INFO [STREAM-INIT-/10.240.81.104:52722] 2015-10-05 23:52:30,063
> StreamResultFuture.java:111 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550
> ID#0] Creating new streaming plan for Repair
> INFO [STREAM-INIT-/10.240.81.104:52722] 2015-10-05 23:52:30,063
> StreamResultFuture.java:118 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550,
> ID#0] Received streaming plan for Repair
> INFO [STREAM-INIT-/10.240.81.104:52723] 2015-10-05 23:52:30,063
> StreamResultFuture.java:118 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550,
> ID#0] Received streaming plan for Repair
> INFO [STREAM-IN-/10.240.81.104] 2015-10-05 23:52:30,098
> StreamResultFuture.java:168 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550
> ID#0] Prepare completed. Receiving 13 files(517391317 bytes), sending 10
> files(469491729 bytes)
> ERROR [STREAM-IN-/10.240.81.104] 2015-10-05 23:52:30,234
> StreamSession.java:524 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550]
> Streaming error occurred
> java.lang.IllegalArgumentException: Unknown type 0
> at
> org.apache.cassandra.streaming.messages.StreamMessage$Type.get(StreamMessage.java:96)
> ~[apache-cassandra-2.2.2.jar:2.2.2]
> at
> org.apache.cassandra.streaming.messages.StreamMessage.deserialize(StreamMessage.java:57)
> ~[apache-cassandra-2.2.2.jar:2.2.2]
> at
> org.apache.cassandra.streaming.ConnectionHandler$IncomingMessageHandler.run(ConnectionHandler.java:261)
> ~[apache-cassandra-2.2.2.jar:2.2.2]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
> INFO [STREAM-IN-/10.240.81.104] 2015-10-05 23:52:30,302
> StreamResultFuture.java:182 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550]
> Session with /10.240.81.104 is complete
> WARN [STREAM-IN-/10.240.81.104] 2015-10-05 23:52:30,302
> StreamResultFuture.java:209 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550]
> Stream failed
> {noformat}
> Side 2 -
> {noformat}
> INFO [AntiEntropyStage:1] 2015-10-05 23:52:30,060 StreamResultFuture.java:86
> - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550] Executing streaming plan for
> Repair
> INFO [StreamConnectionEstablisher:6] 2015-10-05 23:52:30,061
> StreamSession.java:232 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550]
> Starting streaming to /10.240.134.221
> INFO [StreamConnectionEstablisher:6] 2015-10-05 23:52:30,063
> StreamCoordinator.java:213 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550,
> ID#0] Beginning stream session with /10.240.134.221
> INFO [STREAM-IN-/10.240.134.221] 2015-10-05 23:52:30,098
> StreamResultFuture.java:168 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550
> ID#0] Prepare completed. Receiving 10 files(469491729 bytes), sending 13
> files(517391317 bytes)
> INFO [STREAM-IN-/10.240.134.221] 2015-10-05 23:52:30,349
> StreamResultFuture.java:182 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550]
> Session with /10.240.134.221 is complete
> ERROR [STREAM-OUT-/10.240.134.221] 2015-10-05 23:52:30,349
> StreamSession.java:524 - [Stream #239d8e60-6bbc-11e5-93ac-31bdef2dc550]
> Streaming error occurred
> org.apache.cassandra.io.FSReadError: java.io.IOException: Broken pipe
> at
> org.apache.cassandra.io.util.ChannelProxy.transferTo(ChannelProxy.java:144)
> ~[apache-cassandra-2.2.2.jar:2.2.2]
> at
> org.apache.cassandra.streaming.compress.CompressedStreamWriter$1.apply(CompressedStreamWriter.java:79)
> ~[apache-cassandra-2.2.2.jar:2.2.2]
> at
> org.apache.cassandra.streaming.compress.CompressedStreamWriter$1.apply(CompressedStreamWrit
[jira] [Commented] (CASSANDRA-10851) deb file conflict on sstablemetadata
[
https://issues.apache.org/jira/browse/CASSANDRA-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054006#comment-15054006
]
Michael Shuler commented on CASSANDRA-10851:
Test package build/install with the attached patch works out fine for me, now.
{noformat}
mshuler@hana:~/git$ sudo dpkg -i cassandra*.deb
Selecting previously unselected package cassandra.
(Reading database ... 156570 files and directories currently installed.)
Preparing to unpack cassandra_3.2~ms1_all.deb ...
Unpacking cassandra (3.2~ms1) ...
Selecting previously unselected package cassandra-tools.
Preparing to unpack cassandra-tools_3.2~ms1_all.deb ...
Unpacking cassandra-tools (3.2~ms1) ...
Setting up cassandra (3.2~ms1) ...
vm.max_map_count = 1048575
net.ipv4.tcp_keepalive_time = 300
update-rc.d: warning: start and stop actions are no longer supported; falling
back to defaults
Setting up cassandra-tools (3.2~ms1) ...
Processing triggers for systemd (215-17+deb8u2) ...
Processing triggers for python-support (1.0.15) ...
mshuler@hana:~/git$
{noformat}
> deb file conflict on sstablemetadata
>
>
> Key: CASSANDRA-10851
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10851
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
>Reporter: Michael Shuler
> Fix For: 3.2
>
> Attachments: 10851.txt
>
>
> CASSANDRA-9879 added {{sstablemetadata}} to the main cassandra.deb, and it's
> already in the cassandra-tools.deb, so installation fails.
> {noformat}
> Err:
> dpkg: error processing archive debs/cassandra-tools_3.2_all.deb (--install):
> trying to overwrite '/usr/bin/sstablemetadata', which is also in package
> cassandra 3.2
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10851) deb file conflict on sstablemetadata
[
https://issues.apache.org/jira/browse/CASSANDRA-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Shuler updated CASSANDRA-10851:
---
Attachment: 10851.txt
> deb file conflict on sstablemetadata
>
>
> Key: CASSANDRA-10851
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10851
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
>Reporter: Michael Shuler
> Fix For: 3.2
>
> Attachments: 10851.txt
>
>
> CASSANDRA-9879 added {{sstablemetadata}} to the main cassandra.deb, and it's
> already in the cassandra-tools.deb, so installation fails.
> {noformat}
> Err:
> dpkg: error processing archive debs/cassandra-tools_3.2_all.deb (--install):
> trying to overwrite '/usr/bin/sstablemetadata', which is also in package
> cassandra 3.2
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CASSANDRA-10851) deb file conflict on sstablemetadata
Michael Shuler created CASSANDRA-10851:
--
Summary: deb file conflict on sstablemetadata
Key: CASSANDRA-10851
URL: https://issues.apache.org/jira/browse/CASSANDRA-10851
Project: Cassandra
Issue Type: Bug
Components: Packaging
Reporter: Michael Shuler
Fix For: 3.2
CASSANDRA-9879 added {{sstablemetadata}} to the main cassandra.deb, and it's
already in the cassandra-tools.deb, so installation fails.
{noformat}
Err:
dpkg: error processing archive debs/cassandra-tools_3.2_all.deb (--install):
trying to overwrite '/usr/bin/sstablemetadata', which is also in package
cassandra 3.2
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10850) v4 spec has tons of grammatical mistakes
[ https://issues.apache.org/jira/browse/CASSANDRA-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053961#comment-15053961 ] Robert Stupp commented on CASSANDRA-10850: -- [~stamhankar999], not everybody in the C* community is a native english speaker. Mind correcting the mistakes in the doc and provide a patch for it? Contributions are always welcome! > v4 spec has tons of grammatical mistakes > > > Key: CASSANDRA-10850 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10850 > Project: Cassandra > Issue Type: Bug > Components: Documentation and Website >Reporter: Sandeep Tamhankar > > https://github.com/apache/cassandra/blob/cassandra-3.0/doc/native_protocol_v4.spec > I notice the following in the first section of the spec and then gave up: > "The list of allowed opcode is defined Section 2.3" => "The list of allowed > opcode*s* is defined in Section 2.3" > "the details of each corresponding message is described Section 4" => "the > details of each corresponding message are described in Section 4" since the > subject is details, not message. > "Requests are those frame sent by" => "Requests are those frame*s* sent by" > I think someone should go through the whole spec and fix all the mistakes > rather than me pointing out the ones I notice piece-meal. I found the grammar > errors to be rather distracting. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CASSANDRA-10850) v4 spec has tons of grammatical mistakes
Sandeep Tamhankar created CASSANDRA-10850: - Summary: v4 spec has tons of grammatical mistakes Key: CASSANDRA-10850 URL: https://issues.apache.org/jira/browse/CASSANDRA-10850 Project: Cassandra Issue Type: Bug Components: Documentation and Website Reporter: Sandeep Tamhankar https://github.com/apache/cassandra/blob/cassandra-3.0/doc/native_protocol_v4.spec I notice the following in the first section of the spec and then gave up: "The list of allowed opcode is defined Section 2.3" => "The list of allowed opcode*s* is defined in Section 2.3" "the details of each corresponding message is described Section 4" => "the details of each corresponding message are described in Section 4" since the subject is details, not message. "Requests are those frame sent by" => "Requests are those frame*s* sent by" I think someone should go through the whole spec and fix all the mistakes rather than me pointing out the ones I notice piece-meal. I found the grammar errors to be rather distracting. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-9258) Range movement causes CPU & performance impact
[
https://issues.apache.org/jira/browse/CASSANDRA-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dikang Gu updated CASSANDRA-9258:
-
Attachment: (was: 0001-pending-ranges-2.1.patch)
> Range movement causes CPU & performance impact
> --
>
> Key: CASSANDRA-9258
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9258
> Project: Cassandra
> Issue Type: Bug
> Environment: Cassandra 2.1.4
>Reporter: Rick Branson
>Assignee: Dikang Gu
> Fix For: 2.1.x
>
> Attachments: 0001-pending-ranges-map.patch
>
>
> Observing big CPU & latency regressions when doing range movements on
> clusters with many tens of thousands of vnodes. See CPU usage increase by
> ~80% when a single node is being replaced.
> Top methods are:
> 1) Ljava/math/BigInteger;.compareTo in
> Lorg/apache/cassandra/dht/ComparableObjectToken;.compareTo
> 2) Lcom/google/common/collect/AbstractMapBasedMultimap;.wrapCollection in
> Lcom/google/common/collect/AbstractMapBasedMultimap$AsMap$AsMapIterator;.next
> 3) Lorg/apache/cassandra/db/DecoratedKey;.compareTo in
> Lorg/apache/cassandra/dht/Range;.contains
> Here's a sample stack from a thread dump:
> {code}
> "Thrift:50673" daemon prio=10 tid=0x7f2f20164800 nid=0x3a04af runnable
> [0x7f2d878d]
>java.lang.Thread.State: RUNNABLE
> at org.apache.cassandra.dht.Range.isWrapAround(Range.java:260)
> at org.apache.cassandra.dht.Range.contains(Range.java:51)
> at org.apache.cassandra.dht.Range.contains(Range.java:110)
> at
> org.apache.cassandra.locator.TokenMetadata.pendingEndpointsFor(TokenMetadata.java:916)
> at
> org.apache.cassandra.service.StorageProxy.performWrite(StorageProxy.java:775)
> at
> org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:541)
> at
> org.apache.cassandra.service.StorageProxy.mutateWithTriggers(StorageProxy.java:616)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1101)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1083)
> at
> org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:976)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3996)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3980)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:205)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745){code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-9258) Range movement causes CPU & performance impact
[
https://issues.apache.org/jira/browse/CASSANDRA-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053903#comment-15053903
]
Dikang Gu commented on CASSANDRA-9258:
--
[~blambov], here is a patch implemented based two NavigableMaps.
> Range movement causes CPU & performance impact
> --
>
> Key: CASSANDRA-9258
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9258
> Project: Cassandra
> Issue Type: Bug
> Environment: Cassandra 2.1.4
>Reporter: Rick Branson
>Assignee: Dikang Gu
> Fix For: 2.1.x
>
> Attachments: 0001-pending-ranges-map.patch
>
>
> Observing big CPU & latency regressions when doing range movements on
> clusters with many tens of thousands of vnodes. See CPU usage increase by
> ~80% when a single node is being replaced.
> Top methods are:
> 1) Ljava/math/BigInteger;.compareTo in
> Lorg/apache/cassandra/dht/ComparableObjectToken;.compareTo
> 2) Lcom/google/common/collect/AbstractMapBasedMultimap;.wrapCollection in
> Lcom/google/common/collect/AbstractMapBasedMultimap$AsMap$AsMapIterator;.next
> 3) Lorg/apache/cassandra/db/DecoratedKey;.compareTo in
> Lorg/apache/cassandra/dht/Range;.contains
> Here's a sample stack from a thread dump:
> {code}
> "Thrift:50673" daemon prio=10 tid=0x7f2f20164800 nid=0x3a04af runnable
> [0x7f2d878d]
>java.lang.Thread.State: RUNNABLE
> at org.apache.cassandra.dht.Range.isWrapAround(Range.java:260)
> at org.apache.cassandra.dht.Range.contains(Range.java:51)
> at org.apache.cassandra.dht.Range.contains(Range.java:110)
> at
> org.apache.cassandra.locator.TokenMetadata.pendingEndpointsFor(TokenMetadata.java:916)
> at
> org.apache.cassandra.service.StorageProxy.performWrite(StorageProxy.java:775)
> at
> org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:541)
> at
> org.apache.cassandra.service.StorageProxy.mutateWithTriggers(StorageProxy.java:616)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1101)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1083)
> at
> org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:976)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3996)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3980)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:205)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745){code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-9258) Range movement causes CPU & performance impact
[
https://issues.apache.org/jira/browse/CASSANDRA-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dikang Gu updated CASSANDRA-9258:
-
Attachment: (was: 0001-pending-ranges.patch)
> Range movement causes CPU & performance impact
> --
>
> Key: CASSANDRA-9258
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9258
> Project: Cassandra
> Issue Type: Bug
> Environment: Cassandra 2.1.4
>Reporter: Rick Branson
>Assignee: Dikang Gu
> Fix For: 2.1.x
>
> Attachments: 0001-pending-ranges-map.patch
>
>
> Observing big CPU & latency regressions when doing range movements on
> clusters with many tens of thousands of vnodes. See CPU usage increase by
> ~80% when a single node is being replaced.
> Top methods are:
> 1) Ljava/math/BigInteger;.compareTo in
> Lorg/apache/cassandra/dht/ComparableObjectToken;.compareTo
> 2) Lcom/google/common/collect/AbstractMapBasedMultimap;.wrapCollection in
> Lcom/google/common/collect/AbstractMapBasedMultimap$AsMap$AsMapIterator;.next
> 3) Lorg/apache/cassandra/db/DecoratedKey;.compareTo in
> Lorg/apache/cassandra/dht/Range;.contains
> Here's a sample stack from a thread dump:
> {code}
> "Thrift:50673" daemon prio=10 tid=0x7f2f20164800 nid=0x3a04af runnable
> [0x7f2d878d]
>java.lang.Thread.State: RUNNABLE
> at org.apache.cassandra.dht.Range.isWrapAround(Range.java:260)
> at org.apache.cassandra.dht.Range.contains(Range.java:51)
> at org.apache.cassandra.dht.Range.contains(Range.java:110)
> at
> org.apache.cassandra.locator.TokenMetadata.pendingEndpointsFor(TokenMetadata.java:916)
> at
> org.apache.cassandra.service.StorageProxy.performWrite(StorageProxy.java:775)
> at
> org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:541)
> at
> org.apache.cassandra.service.StorageProxy.mutateWithTriggers(StorageProxy.java:616)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1101)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1083)
> at
> org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:976)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3996)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3980)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:205)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745){code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-9258) Range movement causes CPU & performance impact
[
https://issues.apache.org/jira/browse/CASSANDRA-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dikang Gu updated CASSANDRA-9258:
-
Attachment: 0001-pending-ranges-map.patch
> Range movement causes CPU & performance impact
> --
>
> Key: CASSANDRA-9258
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9258
> Project: Cassandra
> Issue Type: Bug
> Environment: Cassandra 2.1.4
>Reporter: Rick Branson
>Assignee: Dikang Gu
> Fix For: 2.1.x
>
> Attachments: 0001-pending-ranges-map.patch
>
>
> Observing big CPU & latency regressions when doing range movements on
> clusters with many tens of thousands of vnodes. See CPU usage increase by
> ~80% when a single node is being replaced.
> Top methods are:
> 1) Ljava/math/BigInteger;.compareTo in
> Lorg/apache/cassandra/dht/ComparableObjectToken;.compareTo
> 2) Lcom/google/common/collect/AbstractMapBasedMultimap;.wrapCollection in
> Lcom/google/common/collect/AbstractMapBasedMultimap$AsMap$AsMapIterator;.next
> 3) Lorg/apache/cassandra/db/DecoratedKey;.compareTo in
> Lorg/apache/cassandra/dht/Range;.contains
> Here's a sample stack from a thread dump:
> {code}
> "Thrift:50673" daemon prio=10 tid=0x7f2f20164800 nid=0x3a04af runnable
> [0x7f2d878d]
>java.lang.Thread.State: RUNNABLE
> at org.apache.cassandra.dht.Range.isWrapAround(Range.java:260)
> at org.apache.cassandra.dht.Range.contains(Range.java:51)
> at org.apache.cassandra.dht.Range.contains(Range.java:110)
> at
> org.apache.cassandra.locator.TokenMetadata.pendingEndpointsFor(TokenMetadata.java:916)
> at
> org.apache.cassandra.service.StorageProxy.performWrite(StorageProxy.java:775)
> at
> org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:541)
> at
> org.apache.cassandra.service.StorageProxy.mutateWithTriggers(StorageProxy.java:616)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1101)
> at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:1083)
> at
> org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:976)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3996)
> at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.getResult(Cassandra.java:3980)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:205)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745){code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CASSANDRA-10849) Decide how to handle with null multi-cell collections
Robert Stupp created CASSANDRA-10849:
Summary: Decide how to handle with null multi-cell collections
Key: CASSANDRA-10849
URL: https://issues.apache.org/jira/browse/CASSANDRA-10849
Project: Cassandra
Issue Type: Improvement
Reporter: Robert Stupp
Priority: Minor
CASSANDRA-10650 introduced the ability to generate the CQL literal from a
serialized representation - currently only used to store a UDA's INITCOND.
The code to generate the CQL literal for a {{null}} collection deals with that
in the following way:
* null frozen collections --> CQL literal {{null}}
* empty frozen collections --> CQL literal {{[]}} (or {{\{\}}} for maps)
* null multi-cell collections --> CQL literal {{[]}} (or {{\{\}}} for maps) ;
there's no way to distinguish null from empty
* empty multi-cell collections --> CQL literal {{[]}} (or {{\{\}}} for maps) ;
there's no way to distinguish null from empty
CASSANDRA-10840 exposed that the handling is not optimal and the patch deals
with this by using a "frozen" state type to generate the CQL literal.
It's currently not a critical thing yet - just want to know whether it's ok how
CASSANDRA-10840 handles this or {{CQL3Type.toCQLLiteral}} should be changed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10840) Replacing an aggregate with a new version doesn't reset INITCOND
[
https://issues.apache.org/jira/browse/CASSANDRA-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053889#comment-15053889
]
Robert Stupp commented on CASSANDRA-10840:
--
The issue is not just INITCOND but also to FINALFUNC - fixed both.
Both 2.2 and 3.0 are affected - although in slightly different ways.
* 2.2 did never reset anything to "null" (omitting INITCOND or FINALFUNC in a
CREATE OR REPLACE AGGREGATE).
* 3.0 would have reset INITCOND to null - but not for collections (crux with
frozen/non-frozen and empty/null collections), which is why you hit this issue
- filed another ticket to check how we deal with that in general
Added new utests for both 2.2 and 3.0.
Branch for 2.2:
https://github.com/snazy/cassandra/tree/10840-aggr-initcond-null-2.2
Branch for 3.0:
https://github.com/snazy/cassandra/tree/10840-aggr-initcond-null-3.0
CassCI: http://cassci.datastax.com/view/trunk/search/?q=snazy-10840-
> Replacing an aggregate with a new version doesn't reset INITCOND
>
>
> Key: CASSANDRA-10840
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10840
> Project: Cassandra
> Issue Type: Bug
> Components: CQL
> Environment: Observed in Cassandra 2.2.4, though it might be an issue
> in 3.0 as well
>Reporter: Sandeep Tamhankar
>Assignee: Robert Stupp
> Fix For: 2.2.x, 3.0.x, 3.x
>
>
> {code}
> use simplex;
> CREATE FUNCTION state_group_and_sum(state map, star_rating
> int)
> CALLED ON NULL INPUT
> RETURNS map
> LANGUAGE java
> AS 'if (state.get(star_rating) == null)
> state.put(star_rating, 1); else state.put(star_rating, ((Integer)
> state.get(star_rating)) + 1); return state;';
> CREATE FUNCTION percent_stars(state map)
> RETURNS NULL ON NULL INPUT
> RETURNS map
> LANGUAGE java AS $$
> Integer sum = 0;
> for(Object k : state.keySet()) {
> sum = sum + (Integer) state.get((Integer) k);
> }
> java.util.Map results = new java.util.HashMap Integer>();
> for(Object k : state.keySet()) {
> results.put((Integer) k, ((Integer) state.get((Integer) k))*100 / sum);
> }
> return results;
> $$;
> {code}
> {code}
> CREATE OR REPLACE AGGREGATE group_and_sum(int)
> SFUNC state_group_and_sum
> STYPE map
> FINALFUNC percent_stars
> INITCOND {}
> {code}
> 1. View the aggregates
> {{select * from system.schema_aggregates;}}
> 2. Now update
> {code}
> CREATE OR REPLACE AGGREGATE group_and_sum(int)
> SFUNC state_group_and_sum
> STYPE map
> FINALFUNC percent_stars
> INITCOND NULL
> {code}
> 3. View the aggregates
> {{select * from system.schema_aggregates;}}
> Expected result:
> * The update should have made initcond null
> Actual result:
> * The update did not touch INITCOND.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10839) cqlsh failed to format value bytearray
[
https://issues.apache.org/jira/browse/CASSANDRA-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053874#comment-15053874
]
Robert McLaughlin commented on CASSANDRA-10839:
---
can not reproduce on cqlsh 5.0.1, cassandra 3.2 (trunk)
> cqlsh failed to format value bytearray
> --
>
> Key: CASSANDRA-10839
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10839
> Project: Cassandra
> Issue Type: Bug
>Reporter: Severin Leonhardt
>Priority: Minor
>
> Execute the following in cqlsh (5.0.1):
> {noformat}
> > create table test(column blob, primary key(column));
> > insert into test (column) VALUES(0x00);
> > select * from test;
> column
>
> bytearray(b'\x00')
> (1 rows)
> Failed to format value bytearray(b'\x00') : b2a_hex() argument 1 must be
> string or read-only buffer, not bytearray
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10840) Replacing an aggregate with a new version doesn't reset INITCOND
[
https://issues.apache.org/jira/browse/CASSANDRA-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053750#comment-15053750
]
Robert Stupp commented on CASSANDRA-10840:
--
We've changed the serialization of INITCONDs in 3.0 - they're stored as CQL
literals in 3.0 but in serialized form in 2.2.
> Replacing an aggregate with a new version doesn't reset INITCOND
>
>
> Key: CASSANDRA-10840
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10840
> Project: Cassandra
> Issue Type: Bug
> Components: CQL
> Environment: Observed in Cassandra 2.2.4, though it might be an issue
> in 3.0 as well
>Reporter: Sandeep Tamhankar
>Assignee: Robert Stupp
> Fix For: 2.2.x, 3.0.x, 3.x
>
>
> {code}
> use simplex;
> CREATE FUNCTION state_group_and_sum(state map, star_rating
> int)
> CALLED ON NULL INPUT
> RETURNS map
> LANGUAGE java
> AS 'if (state.get(star_rating) == null)
> state.put(star_rating, 1); else state.put(star_rating, ((Integer)
> state.get(star_rating)) + 1); return state;';
> CREATE FUNCTION percent_stars(state map)
> RETURNS NULL ON NULL INPUT
> RETURNS map
> LANGUAGE java AS $$
> Integer sum = 0;
> for(Object k : state.keySet()) {
> sum = sum + (Integer) state.get((Integer) k);
> }
> java.util.Map results = new java.util.HashMap Integer>();
> for(Object k : state.keySet()) {
> results.put((Integer) k, ((Integer) state.get((Integer) k))*100 / sum);
> }
> return results;
> $$;
> {code}
> {code}
> CREATE OR REPLACE AGGREGATE group_and_sum(int)
> SFUNC state_group_and_sum
> STYPE map
> FINALFUNC percent_stars
> INITCOND {}
> {code}
> 1. View the aggregates
> {{select * from system.schema_aggregates;}}
> 2. Now update
> {code}
> CREATE OR REPLACE AGGREGATE group_and_sum(int)
> SFUNC state_group_and_sum
> STYPE map
> FINALFUNC percent_stars
> INITCOND NULL
> {code}
> 3. View the aggregates
> {{select * from system.schema_aggregates;}}
> Expected result:
> * The update should have made initcond null
> Actual result:
> * The update did not touch INITCOND.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10541) cqlshlib tests cannot run on Windows
[
https://issues.apache.org/jira/browse/CASSANDRA-10541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053744#comment-15053744
]
Paulo Motta commented on CASSANDRA-10541:
-
bq. I've looked at the cqlshlib tests and I'd be comfortable having these
changes merged and dealing with environmental issues in a separate ticket.
That would be better I think. I rebased and fixed a conflict with
CASSANDRA-10799 and tests look good. Can we mark as ready to commit then?
We also need to address CASSANDRA-10720 separately, since completion tests are
being currently skipped on Windows.
> cqlshlib tests cannot run on Windows
>
>
> Key: CASSANDRA-10541
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10541
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
>Reporter: Benjamin Lerer
>Assignee: Paulo Motta
>Priority: Minor
> Labels: cqlsh, windows
> Fix For: 2.2.x, 3.0.x, 3.x
>
>
> If I try to run the {{cqlshlib}} tests on Windows, I got the following error:
> {quote}
> ==
> ERROR: Failure: AttributeError ('module' object has no attribute 'symlink')
> --
> Traceback (most recent call last):
> File "C:\Python27\lib\site-packages\nose\loader.py", line 414, in
> loadTestsFromName
> addr.filename, addr.module)
> File "C:\Python27\lib\site-packages\nose\importer.py", line 47, in
> importFromPath
> return self.importFromDir(dir_path, fqname)
> File "C:\Python27\lib\site-packages\nose\importer.py", line 94, in
> importFromDir
> mod = load_module(part_fqname, fh, filename, desc)
> File "[...]\pylib\cqlshlib\test\__init__.py", line 17, in
> from .cassconnect import create_test_db, remove_test_db
> File "[...]\pylib\cqlshlib\test\cassconnect.py", line 22, in
> from .basecase import cql, cqlsh, cqlshlog, TEST_HOST, TEST_PORT, rundir
> File "[...]\pylib\cqlshlib\test\basecase.py", line 43, in
> os.symlink(path_to_cqlsh, modulepath)
> AttributeError: 'module' object has no attribute 'symlink'
> --
> Ran 1 test in 0.002s
> FAILED (errors=1)
> {quote}
> The problem comes from the fact tha Windows has no support for symlinks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[2/2] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2
Merge branch 'cassandra-2.1' into cassandra-2.2
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/6ff7c9ce
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/6ff7c9ce
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/6ff7c9ce
Branch: refs/heads/cassandra-2.2
Commit: 6ff7c9ce98eb937c6e2347df9af1d36364eeb184
Parents: 94c361d dff2214
Author: Robert Stupp
Authored: Fri Dec 11 16:51:04 2015 -0600
Committer: Robert Stupp
Committed: Fri Dec 11 16:51:04 2015 -0600
--
CHANGES.txt| 1 +
src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++
2 files changed, 3 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ff7c9ce/CHANGES.txt
--
diff --cc CHANGES.txt
index 035e471,96f2f4f..d44a47b
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,33 -1,11 +1,34 @@@
-2.1.13
+2.2.5
+ * Add property to allow listening on broadcast interface (CASSANDRA-9748)
+ * Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
+ * Better handling of SSL connection errors inter-node (CASSANDRA-10816)
+ * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
+ * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761)
+Merged from 2.1:
+ * Cassandra Daemon should print JVM arguments (CASSANDRA-10764)
* Allow cancellation of index summary redistribution (CASSANDRA-8805)
- * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
-
-2.1.12
+2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
+ * Reject index queries while the index is building (CASSANDRA-8505)
+ * CQL.textile syntax incorrectly includes optional keyspace for aggregate
SFUNC and FINALFUNC (CASSANDRA-10747)
+ * Fix JSON update with prepared statements (CASSANDRA-10631)
+ * Don't do anticompaction after subrange repair (CASSANDRA-10422)
+ * Fix SimpleDateType type compatibility (CASSANDRA-10027)
+ * (Hadoop) fix splits calculation (CASSANDRA-10640)
+ * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
+ * (cqlsh) show partial trace if incomplete after max_trace_wait
(CASSANDRA-7645)
+ * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
+ * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
+ * Expose phi values from failure detector via JMX and tweak debug
+ and trace logging (CASSANDRA-9526)
+ * Fix RangeNamesQueryPager (CASSANDRA-10509)
+ * Deprecate Pig support (CASSANDRA-10542)
+ * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
+ * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large
buffers (CASSANDRA-10592)
+Merged from 2.1:
* Fix incremental repair hang when replica is down (CASSANDRA-10288)
* Avoid writing range tombstones after END_OF_ROW marker (CASSANDRA-10791)
* Optimize the way we check if a token is repaired in anticompaction
(CASSANDRA-10768)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ff7c9ce/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --cc src/java/org/apache/cassandra/service/CassandraDaemon.java
index eb05324,a27fa20..6f38545
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@@ -377,29 -467,6 +377,31 @@@ public class CassandraDaemo
return setupCompleted;
}
+private void logSystemInfo()
+{
+ if (logger.isInfoEnabled())
+ {
+ try
+ {
+ logger.info("Hostname: {}",
InetAddress.getLocalHost().getHostName());
+ }
+ catch (UnknownHostException e1)
+ {
+ logger.info("Could not resolve local host");
+ }
+
+ logger.info("JVM vendor/version: {}/{}",
System.getProperty("java.vm.name"), System.getProperty("java.version"));
+ logger.info("Heap size: {}/{}",
Runtime.getRuntime().totalMemory(), Runtime.getRuntime().maxMemory());
+
+ for(MemoryPoolMXBean pool:
ManagementFactory.getMemoryPoolMXBeans())
+ logger.info("{} {}: {}", pool.getName(), pool.getType(),
pool.getPeakUsage());
+
+ logger.info("Classpath: {}",
System.getProperty("java.class.path"));
++
++logger.info("JVM Arguments: {}",
ManagementFactory.getRuntimeMXBean().getInputArguments());
+ }
+}
+
/**
* Initialize the Cassandra Daemon based
cassandra git commit: Cassandra Daemon should print JVM arguments
Repository: cassandra
Updated Branches:
refs/heads/cassandra-2.1 fc7075a41 -> dff221459
Cassandra Daemon should print JVM arguments
patch by Robert Stupp; reviewed by Michael Shuler for CASSANDRA-10764
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/dff22145
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/dff22145
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/dff22145
Branch: refs/heads/cassandra-2.1
Commit: dff2214595c5e2b0b8f3781186df55bd90c6728c
Parents: fc7075a
Author: Robert Stupp
Authored: Fri Dec 11 16:50:34 2015 -0600
Committer: Robert Stupp
Committed: Fri Dec 11 16:50:34 2015 -0600
--
CHANGES.txt| 1 +
src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++
2 files changed, 3 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2ee8b07..96f2f4f 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Cassandra Daemon should print JVM arguments (CASSANDRA-10764)
* Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 17553f3..a27fa20 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -202,6 +202,8 @@ public class CassandraDaemon
logger.info("{} {}: {}", pool.getName(), pool.getType(),
pool.getPeakUsage());
logger.info("Classpath: {}", System.getProperty("java.class.path"));
+logger.info("JVM Arguments: {}",
ManagementFactory.getRuntimeMXBean().getInputArguments());
+
// Fail-fast if JNA is not available or failing to initialize properly
// except with -Dcassandra.boot_without_jna=true. See CASSANDRA-6575.
if (!CLibrary.jnaAvailable())
[4/4] cassandra git commit: Merge branch 'cassandra-3.0' into trunk
Merge branch 'cassandra-3.0' into trunk Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f7666d5f Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f7666d5f Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f7666d5f Branch: refs/heads/trunk Commit: f7666d5f21807e783ab802a1a78262518d96cc0e Parents: 4139d8f c0d47be Author: Robert Stupp Authored: Fri Dec 11 16:51:23 2015 -0600 Committer: Robert Stupp Committed: Fri Dec 11 16:51:23 2015 -0600 -- CHANGES.txt| 1 + src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++ 2 files changed, 3 insertions(+) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/f7666d5f/CHANGES.txt -- diff --cc CHANGES.txt index f06648e,e20f5ed..905f7a3 --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -1,27 -1,15 +1,28 @@@ -3.0.2 -Merged from 2.2 +3.2 + * Add compressor name in sstablemetadata output (CASSANDRA-9879) + * Fix type casting for counter columns (CASSANDRA-10824) + * Prevent running Cassandra as root (CASSANDRA-8142) + * bound maximum in-flight commit log replay mutation bytes to 64 megabytes (CASSANDRA-8639) + * Normalize all scripts (CASSANDRA-10679) + * Make compression ratio much more accurate (CASSANDRA-10225) + * Optimize building of Clustering object when only one is created (CASSANDRA-10409) + * Make index building pluggable (CASSANDRA-10681) + * Add sstable flush observer (CASSANDRA-10678) + * Improve NTS endpoints calculation (CASSANDRA-10200) + * Improve performance of the folderSize function (CASSANDRA-10677) + * Add support for type casting in selection clause (CASSANDRA-10310) + * Added graphing option to cassandra-stress (CASSANDRA-7918) + * Abort in-progress queries that time out (CASSANDRA-7392) + * Add transparent data encryption core classes (CASSANDRA-9945) +Merged from 2.2: * Add property to allow listening on broadcast interface (CASSANDRA-9748) - * Fix regression in split size on CqlInputFormat (CASSANDRA-10835) - * Better handling of SSL connection errors inter-node (CASSANDRA-10816) - * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) - * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) Merged from 2.1: + * Cassandra Daemon should print JVM arguments (CASSANDRA-10764) * Allow cancellation of index summary redistribution (CASSANDRA-8805) -3.0.1 + +3.1 +Merged from 3.0: * Avoid MV race during node decommission (CASSANDRA-10674) * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) * Handle single-column deletions correction in materialized views http://git-wip-us.apache.org/repos/asf/cassandra/blob/f7666d5f/src/java/org/apache/cassandra/service/CassandraDaemon.java --
[2/3] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2
Merge branch 'cassandra-2.1' into cassandra-2.2
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/6ff7c9ce
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/6ff7c9ce
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/6ff7c9ce
Branch: refs/heads/cassandra-3.0
Commit: 6ff7c9ce98eb937c6e2347df9af1d36364eeb184
Parents: 94c361d dff2214
Author: Robert Stupp
Authored: Fri Dec 11 16:51:04 2015 -0600
Committer: Robert Stupp
Committed: Fri Dec 11 16:51:04 2015 -0600
--
CHANGES.txt| 1 +
src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++
2 files changed, 3 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ff7c9ce/CHANGES.txt
--
diff --cc CHANGES.txt
index 035e471,96f2f4f..d44a47b
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,33 -1,11 +1,34 @@@
-2.1.13
+2.2.5
+ * Add property to allow listening on broadcast interface (CASSANDRA-9748)
+ * Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
+ * Better handling of SSL connection errors inter-node (CASSANDRA-10816)
+ * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
+ * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761)
+Merged from 2.1:
+ * Cassandra Daemon should print JVM arguments (CASSANDRA-10764)
* Allow cancellation of index summary redistribution (CASSANDRA-8805)
- * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
-
-2.1.12
+2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
+ * Reject index queries while the index is building (CASSANDRA-8505)
+ * CQL.textile syntax incorrectly includes optional keyspace for aggregate
SFUNC and FINALFUNC (CASSANDRA-10747)
+ * Fix JSON update with prepared statements (CASSANDRA-10631)
+ * Don't do anticompaction after subrange repair (CASSANDRA-10422)
+ * Fix SimpleDateType type compatibility (CASSANDRA-10027)
+ * (Hadoop) fix splits calculation (CASSANDRA-10640)
+ * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
+ * (cqlsh) show partial trace if incomplete after max_trace_wait
(CASSANDRA-7645)
+ * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
+ * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
+ * Expose phi values from failure detector via JMX and tweak debug
+ and trace logging (CASSANDRA-9526)
+ * Fix RangeNamesQueryPager (CASSANDRA-10509)
+ * Deprecate Pig support (CASSANDRA-10542)
+ * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
+ * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large
buffers (CASSANDRA-10592)
+Merged from 2.1:
* Fix incremental repair hang when replica is down (CASSANDRA-10288)
* Avoid writing range tombstones after END_OF_ROW marker (CASSANDRA-10791)
* Optimize the way we check if a token is repaired in anticompaction
(CASSANDRA-10768)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ff7c9ce/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --cc src/java/org/apache/cassandra/service/CassandraDaemon.java
index eb05324,a27fa20..6f38545
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@@ -377,29 -467,6 +377,31 @@@ public class CassandraDaemo
return setupCompleted;
}
+private void logSystemInfo()
+{
+ if (logger.isInfoEnabled())
+ {
+ try
+ {
+ logger.info("Hostname: {}",
InetAddress.getLocalHost().getHostName());
+ }
+ catch (UnknownHostException e1)
+ {
+ logger.info("Could not resolve local host");
+ }
+
+ logger.info("JVM vendor/version: {}/{}",
System.getProperty("java.vm.name"), System.getProperty("java.version"));
+ logger.info("Heap size: {}/{}",
Runtime.getRuntime().totalMemory(), Runtime.getRuntime().maxMemory());
+
+ for(MemoryPoolMXBean pool:
ManagementFactory.getMemoryPoolMXBeans())
+ logger.info("{} {}: {}", pool.getName(), pool.getType(),
pool.getPeakUsage());
+
+ logger.info("Classpath: {}",
System.getProperty("java.class.path"));
++
++logger.info("JVM Arguments: {}",
ManagementFactory.getRuntimeMXBean().getInputArguments());
+ }
+}
+
/**
* Initialize the Cassandra Daemon based
[1/4] cassandra git commit: Cassandra Daemon should print JVM arguments
Repository: cassandra
Updated Branches:
refs/heads/trunk 4139d8f3f -> f7666d5f2
Cassandra Daemon should print JVM arguments
patch by Robert Stupp; reviewed by Michael Shuler for CASSANDRA-10764
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/dff22145
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/dff22145
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/dff22145
Branch: refs/heads/trunk
Commit: dff2214595c5e2b0b8f3781186df55bd90c6728c
Parents: fc7075a
Author: Robert Stupp
Authored: Fri Dec 11 16:50:34 2015 -0600
Committer: Robert Stupp
Committed: Fri Dec 11 16:50:34 2015 -0600
--
CHANGES.txt| 1 +
src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++
2 files changed, 3 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2ee8b07..96f2f4f 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Cassandra Daemon should print JVM arguments (CASSANDRA-10764)
* Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 17553f3..a27fa20 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -202,6 +202,8 @@ public class CassandraDaemon
logger.info("{} {}: {}", pool.getName(), pool.getType(),
pool.getPeakUsage());
logger.info("Classpath: {}", System.getProperty("java.class.path"));
+logger.info("JVM Arguments: {}",
ManagementFactory.getRuntimeMXBean().getInputArguments());
+
// Fail-fast if JNA is not available or failing to initialize properly
// except with -Dcassandra.boot_without_jna=true. See CASSANDRA-6575.
if (!CLibrary.jnaAvailable())
[jira] [Commented] (CASSANDRA-9813) cqlsh column header can be incorrect when no rows are returned
[
https://issues.apache.org/jira/browse/CASSANDRA-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053736#comment-15053736
]
Adam Holmberg commented on CASSANDRA-9813:
--
[2.2|https://github.com/aholmberg/cassandra/tree/9813-2.2]
[3.x|https://github.com/aholmberg/cassandra/tree/9813-3.x]
I've run cqlshlib tests locally showing no regressions. I'm not setup/don't
know how to run things in cassci. Can someone kick these off or point me to
instructions?
> cqlsh column header can be incorrect when no rows are returned
> --
>
> Key: CASSANDRA-9813
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9813
> Project: Cassandra
> Issue Type: Bug
>Reporter: Aleksey Yeschenko
>Assignee: Adam Holmberg
> Labels: cqlsh
> Fix For: 2.1.x, 2.2.x, 3.x
>
> Attachments: 9813-2.1.txt, Test-for-9813.txt
>
>
> Upon migration, we internally create a pair of surrogate clustering/regular
> columns for compact static tables. These shouldn't be exposed to the user.
> That is, for the table
> {code}
> CREATE TABLE bar (k int, c int, PRIMARY KEY (k)) WITH COMPACT STORAGE;
> {code}
> {{SELECT * FROM bar}} should not be returning this result set:
> {code}
> cqlsh:test> select * from bar;
> c | column1 | k | value
> ---+-+---+---
> (0 rows)
> {code}
> Should only contain the defined {{c}} and {{k}} columns.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[1/3] cassandra git commit: Cassandra Daemon should print JVM arguments
Repository: cassandra
Updated Branches:
refs/heads/cassandra-3.0 d55a51e95 -> c0d47bed9
Cassandra Daemon should print JVM arguments
patch by Robert Stupp; reviewed by Michael Shuler for CASSANDRA-10764
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/dff22145
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/dff22145
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/dff22145
Branch: refs/heads/cassandra-3.0
Commit: dff2214595c5e2b0b8f3781186df55bd90c6728c
Parents: fc7075a
Author: Robert Stupp
Authored: Fri Dec 11 16:50:34 2015 -0600
Committer: Robert Stupp
Committed: Fri Dec 11 16:50:34 2015 -0600
--
CHANGES.txt| 1 +
src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++
2 files changed, 3 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2ee8b07..96f2f4f 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Cassandra Daemon should print JVM arguments (CASSANDRA-10764)
* Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 17553f3..a27fa20 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -202,6 +202,8 @@ public class CassandraDaemon
logger.info("{} {}: {}", pool.getName(), pool.getType(),
pool.getPeakUsage());
logger.info("Classpath: {}", System.getProperty("java.class.path"));
+logger.info("JVM Arguments: {}",
ManagementFactory.getRuntimeMXBean().getInputArguments());
+
// Fail-fast if JNA is not available or failing to initialize properly
// except with -Dcassandra.boot_without_jna=true. See CASSANDRA-6575.
if (!CLibrary.jnaAvailable())
[2/4] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2
Merge branch 'cassandra-2.1' into cassandra-2.2
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/6ff7c9ce
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/6ff7c9ce
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/6ff7c9ce
Branch: refs/heads/trunk
Commit: 6ff7c9ce98eb937c6e2347df9af1d36364eeb184
Parents: 94c361d dff2214
Author: Robert Stupp
Authored: Fri Dec 11 16:51:04 2015 -0600
Committer: Robert Stupp
Committed: Fri Dec 11 16:51:04 2015 -0600
--
CHANGES.txt| 1 +
src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++
2 files changed, 3 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ff7c9ce/CHANGES.txt
--
diff --cc CHANGES.txt
index 035e471,96f2f4f..d44a47b
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,33 -1,11 +1,34 @@@
-2.1.13
+2.2.5
+ * Add property to allow listening on broadcast interface (CASSANDRA-9748)
+ * Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
+ * Better handling of SSL connection errors inter-node (CASSANDRA-10816)
+ * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
+ * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761)
+Merged from 2.1:
+ * Cassandra Daemon should print JVM arguments (CASSANDRA-10764)
* Allow cancellation of index summary redistribution (CASSANDRA-8805)
- * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
-
-2.1.12
+2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
+ * Reject index queries while the index is building (CASSANDRA-8505)
+ * CQL.textile syntax incorrectly includes optional keyspace for aggregate
SFUNC and FINALFUNC (CASSANDRA-10747)
+ * Fix JSON update with prepared statements (CASSANDRA-10631)
+ * Don't do anticompaction after subrange repair (CASSANDRA-10422)
+ * Fix SimpleDateType type compatibility (CASSANDRA-10027)
+ * (Hadoop) fix splits calculation (CASSANDRA-10640)
+ * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
+ * (cqlsh) show partial trace if incomplete after max_trace_wait
(CASSANDRA-7645)
+ * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
+ * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
+ * Expose phi values from failure detector via JMX and tweak debug
+ and trace logging (CASSANDRA-9526)
+ * Fix RangeNamesQueryPager (CASSANDRA-10509)
+ * Deprecate Pig support (CASSANDRA-10542)
+ * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
+ * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large
buffers (CASSANDRA-10592)
+Merged from 2.1:
* Fix incremental repair hang when replica is down (CASSANDRA-10288)
* Avoid writing range tombstones after END_OF_ROW marker (CASSANDRA-10791)
* Optimize the way we check if a token is repaired in anticompaction
(CASSANDRA-10768)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/6ff7c9ce/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --cc src/java/org/apache/cassandra/service/CassandraDaemon.java
index eb05324,a27fa20..6f38545
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@@ -377,29 -467,6 +377,31 @@@ public class CassandraDaemo
return setupCompleted;
}
+private void logSystemInfo()
+{
+ if (logger.isInfoEnabled())
+ {
+ try
+ {
+ logger.info("Hostname: {}",
InetAddress.getLocalHost().getHostName());
+ }
+ catch (UnknownHostException e1)
+ {
+ logger.info("Could not resolve local host");
+ }
+
+ logger.info("JVM vendor/version: {}/{}",
System.getProperty("java.vm.name"), System.getProperty("java.version"));
+ logger.info("Heap size: {}/{}",
Runtime.getRuntime().totalMemory(), Runtime.getRuntime().maxMemory());
+
+ for(MemoryPoolMXBean pool:
ManagementFactory.getMemoryPoolMXBeans())
+ logger.info("{} {}: {}", pool.getName(), pool.getType(),
pool.getPeakUsage());
+
+ logger.info("Classpath: {}",
System.getProperty("java.class.path"));
++
++logger.info("JVM Arguments: {}",
ManagementFactory.getRuntimeMXBean().getInputArguments());
+ }
+}
+
/**
* Initialize the Cassandra Daemon based on the g
[3/4] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0
Merge branch 'cassandra-2.2' into cassandra-3.0 Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c0d47bed Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c0d47bed Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c0d47bed Branch: refs/heads/trunk Commit: c0d47bed9d5103ecbc5f99dd420dc3198cdd176f Parents: d55a51e 6ff7c9c Author: Robert Stupp Authored: Fri Dec 11 16:51:14 2015 -0600 Committer: Robert Stupp Committed: Fri Dec 11 16:51:14 2015 -0600 -- CHANGES.txt| 1 + src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++ 2 files changed, 3 insertions(+) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/c0d47bed/CHANGES.txt -- diff --cc CHANGES.txt index a71ecbd,d44a47b..e20f5ed --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -6,39 -5,11 +6,40 @@@ Merged from 2. * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) Merged from 2.1: + * Cassandra Daemon should print JVM arguments (CASSANDRA-10764) * Allow cancellation of index summary redistribution (CASSANDRA-8805) - * Fix Stress profile parsing on Windows (CASSANDRA-10808) -2.2.4 +3.0.1 + * Avoid MV race during node decommission (CASSANDRA-10674) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Handle single-column deletions correction in materialized views + when the column is part of the view primary key (CASSANDRA-10796) + * Fix issue with datadir migration on upgrade (CASSANDRA-10788) + * Fix bug with range tombstones on reverse queries and test coverage for + AbstractBTreePartition (CASSANDRA-10059) + * Remove 64k limit on collection elements (CASSANDRA-10374) + * Remove unclear Indexer.indexes() method (CASSANDRA-10690) + * Fix NPE on stream read error (CASSANDRA-10771) + * Normalize cqlsh DESC output (CASSANDRA-10431) + * Rejects partition range deletions when columns are specified (CASSANDRA-10739) + * Fix error when saving cached key for old format sstable (CASSANDRA-10778) + * Invalidate prepared statements on DROP INDEX (CASSANDRA-10758) + * Fix SELECT statement with IN restrictions on partition key, + ORDER BY and LIMIT (CASSANDRA-10729) + * Improve stress performance over 1k threads (CASSANDRA-7217) + * Wait for migration responses to complete before bootstrapping (CASSANDRA-10731) + * Unable to create a function with argument of type Inet (CASSANDRA-10741) + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717) + * Correctly preserve deletion info on updated rows when notifying indexers + of single-row deletions (CASSANDRA-10694) + * Notify indexers of partition delete during cleanup (CASSANDRA-10685) + * Keep the file open in trySkipCache (CASSANDRA-10669) + * Updated trigger example (CASSANDRA-10257) +Merged from 2.2: + * Fix regression on split size in CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) + * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large buffers (CASSANDRA-10592) * Show CQL help in cqlsh in web browser (CASSANDRA-7225) * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775) * Reject index queries while the index is building (CASSANDRA-8505) http://git-wip-us.apache.org/repos/asf/cassandra/blob/c0d47bed/src/java/org/apache/cassandra/service/CassandraDaemon.java --
[1/2] cassandra git commit: Cassandra Daemon should print JVM arguments
Repository: cassandra
Updated Branches:
refs/heads/cassandra-2.2 94c361d1a -> 6ff7c9ce9
Cassandra Daemon should print JVM arguments
patch by Robert Stupp; reviewed by Michael Shuler for CASSANDRA-10764
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/dff22145
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/dff22145
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/dff22145
Branch: refs/heads/cassandra-2.2
Commit: dff2214595c5e2b0b8f3781186df55bd90c6728c
Parents: fc7075a
Author: Robert Stupp
Authored: Fri Dec 11 16:50:34 2015 -0600
Committer: Robert Stupp
Committed: Fri Dec 11 16:50:34 2015 -0600
--
CHANGES.txt| 1 +
src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++
2 files changed, 3 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2ee8b07..96f2f4f 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Cassandra Daemon should print JVM arguments (CASSANDRA-10764)
* Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/dff22145/src/java/org/apache/cassandra/service/CassandraDaemon.java
--
diff --git a/src/java/org/apache/cassandra/service/CassandraDaemon.java
b/src/java/org/apache/cassandra/service/CassandraDaemon.java
index 17553f3..a27fa20 100644
--- a/src/java/org/apache/cassandra/service/CassandraDaemon.java
+++ b/src/java/org/apache/cassandra/service/CassandraDaemon.java
@@ -202,6 +202,8 @@ public class CassandraDaemon
logger.info("{} {}: {}", pool.getName(), pool.getType(),
pool.getPeakUsage());
logger.info("Classpath: {}", System.getProperty("java.class.path"));
+logger.info("JVM Arguments: {}",
ManagementFactory.getRuntimeMXBean().getInputArguments());
+
// Fail-fast if JNA is not available or failing to initialize properly
// except with -Dcassandra.boot_without_jna=true. See CASSANDRA-6575.
if (!CLibrary.jnaAvailable())
[3/3] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0
Merge branch 'cassandra-2.2' into cassandra-3.0 Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c0d47bed Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c0d47bed Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c0d47bed Branch: refs/heads/cassandra-3.0 Commit: c0d47bed9d5103ecbc5f99dd420dc3198cdd176f Parents: d55a51e 6ff7c9c Author: Robert Stupp Authored: Fri Dec 11 16:51:14 2015 -0600 Committer: Robert Stupp Committed: Fri Dec 11 16:51:14 2015 -0600 -- CHANGES.txt| 1 + src/java/org/apache/cassandra/service/CassandraDaemon.java | 2 ++ 2 files changed, 3 insertions(+) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/c0d47bed/CHANGES.txt -- diff --cc CHANGES.txt index a71ecbd,d44a47b..e20f5ed --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -6,39 -5,11 +6,40 @@@ Merged from 2. * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) Merged from 2.1: + * Cassandra Daemon should print JVM arguments (CASSANDRA-10764) * Allow cancellation of index summary redistribution (CASSANDRA-8805) - * Fix Stress profile parsing on Windows (CASSANDRA-10808) -2.2.4 +3.0.1 + * Avoid MV race during node decommission (CASSANDRA-10674) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Handle single-column deletions correction in materialized views + when the column is part of the view primary key (CASSANDRA-10796) + * Fix issue with datadir migration on upgrade (CASSANDRA-10788) + * Fix bug with range tombstones on reverse queries and test coverage for + AbstractBTreePartition (CASSANDRA-10059) + * Remove 64k limit on collection elements (CASSANDRA-10374) + * Remove unclear Indexer.indexes() method (CASSANDRA-10690) + * Fix NPE on stream read error (CASSANDRA-10771) + * Normalize cqlsh DESC output (CASSANDRA-10431) + * Rejects partition range deletions when columns are specified (CASSANDRA-10739) + * Fix error when saving cached key for old format sstable (CASSANDRA-10778) + * Invalidate prepared statements on DROP INDEX (CASSANDRA-10758) + * Fix SELECT statement with IN restrictions on partition key, + ORDER BY and LIMIT (CASSANDRA-10729) + * Improve stress performance over 1k threads (CASSANDRA-7217) + * Wait for migration responses to complete before bootstrapping (CASSANDRA-10731) + * Unable to create a function with argument of type Inet (CASSANDRA-10741) + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717) + * Correctly preserve deletion info on updated rows when notifying indexers + of single-row deletions (CASSANDRA-10694) + * Notify indexers of partition delete during cleanup (CASSANDRA-10685) + * Keep the file open in trySkipCache (CASSANDRA-10669) + * Updated trigger example (CASSANDRA-10257) +Merged from 2.2: + * Fix regression on split size in CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) + * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large buffers (CASSANDRA-10592) * Show CQL help in cqlsh in web browser (CASSANDRA-7225) * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775) * Reject index queries while the index is building (CASSANDRA-8505) http://git-wip-us.apache.org/repos/asf/cassandra/blob/c0d47bed/src/java/org/apache/cassandra/service/CassandraDaemon.java --
[1/3] cassandra git commit: Add property to allow listening on broadcast_address (CASSANDRA-9748)
Repository: cassandra
Updated Branches:
refs/heads/trunk 3f79c5baa -> 4139d8f3f
Add property to allow listening on broadcast_address (CASSANDRA-9748)
patch by pauloricardomg; reviewed by aweisberg for CASSANDRA-9748
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/94c361d1
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/94c361d1
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/94c361d1
Branch: refs/heads/trunk
Commit: 94c361d1a7a63490f1b66f5b10e02579516c5eae
Parents: f166749
Author: Paulo Motta
Authored: Thu Nov 26 13:00:20 2015 -0800
Committer: Sylvain Lebresne
Committed: Fri Dec 11 17:56:45 2015 +0100
--
CHANGES.txt | 1 +
conf/cassandra.yaml | 8
.../org/apache/cassandra/config/Config.java | 1 +
.../cassandra/config/DatabaseDescriptor.java| 5 +
.../locator/ReconnectableSnitchHelper.java | 2 +-
.../apache/cassandra/net/MessagingService.java | 20
.../cassandra/service/StorageService.java | 8
.../org/apache/cassandra/utils/FBUtilities.java | 16
.../apache/cassandra/service/RemoveTest.java| 2 +-
9 files changed, 53 insertions(+), 10 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 5da0d42..035e471 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.2.5
+ * Add property to allow listening on broadcast interface (CASSANDRA-9748)
* Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
* Better handling of SSL connection errors inter-node (CASSANDRA-10816)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/conf/cassandra.yaml
--
diff --git a/conf/cassandra.yaml b/conf/cassandra.yaml
index dc4ef32..ec30488 100644
--- a/conf/cassandra.yaml
+++ b/conf/cassandra.yaml
@@ -421,6 +421,14 @@ listen_address: localhost
# Leaving this blank will set it to the same value as listen_address
# broadcast_address: 1.2.3.4
+# When using multiple physical network interfaces, set this
+# to true to listen on broadcast_address in addition to
+# the listen_address, allowing nodes to communicate in both
+# interfaces.
+# Ignore this property if the network configuration automatically
+# routes between the public and private networks such as EC2.
+# listen_on_broadcast_address: false
+
# Internode authentication backend, implementing IInternodeAuthenticator;
# used to allow/disallow connections from peer nodes.
# internode_authenticator:
org.apache.cassandra.auth.AllowAllInternodeAuthenticator
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/config/Config.java
--
diff --git a/src/java/org/apache/cassandra/config/Config.java
b/src/java/org/apache/cassandra/config/Config.java
index a8be5f4..c8ce0d7 100644
--- a/src/java/org/apache/cassandra/config/Config.java
+++ b/src/java/org/apache/cassandra/config/Config.java
@@ -112,6 +112,7 @@ public class Config
public String listen_interface;
public Boolean listen_interface_prefer_ipv6 = false;
public String broadcast_address;
+public Boolean listen_on_broadcast_address = false;
public String internode_authenticator;
/* intentionally left set to true, despite being set to false in stock 2.2
cassandra.yaml
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
--
diff --git a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
index 4fcc1fe..af0595d 100644
--- a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
+++ b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
@@ -1226,6 +1226,11 @@ public class DatabaseDescriptor
return broadcastAddress;
}
+public static Boolean shouldListenOnBroadcastAddress()
+{
+return conf.listen_on_broadcast_address;
+}
+
public static IInternodeAuthenticator getInternodeAuthenticator()
{
return internodeAuthenticator;
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/locator/ReconnectableSnitchHelper.java
--
diff --git
a/src/java/org/apache/cassandra/locator/ReconnectableSnitchHelper.java
[3/3] cassandra git commit: Merge branch 'cassandra-3.0' into trunk
Merge branch 'cassandra-3.0' into trunk Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/4139d8f3 Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/4139d8f3 Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/4139d8f3 Branch: refs/heads/trunk Commit: 4139d8f3fe88a1307458b59df3cf84f00ad97b2d Parents: 3f79c5b d55a51e Author: Robert Stupp Authored: Fri Dec 11 16:44:28 2015 -0600 Committer: Robert Stupp Committed: Fri Dec 11 16:44:28 2015 -0600 -- CHANGES.txt | 2 ++ conf/cassandra.yaml | 8 .../org/apache/cassandra/config/Config.java | 1 + .../cassandra/config/DatabaseDescriptor.java| 5 + .../locator/ReconnectableSnitchHelper.java | 2 +- .../apache/cassandra/net/MessagingService.java | 20 .../cassandra/service/StorageService.java | 8 .../org/apache/cassandra/utils/FBUtilities.java | 16 .../apache/cassandra/service/RemoveTest.java| 2 +- 9 files changed, 54 insertions(+), 10 deletions(-) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/4139d8f3/CHANGES.txt -- diff --cc CHANGES.txt index fad4bb2,a71ecbd..f06648e --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -1,19 -1,10 +1,21 @@@ -3.0.2 -Merged from 2.2 +3.2 + * Add compressor name in sstablemetadata output (CASSANDRA-9879) + * Fix type casting for counter columns (CASSANDRA-10824) + * Prevent running Cassandra as root (CASSANDRA-8142) + * bound maximum in-flight commit log replay mutation bytes to 64 megabytes (CASSANDRA-8639) + * Normalize all scripts (CASSANDRA-10679) + * Make compression ratio much more accurate (CASSANDRA-10225) + * Optimize building of Clustering object when only one is created (CASSANDRA-10409) + * Make index building pluggable (CASSANDRA-10681) + * Add sstable flush observer (CASSANDRA-10678) + * Improve NTS endpoints calculation (CASSANDRA-10200) + * Improve performance of the folderSize function (CASSANDRA-10677) + * Add support for type casting in selection clause (CASSANDRA-10310) + * Added graphing option to cassandra-stress (CASSANDRA-7918) + * Abort in-progress queries that time out (CASSANDRA-7392) + * Add transparent data encryption core classes (CASSANDRA-9945) ++Merged from 2.2: + * Add property to allow listening on broadcast interface (CASSANDRA-9748) - * Fix regression in split size on CqlInputFormat (CASSANDRA-10835) - * Better handling of SSL connection errors inter-node (CASSANDRA-10816) - * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) - * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) Merged from 2.1: * Allow cancellation of index summary redistribution (CASSANDRA-8805) http://git-wip-us.apache.org/repos/asf/cassandra/blob/4139d8f3/src/java/org/apache/cassandra/config/Config.java -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/4139d8f3/src/java/org/apache/cassandra/config/DatabaseDescriptor.java -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/4139d8f3/src/java/org/apache/cassandra/net/MessagingService.java -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/4139d8f3/src/java/org/apache/cassandra/utils/FBUtilities.java --
[2/3] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0
Merge branch 'cassandra-2.2' into cassandra-3.0 Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d55a51e9 Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d55a51e9 Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d55a51e9 Branch: refs/heads/trunk Commit: d55a51e9523d3695fa43bfbe7da3b6ab0a110caf Parents: 65885e7 94c361d Author: Sylvain Lebresne Authored: Fri Dec 11 17:58:48 2015 +0100 Committer: Sylvain Lebresne Committed: Fri Dec 11 17:58:48 2015 +0100 -- CHANGES.txt | 7 +++ conf/cassandra.yaml | 8 .../org/apache/cassandra/config/Config.java | 1 + .../cassandra/config/DatabaseDescriptor.java| 5 + .../locator/ReconnectableSnitchHelper.java | 2 +- .../apache/cassandra/net/MessagingService.java | 20 .../cassandra/service/StorageService.java | 8 .../org/apache/cassandra/utils/FBUtilities.java | 16 .../apache/cassandra/service/RemoveTest.java| 2 +- 9 files changed, 59 insertions(+), 10 deletions(-) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/CHANGES.txt -- diff --cc CHANGES.txt index 5932dbb,035e471..a71ecbd --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -1,37 -1,14 +1,44 @@@ -2.2.5 +3.0.2 ++Merged from 2.2 + * Add property to allow listening on broadcast interface (CASSANDRA-9748) + * Fix regression in split size on CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) Merged from 2.1: * Allow cancellation of index summary redistribution (CASSANDRA-8805) - * Fix Stress profile parsing on Windows (CASSANDRA-10808) + -2.2.4 +3.0.1 + * Avoid MV race during node decommission (CASSANDRA-10674) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Handle single-column deletions correction in materialized views + when the column is part of the view primary key (CASSANDRA-10796) + * Fix issue with datadir migration on upgrade (CASSANDRA-10788) + * Fix bug with range tombstones on reverse queries and test coverage for + AbstractBTreePartition (CASSANDRA-10059) + * Remove 64k limit on collection elements (CASSANDRA-10374) + * Remove unclear Indexer.indexes() method (CASSANDRA-10690) + * Fix NPE on stream read error (CASSANDRA-10771) + * Normalize cqlsh DESC output (CASSANDRA-10431) + * Rejects partition range deletions when columns are specified (CASSANDRA-10739) + * Fix error when saving cached key for old format sstable (CASSANDRA-10778) + * Invalidate prepared statements on DROP INDEX (CASSANDRA-10758) + * Fix SELECT statement with IN restrictions on partition key, + ORDER BY and LIMIT (CASSANDRA-10729) + * Improve stress performance over 1k threads (CASSANDRA-7217) + * Wait for migration responses to complete before bootstrapping (CASSANDRA-10731) + * Unable to create a function with argument of type Inet (CASSANDRA-10741) + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717) + * Correctly preserve deletion info on updated rows when notifying indexers + of single-row deletions (CASSANDRA-10694) + * Notify indexers of partition delete during cleanup (CASSANDRA-10685) + * Keep the file open in trySkipCache (CASSANDRA-10669) + * Updated trigger example (CASSANDRA-10257) +Merged from 2.2: + * Fix regression on split size in CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) + * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large buffers (CASSANDRA-10592) * Show CQL help in cqlsh in web browser (CASSANDRA-7225) * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775) * Reject index queries while the index is building (CASSANDRA-8505) http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/conf/cassandra.yaml -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/src/java/org/apache/cassandra/config/Config.java -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/src/java/org/apache/cassandra/config/DatabaseDescriptor.java -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/src/java/org/apache/cassandra/net/MessagingService.java
[jira] [Commented] (CASSANDRA-9318) Bound the number of in-flight requests at the coordinator
[ https://issues.apache.org/jira/browse/CASSANDRA-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053719#comment-15053719 ] Ariel Weisberg commented on CASSANDRA-9318: --- I tried out limiting based on memory utilization. What I found was that for the small amount of throughput I can get out of my desktop the 2 second timeout is sufficient to evict and hint without OOM. If I extend the timeout enough I can get an OOM because eviction doesn't keep up so that demonstrates that eviction has to take place to avoid OOM. I see this change as useful in that it places a hard bound on working set size, but not sufficient. Performance tanks so badly as the heap fills up with requests being timed out that evicting them is not a problem. If that is the case maybe we should just be evicting them more aggressively so they don't have an impact on performance. Possibly based on perceived odds of receiving a response in a reasonable amount of time. It makes sense to me to use hinting as a method of getting the data off the heap and batching the replication to slow nodes or DCs. If we start evicting requests for a node maybe we should have an adaptive approach and go straight to hinting for the slow node for some % of requests. If the non-immediately hinted requests start succeeding we can gradually increase the % that go straight to the node. I am trying to think of alternatives that don't end up kicking back an error to the application. That's still an important capability to have because growing hints forever is not great, but we can start by ensuring that rest of the cluster can always operate at full speed even if a node is slow. Separately we can tackle bounding the resource utilization issues that presents. Operationally how do people feel about having many gigabytes worth of hints to deliver? Is that useful in that it allows things to continue until the slow node is addressed? > Bound the number of in-flight requests at the coordinator > - > > Key: CASSANDRA-9318 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9318 > Project: Cassandra > Issue Type: Improvement > Components: Local Write-Read Paths, Streaming and Messaging >Reporter: Ariel Weisberg >Assignee: Ariel Weisberg > Fix For: 2.1.x, 2.2.x > > > It's possible to somewhat bound the amount of load accepted into the cluster > by bounding the number of in-flight requests and request bytes. > An implementation might do something like track the number of outstanding > bytes and requests and if it reaches a high watermark disable read on client > connections until it goes back below some low watermark. > Need to make sure that disabling read on the client connection won't > introduce other issues. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10580) On dropped mutations, more details should be logged.
[
https://issues.apache.org/jira/browse/CASSANDRA-10580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053675#comment-15053675
]
Paulo Motta commented on CASSANDRA-10580:
-
While re-reviewing your patch I just noticed we already log dropped messages on
{{MessageDeliveryTask.logDroppedMetrics()}}. Actually, we used to log dropped
messages individually before, but it became very verbose so we started logging
a summary every minute instead (more details on CASSANDRA-1284). Sorry for not
checking this before.
I think a more robust/elegant approach is to provide a new {{Timer}} metric
{{droppedTime}} or {{timeTaken}} on {{DroppedMessageMetrics}}, and print the
average dropped time on {{MessagingService.logDroppedMetrics()}}. One benefit
of this approach is that it will automatically allow to plot and consume this
metric in real-time via JMX. Another aesthetic benefit is that we would not
need to repeat the logging logic on {{MessageDeliveryTask}},
{{LocalMutationRunnable}} and {{DroppableRunnable}}, since they already report
statistics to {{MessagingService}} via {{incrementDroppedMessages()}}.
In order to provide dropped mutation metrics per KS/Table we would need to add
a new counter metric {{droppedMutations}} to {{TableMetrics}}. This will be a
bit more complex but still doable, so we can leave it for another ticket if you
don't want to do it now. If you're not familiar with the metrics system you
can have a look in the classes with name ending in {{Metrics}} for more
background.
Please let me know if you need some help with this approach.
> On dropped mutations, more details should be logged.
>
>
> Key: CASSANDRA-10580
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10580
> Project: Cassandra
> Issue Type: Improvement
> Components: Coordination
> Environment: Production
>Reporter: Anubhav Kale
>Assignee: Anubhav Kale
>Priority: Minor
> Fix For: 3.2, 2.2.x
>
> Attachments: 10580.patch, CASSANDRA-10580-Head.patch, Trunk.patch
>
>
> In our production cluster, we are seeing a large number of dropped mutations.
> At a minimum, we should print the time the thread took to get scheduled
> thereby dropping the mutation (We should also print the Message / Mutation so
> it helps in figuring out which column family was affected). This will help
> find the right tuning parameter for write_timeout_in_ms.
> The change is small and is in StorageProxy.java and MessagingTask.java. I
> will submit a patch shortly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CASSANDRA-10848) Upgrade paging dtests involving deletion flap on CassCI
Jim Witschey created CASSANDRA-10848:
Summary: Upgrade paging dtests involving deletion flap on CassCI
Key: CASSANDRA-10848
URL: https://issues.apache.org/jira/browse/CASSANDRA-10848
Project: Cassandra
Issue Type: Bug
Reporter: Jim Witschey
A number of dtests in the {{upgrade_tests.paging_tests}} that involve deletion
flap with the following error:
{code}
Requested pages were not delivered before timeout.
{code}
This may just be an effect of CASSANDRA-10730, but it's worth having a look at
separately. Here are some examples of tests flapping in this way:
http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/junit/upgrade_tests.paging_test/TestPagingWithDeletionsNodes2RF1/test_multiple_partition_deletions/
http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/junit/upgrade_tests.paging_test/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10848) Upgrade paging dtests involving deletion flap on CassCI
[
https://issues.apache.org/jira/browse/CASSANDRA-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jim Witschey updated CASSANDRA-10848:
-
Fix Version/s: 3.x
3.0.x
> Upgrade paging dtests involving deletion flap on CassCI
> ---
>
> Key: CASSANDRA-10848
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10848
> Project: Cassandra
> Issue Type: Bug
>Reporter: Jim Witschey
> Fix For: 3.0.x, 3.x
>
>
> A number of dtests in the {{upgrade_tests.paging_tests}} that involve
> deletion flap with the following error:
> {code}
> Requested pages were not delivered before timeout.
> {code}
> This may just be an effect of CASSANDRA-10730, but it's worth having a look
> at separately. Here are some examples of tests flapping in this way:
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/junit/upgrade_tests.paging_test/TestPagingWithDeletionsNodes2RF1/test_multiple_partition_deletions/
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/junit/upgrade_tests.paging_test/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10476) Fix upgrade paging dtest failures on 2.2->3.0 path
[
https://issues.apache.org/jira/browse/CASSANDRA-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053577#comment-15053577
]
Jim Witschey commented on CASSANDRA-10476:
--
I've also seen some flapping on this test:
http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/420/testReport/upgrade_tests.paging_test/TestPagingWithDeletionsNodes3RF3/test_failure_threshold_deletions/history/
It looks like an ordinary flap where a node doesn't come up, but I rarely see
it in other tests. Any thoughts on this one?
> Fix upgrade paging dtest failures on 2.2->3.0 path
> --
>
> Key: CASSANDRA-10476
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10476
> Project: Cassandra
> Issue Type: Sub-task
>Reporter: Jim Witschey
>Assignee: Benjamin Lerer
> Fix For: 3.0.x
>
>
> EDIT: this list of failures is no longer current; see comments for current
> failures.
> The following upgrade tests for paging features fail or flap on the upgrade
> path from 2.2 to 3.0:
> - {{upgrade_tests/paging_test.py:TestPagingData.static_columns_paging_test}}
> -
> {{upgrade_tests/paging_test.py:TestPagingSize.test_undefined_page_size_default}}
> -
> {{upgrade_tests/paging_test.py:TestPagingSize.test_with_more_results_than_page_size}}
> -
> {{upgrade_tests/paging_test.py:TestPagingWithDeletions.test_failure_threshold_deletions}}
> -
> {{upgrade_tests/paging_test.py:TestPagingWithDeletions.test_multiple_cell_deletions}}
> -
> {{upgrade_tests/paging_test.py:TestPagingWithDeletions.test_single_cell_deletions}}
> -
> {{upgrade_tests/paging_test.py:TestPagingWithDeletions.test_single_row_deletions}}
> -
> {{upgrade_tests/paging_test.py:TestPagingDatasetChanges.test_cell_TTL_expiry_during_paging/}}
> I've grouped them all together because I don't know how to tell if they're
> related; once someone triages them, it may be appropriate to break this out
> into multiple tickets.
> The failures can be found here:
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/44/testReport/upgrade_tests.paging_test/TestPagingData/static_columns_paging_test/history/
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/44/testReport/upgrade_tests.paging_test/TestPagingSize/test_undefined_page_size_default/history/
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/42/testReport/upgrade_tests.paging_test/TestPagingSize/test_with_more_results_than_page_size/history/
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/44/testReport/upgrade_tests.paging_test/TestPagingWithDeletions/test_failure_threshold_deletions/history/
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/44/testReport/upgrade_tests.paging_test/TestPagingWithDeletions/test_multiple_cell_deletions/history/
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/44/testReport/upgrade_tests.paging_test/TestPagingWithDeletions/test_single_cell_deletions/history/
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/44/testReport/upgrade_tests.paging_test/TestPagingWithDeletions/test_single_row_deletions/history/
> http://cassci.datastax.com/view/Upgrades/job/storage_engine_upgrade_dtest-22_tarball-30_HEAD/44/testReport/upgrade_tests.paging_test/TestPagingDatasetChanges/test_cell_TTL_expiry_during_paging/
> Once [this dtest PR|https://github.com/riptano/cassandra-dtest/pull/586] is
> merged, these tests should also run with this upgrade path on normal 3.0
> jobs. Until then, you can run them with the following command:
> {code}
> SKIP=false CASSANDRA_VERSION=binary:2.2.0 UPGRADE_TO=git:cassandra-3.0
> nosetests
> upgrade_tests/paging_test.py:TestPagingData.static_columns_paging_test
> upgrade_tests/paging_test.py:TestPagingSize.test_undefined_page_size_default
> upgrade_tests/paging_test.py:TestPagingSize.test_with_more_results_than_page_size
>
> upgrade_tests/paging_test.py:TestPagingWithDeletions.test_failure_threshold_deletions
>
> upgrade_tests/paging_test.py:TestPagingWithDeletions.test_multiple_cell_deletions
>
> upgrade_tests/paging_test.py:TestPagingWithDeletions.test_single_cell_deletions
>
> upgrade_tests/paging_test.py:TestPagingWithDeletions.test_single_row_deletions
> upgrade_tests/paging_test.py:TestPagingDatasetChanges.test_cell_TTL_expiry_during_paging
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CASSANDRA-10847) Log a message when refusing a major compaction due to incremental repairedAt status
Brandon Williams created CASSANDRA-10847: Summary: Log a message when refusing a major compaction due to incremental repairedAt status Key: CASSANDRA-10847 URL: https://issues.apache.org/jira/browse/CASSANDRA-10847 Project: Cassandra Issue Type: Improvement Components: Compaction Reporter: Brandon Williams When you do a major compaction, but have some repaired sstables and some that are not, it will correctly not compact them together. However, it can be somewhat confusing the operator as to *why* they aren't compacting together. It would be beneficial, specifically when doing a major, to log that we aren't going to do a full major because of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CASSANDRA-10846) sstableofflinerelevel_test is failing
Philip Thompson created CASSANDRA-10846:
---
Summary: sstableofflinerelevel_test is failing
Key: CASSANDRA-10846
URL: https://issues.apache.org/jira/browse/CASSANDRA-10846
Project: Cassandra
Issue Type: Sub-task
Components: Testing, Tools
Reporter: Philip Thompson
Fix For: 2.2.x
{{offline_tools_test.TestOfflineTools.sstableofflinerelevel_test}} is failing
consistently on 2.2-head on cassci. 2.1 and 3.0 appear unaffected.
If you see here:
http://cassci.datastax.com/job/cassandra-2.2_dtest/439/testReport/ , it appears
that after running sstableofflinerelevel, all twenty sstables are promoted to
level 1, while we are expecting at least some to make it to L2.
I am unable to reproduce this locally on OSX
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CASSANDRA-10845) jmxmetrics_test.TestJMXMetrics.begin_test is failing
Philip Thompson created CASSANDRA-10845: --- Summary: jmxmetrics_test.TestJMXMetrics.begin_test is failing Key: CASSANDRA-10845 URL: https://issues.apache.org/jira/browse/CASSANDRA-10845 Project: Cassandra Issue Type: Sub-task Components: Testing Reporter: Philip Thompson Assignee: Philip Thompson This test is failing on 2.1-head. There appear to be structural issues with the test. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10845) jmxmetrics_test.TestJMXMetrics.begin_test is failing
[ https://issues.apache.org/jira/browse/CASSANDRA-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Thompson updated CASSANDRA-10845: Fix Version/s: (was: 3.0.x) > jmxmetrics_test.TestJMXMetrics.begin_test is failing > > > Key: CASSANDRA-10845 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10845 > Project: Cassandra > Issue Type: Sub-task > Components: Testing >Reporter: Philip Thompson >Assignee: Philip Thompson > > This test is failing on 2.1-head. There appear to be structural issues with > the test, and no C* bug to be fixed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10845) jmxmetrics_test.TestJMXMetrics.begin_test is failing
[ https://issues.apache.org/jira/browse/CASSANDRA-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Thompson updated CASSANDRA-10845: Description: This test is failing on 2.1-head. There appear to be structural issues with the test, and no C* bug to be fixed. (was: This test is failing on 2.1-head. There appear to be structural issues with the test.) > jmxmetrics_test.TestJMXMetrics.begin_test is failing > > > Key: CASSANDRA-10845 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10845 > Project: Cassandra > Issue Type: Sub-task > Components: Testing >Reporter: Philip Thompson >Assignee: Philip Thompson > > This test is failing on 2.1-head. There appear to be structural issues with > the test, and no C* bug to be fixed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (CASSANDRA-10763) jmxmetrics_test.TestJMXMetrics.begin_test is failing
[
https://issues.apache.org/jira/browse/CASSANDRA-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philip Thompson resolved CASSANDRA-10763.
-
Resolution: Fixed
Fix Version/s: (was: 3.0.x)
Discovered and fixed by Benjamin while he was working on 10225
> jmxmetrics_test.TestJMXMetrics.begin_test is failing
> -
>
> Key: CASSANDRA-10763
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10763
> Project: Cassandra
> Issue Type: Sub-task
> Components: Testing
>Reporter: Philip Thompson
>
> jmxmetrics_test.TestJMXMetrics.begin_test is failing against 3.0
> The error message is
> {code}
> org.apache.cassandra.metrics:type=Table,name=CompressionRatio has a before
> value of 0.821687586749 and after value of 0.822466108603 and did not
> decrement
> {code}
> The test expects that mbean to decrease over the course of the test, but it
> does not. I do not know if this is a bug, a change in behavior, or simply an
> incorrect assumption by the test.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10844) failed_bootstrap_wiped_node_can_join_test is failing
[
https://issues.apache.org/jira/browse/CASSANDRA-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philip Thompson updated CASSANDRA-10844:
Description:
{{bootstrap_test.TestBootstrap.failed_bootstap_wiped_node_can_join_test}} is
failing on 2.1-head. The second node fails to join the cluster. I see a lot of
exceptions in node1's log, such as
{code}
ERROR [STREAM-OUT-/127.0.0.2] 2015-12-11 12:06:13,778 StreamSession.java:505 -
[Stream #7b5ec5a0-a029-11e5-bad9-ffd0922f40e6] Streaming error occurred
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_51]
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[na:1.8.0_51]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
~[na:1.8.0_51]
at
org.apache.cassandra.io.util.DataOutputStreamAndChannel.write(DataOutputStreamAndChannel.java:48)
~[main/:na]
at
org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:44)
~[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:351)
[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:331)
[main/:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
{code}
Which seem consistent with node2 being killed, so the bootstrap fails. But then
when restarting node2, it does not join. It *looks* like it fails to rejoin
because of a false positive in checking the 2 minute rule.
{code}
ERROR [main] 2015-12-11 12:06:17,954 CassandraDaemon.java:579 - Except
ion encountered during startup
java.lang.UnsupportedOperationException: Other bootstrapping/leaving/m
oving nodes detected, cannot bootstrap while cassandra.consistent.rang
emovement is true
at org.apache.cassandra.service.StorageService.checkForEndpoin
tCollision(StorageService.java:559) ~[main/:na]
at org.apache.cassandra.service.StorageService.prepareToJoin(S
torageService.java:789) ~[main/:na]
at org.apache.cassandra.service.StorageService.initServer(Stor
ageService.java:721) ~[main/:na]
at org.apache.cassandra.service.StorageService.initServer(Stor
ageService.java:612) ~[main/:na]
at
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:387)
[main/:na]
at
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:562)
[main/:na]
at
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:651)
[main/:na]
{code}
This fails consistently locally and on cassci. Logs attached.
was:
{{bootstrap_test.TestBootstrap.failed_bootstap_wiped_node_can_join_test}} is
failing on 2.1-head. The second node fails to join the cluster. I see a lot of
exceptions in node1's log, such as
{code}
ERROR [STREAM-OUT-/127.0.0.2] 2015-12-11 12:06:13,778 StreamSession.java:505 -
[Stream #7b5ec5a0-a029-11e5-bad9-ffd0922f40e6] Streaming error occurred
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_51]
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[na:1.8.0_51]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
~[na:1.8.0_51]
at
org.apache.cassandra.io.util.DataOutputStreamAndChannel.write(DataOutputStreamAndChannel.java:48)
~[main/:na]
at
org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:44)
~[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:351)
[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:331)
[main/:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
{code}
Which seem consistent with node2 being killed, so the bootstrap fails. But then
when restarting node2, it does not join.
This fails consistently locally and on cassci. Logs attached.
> failed_bootstrap_wiped_node_can_join_test is failing
>
>
> Key: CASSANDRA-10844
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10844
> Project: Cassandra
> Issue Type: Sub-task
> Components: Streaming and Messaging, Testing
>Reporter: Philip Thompson
> Fix For: 2.1.x
>
> Attachments: node1.log, node2.log
>
>
> {{bootstrap_test.TestBootstrap.failed_bootstap_wiped_node_can_join_test}} is
> faili
[jira] [Updated] (CASSANDRA-10844) failed_bootstrap_wiped_node_can_join_test is failing
[
https://issues.apache.org/jira/browse/CASSANDRA-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philip Thompson updated CASSANDRA-10844:
Description:
{{bootstrap_test.TestBootstrap.failed_bootstap_wiped_node_can_join_test}} is
failing on 2.1-head. The second node fails to join the cluster. I see a lot of
exceptions in node1's log, such as
{code}
ERROR [STREAM-OUT-/127.0.0.2] 2015-12-11 12:06:13,778 StreamSession.java:505 -
[Stream #7b5ec5a0-a029-11e5-bad9-ffd0922f40e6] Streaming error occurred
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_51]
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[na:1.8.0_51]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
~[na:1.8.0_51]
at
org.apache.cassandra.io.util.DataOutputStreamAndChannel.write(DataOutputStreamAndChannel.java:48)
~[main/:na]
at
org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:44)
~[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:351)
[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:331)
[main/:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
{code}
Which seem consistent with node2 being killed, so the bootstrap fails. But then
when restarting node2, it does not join.
This fails consistently locally and on cassci. Logs attached.
was:
{{bootstrap_test.TestBootstrap.failed_bootstap_wiped_node_can_join_test}} is
failing on 2.1-head. The second node fails to join the cluster. I see a lot of
exceptions in node1's log, such as
{code}
ERROR [STREAM-OUT-/127.0.0.2] 2015-12-11 12:06:13,778 StreamSession.java:505 -
[Stream #7b5ec5a0-a029-11e5-bad9-ffd0922f40e6] Streaming error occurred
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_51]
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[na:1.8.0_51]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
~[na:1.8.0_51]
at
org.apache.cassandra.io.util.DataOutputStreamAndChannel.write(DataOutputStreamAndChannel.java:48)
~[main/:na]
at
org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:44)
~[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:351)
[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:331)
[main/:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
{code}
This fails consistently locally and on cassci. Logs attached.
> failed_bootstrap_wiped_node_can_join_test is failing
>
>
> Key: CASSANDRA-10844
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10844
> Project: Cassandra
> Issue Type: Sub-task
> Components: Streaming and Messaging, Testing
>Reporter: Philip Thompson
> Fix For: 2.1.x
>
> Attachments: node1.log, node2.log
>
>
> {{bootstrap_test.TestBootstrap.failed_bootstap_wiped_node_can_join_test}} is
> failing on 2.1-head. The second node fails to join the cluster. I see a lot
> of exceptions in node1's log, such as
> {code}
> ERROR [STREAM-OUT-/127.0.0.2] 2015-12-11 12:06:13,778 StreamSession.java:505
> - [Stream #7b5ec5a0-a029-11e5-bad9-ffd0922f40e6] Streaming error occurred
> java.io.IOException: Broken pipe
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_51]
> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
> ~[na:1.8.0_51]
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
> ~[na:1.8.0_51]
> at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[na:1.8.0_51]
> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
> ~[na:1.8.0_51]
> at
> org.apache.cassandra.io.util.DataOutputStreamAndChannel.write(DataOutputStreamAndChannel.java:48)
> ~[main/:na]
> at
> org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:44)
> ~[main/:na]
> at
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:351)
> [main/:na]
> at
> org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.j
[jira] [Created] (CASSANDRA-10844) failed_bootstrap_wiped_node_can_join_test is failing
Philip Thompson created CASSANDRA-10844:
---
Summary: failed_bootstrap_wiped_node_can_join_test is failing
Key: CASSANDRA-10844
URL: https://issues.apache.org/jira/browse/CASSANDRA-10844
Project: Cassandra
Issue Type: Sub-task
Components: Streaming and Messaging, Testing
Reporter: Philip Thompson
Fix For: 2.1.x
Attachments: node1.log, node2.log
{{bootstrap_test.TestBootstrap.failed_bootstap_wiped_node_can_join_test}} is
failing on 2.1-head. The second node fails to join the cluster. I see a lot of
exceptions in node1's log, such as
{code}
ERROR [STREAM-OUT-/127.0.0.2] 2015-12-11 12:06:13,778 StreamSession.java:505 -
[Stream #7b5ec5a0-a029-11e5-bad9-ffd0922f40e6] Streaming error occurred
java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_51]
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
~[na:1.8.0_51]
at sun.nio.ch.IOUtil.write(IOUtil.java:65) ~[na:1.8.0_51]
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
~[na:1.8.0_51]
at
org.apache.cassandra.io.util.DataOutputStreamAndChannel.write(DataOutputStreamAndChannel.java:48)
~[main/:na]
at
org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:44)
~[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:351)
[main/:na]
at
org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:331)
[main/:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
{code}
This fails consistently locally and on cassci. Logs attached.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10836) Data integrity flappers in upgrade_tests dtests
[
https://issues.apache.org/jira/browse/CASSANDRA-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053034#comment-15053034
]
Jim Witschey commented on CASSANDRA-10836:
--
I've changed the topic of this ticket slightly. We still don't know the
underlying cause of this kind of error, and some of the flapping upgrade_tests
don't involve data resurrection. E.g., {{whole_set_conditional_test}} recently
flapped once, finding a cell empty rather than finding resurrected data:
http://cassci.datastax.com/job/cassandra-3.0_dtest/429/testReport/junit/upgrade_tests.cql_tests/TestCQLNodes3RF3/whole_set_conditional_test/history/
> Data integrity flappers in upgrade_tests dtests
> ---
>
> Key: CASSANDRA-10836
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10836
> Project: Cassandra
> Issue Type: Bug
>Reporter: Jim Witschey
>Priority: Critical
> Fix For: 3.0.x, 3.x
>
>
> A number of the {{upgrade_tests}} in dtest are flapping with data integrity
> bugs. For instance:
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/conditional_delete_test/history/
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/421/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/cas_and_list_index_test/history/
> This needs further digging to get good debug information; it could well be,
> e.g., a race condition in the test. I have not reproduced locally.
> /cc [~philipthompson]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-7306) Support "edge dcs" with more flexible gossip
[ https://issues.apache.org/jira/browse/CASSANDRA-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053033#comment-15053033 ] Jeff Jirsa commented on CASSANDRA-7306: --- Missing dtests primarily. Probably going to add some more gossip-related unit tests, but dtests. > Support "edge dcs" with more flexible gossip > > > Key: CASSANDRA-7306 > URL: https://issues.apache.org/jira/browse/CASSANDRA-7306 > Project: Cassandra > Issue Type: Improvement > Components: Distributed Metadata >Reporter: Tupshin Harper >Assignee: Jeff Jirsa > Labels: ponies > > As Cassandra clusters get bigger and bigger, and their topology becomes more > complex, there is more and more need for a notion of "hub" and "spoke" > datacenters. > One of the big obstacles to supporting hundreds (or thousands) of remote dcs, > is the assumption that all dcs need to talk to each other (and be connected > all the time). > This ticket is a vague placeholder with the goals of achieving: > 1) better behavioral support for occasionally disconnected datacenters > 2) explicit support for custom dc to dc routing. A simple approach would be > an optional per-dc annotation of which other DCs that DC could gossip with. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10836) Data integrity flappers in upgrade_tests dtests
[
https://issues.apache.org/jira/browse/CASSANDRA-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jim Witschey updated CASSANDRA-10836:
-
Summary: Data integrity flappers in upgrade_tests dtests (was: Data
resurrection flappers in upgrade_tests dtests)
> Data integrity flappers in upgrade_tests dtests
> ---
>
> Key: CASSANDRA-10836
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10836
> Project: Cassandra
> Issue Type: Bug
>Reporter: Jim Witschey
>Priority: Critical
> Fix For: 3.0.x, 3.x
>
>
> A number of the {{upgrade_tests}} in dtest are flapping with data
> resurrection bugs. For instance:
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/conditional_delete_test/history/
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/421/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/cas_and_list_index_test/history/
> This needs further digging to get good debug information; it could well be,
> e.g., a race condition in the test. I have not reproduced locally.
> /cc [~philipthompson]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10836) Data integrity flappers in upgrade_tests dtests
[
https://issues.apache.org/jira/browse/CASSANDRA-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jim Witschey updated CASSANDRA-10836:
-
Description:
A number of the {{upgrade_tests}} in dtest are flapping with data integrity
bugs. For instance:
http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/conditional_delete_test/history/
http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/421/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/cas_and_list_index_test/history/
This needs further digging to get good debug information; it could well be,
e.g., a race condition in the test. I have not reproduced locally.
/cc [~philipthompson]
was:
A number of the {{upgrade_tests}} in dtest are flapping with data resurrection
bugs. For instance:
http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/conditional_delete_test/history/
http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/421/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/cas_and_list_index_test/history/
This needs further digging to get good debug information; it could well be,
e.g., a race condition in the test. I have not reproduced locally.
/cc [~philipthompson]
> Data integrity flappers in upgrade_tests dtests
> ---
>
> Key: CASSANDRA-10836
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10836
> Project: Cassandra
> Issue Type: Bug
>Reporter: Jim Witschey
>Priority: Critical
> Fix For: 3.0.x, 3.x
>
>
> A number of the {{upgrade_tests}} in dtest are flapping with data integrity
> bugs. For instance:
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/422/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/conditional_delete_test/history/
> http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest/421/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3/cas_and_list_index_test/history/
> This needs further digging to get good debug information; it could well be,
> e.g., a race condition in the test. I have not reproduced locally.
> /cc [~philipthompson]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-6992) Bootstrap on vnodes clusters can cause stampeding/storm behavior
[ https://issues.apache.org/jira/browse/CASSANDRA-6992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053024#comment-15053024 ] Joshua McKenzie commented on CASSANDRA-6992: Yuki was out this past week. Since this is an improvement for 3.2 there's really no rush to commit (other than atrophy). > Bootstrap on vnodes clusters can cause stampeding/storm behavior > > > Key: CASSANDRA-6992 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6992 > Project: Cassandra > Issue Type: Improvement > Components: Coordination, Streaming and Messaging > Environment: Various vnodes-enabled clusters in EC2, m1.xlarge and > hi1.4xlarge, ~3000-8000 tokens. >Reporter: Rick Branson >Assignee: Paulo Motta >Priority: Minor > Labels: dense-storage > Fix For: 3.2 > > > Assuming this is an issue with vnodes clusters because > SSTableReader#getPositionsForRanges is more expensive to compute with 256x > the ranges, but could be wrong. On even well-provisioned hosts, this can > cause a severe spike in network throughput & CPU utilization from a storm of > flushes, which impacts long-tail times pretty badly. On weaker hosts (like > m1.xlarge with ~500GB of data), it can result in minutes of churn while the > node gets through StreamOut#createPendingFiles. This *might* be better in > 2.0, but it's probably still reproducible because the bootstrapping node > sends out all of it's streaming requests at once. > I'm thinking that this could be staggered at the bootstrapping node to avoid > the simultaneous spike across the whole cluster. Not sure on how to stagger > it besides something very naive like one-at-a-time with a pause. Maybe this > should also be throttled in StreamOut#createPendingFiles on the out-streaming > host? Any thoughts? > From the stack dump of one of our weaker nodes that was struggling for a few > minutes just starting the StreamOut: > "MiscStage:1" daemon prio=10 tid=0x0292f000 nid=0x688 runnable > [0x7f7b03df6000] >java.lang.Thread.State: RUNNABLE > at > org.apache.cassandra.utils.ByteBufferUtil.readShortLength(ByteBufferUtil.java:361) > at > org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:371) > at > org.apache.cassandra.io.sstable.IndexHelper$IndexInfo.deserialize(IndexHelper.java:187) > at > org.apache.cassandra.db.RowIndexEntry$Serializer.deserialize(RowIndexEntry.java:125) > at > org.apache.cassandra.io.sstable.SSTableReader.getPosition(SSTableReader.java:889) > at > org.apache.cassandra.io.sstable.SSTableReader.getPosition(SSTableReader.java:790) > at > org.apache.cassandra.io.sstable.SSTableReader.getPositionsForRanges(SSTableReader.java:730) > at > org.apache.cassandra.streaming.StreamOut.createPendingFiles(StreamOut.java:172) > at > org.apache.cassandra.streaming.StreamOut.transferSSTables(StreamOut.java:157) > at > org.apache.cassandra.streaming.StreamOut.transferRanges(StreamOut.java:148) > at > org.apache.cassandra.streaming.StreamOut.transferRanges(StreamOut.java:116) > at > org.apache.cassandra.streaming.StreamRequestVerbHandler.doVerb(StreamRequestVerbHandler.java:44) > at > org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:56) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) > at java.lang.Thread.run(Thread.java:662) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-7306) Support "edge dcs" with more flexible gossip
[ https://issues.apache.org/jira/browse/CASSANDRA-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053016#comment-15053016 ] Aleksey Yeschenko commented on CASSANDRA-7306: -- [~jjirsa] Moved from Patch Available to Awaiting Feedback, as your comment gives an impression that it's not fully complete yet. Someone will give feedback eventually, but, for context, what's missing in the branch? > Support "edge dcs" with more flexible gossip > > > Key: CASSANDRA-7306 > URL: https://issues.apache.org/jira/browse/CASSANDRA-7306 > Project: Cassandra > Issue Type: Improvement > Components: Distributed Metadata >Reporter: Tupshin Harper >Assignee: Jeff Jirsa > Labels: ponies > > As Cassandra clusters get bigger and bigger, and their topology becomes more > complex, there is more and more need for a notion of "hub" and "spoke" > datacenters. > One of the big obstacles to supporting hundreds (or thousands) of remote dcs, > is the assumption that all dcs need to talk to each other (and be connected > all the time). > This ticket is a vague placeholder with the goals of achieving: > 1) better behavioral support for occasionally disconnected datacenters > 2) explicit support for custom dc to dc routing. A simple approach would be > an optional per-dc annotation of which other DCs that DC could gossip with. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[2/2] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0
Merge branch 'cassandra-2.2' into cassandra-3.0 Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/d55a51e9 Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/d55a51e9 Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/d55a51e9 Branch: refs/heads/cassandra-3.0 Commit: d55a51e9523d3695fa43bfbe7da3b6ab0a110caf Parents: 65885e7 94c361d Author: Sylvain Lebresne Authored: Fri Dec 11 17:58:48 2015 +0100 Committer: Sylvain Lebresne Committed: Fri Dec 11 17:58:48 2015 +0100 -- CHANGES.txt | 7 +++ conf/cassandra.yaml | 8 .../org/apache/cassandra/config/Config.java | 1 + .../cassandra/config/DatabaseDescriptor.java| 5 + .../locator/ReconnectableSnitchHelper.java | 2 +- .../apache/cassandra/net/MessagingService.java | 20 .../cassandra/service/StorageService.java | 8 .../org/apache/cassandra/utils/FBUtilities.java | 16 .../apache/cassandra/service/RemoveTest.java| 2 +- 9 files changed, 59 insertions(+), 10 deletions(-) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/CHANGES.txt -- diff --cc CHANGES.txt index 5932dbb,035e471..a71ecbd --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -1,37 -1,14 +1,44 @@@ -2.2.5 +3.0.2 ++Merged from 2.2 + * Add property to allow listening on broadcast interface (CASSANDRA-9748) + * Fix regression in split size on CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) Merged from 2.1: * Allow cancellation of index summary redistribution (CASSANDRA-8805) - * Fix Stress profile parsing on Windows (CASSANDRA-10808) + -2.2.4 +3.0.1 + * Avoid MV race during node decommission (CASSANDRA-10674) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Handle single-column deletions correction in materialized views + when the column is part of the view primary key (CASSANDRA-10796) + * Fix issue with datadir migration on upgrade (CASSANDRA-10788) + * Fix bug with range tombstones on reverse queries and test coverage for + AbstractBTreePartition (CASSANDRA-10059) + * Remove 64k limit on collection elements (CASSANDRA-10374) + * Remove unclear Indexer.indexes() method (CASSANDRA-10690) + * Fix NPE on stream read error (CASSANDRA-10771) + * Normalize cqlsh DESC output (CASSANDRA-10431) + * Rejects partition range deletions when columns are specified (CASSANDRA-10739) + * Fix error when saving cached key for old format sstable (CASSANDRA-10778) + * Invalidate prepared statements on DROP INDEX (CASSANDRA-10758) + * Fix SELECT statement with IN restrictions on partition key, + ORDER BY and LIMIT (CASSANDRA-10729) + * Improve stress performance over 1k threads (CASSANDRA-7217) + * Wait for migration responses to complete before bootstrapping (CASSANDRA-10731) + * Unable to create a function with argument of type Inet (CASSANDRA-10741) + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717) + * Correctly preserve deletion info on updated rows when notifying indexers + of single-row deletions (CASSANDRA-10694) + * Notify indexers of partition delete during cleanup (CASSANDRA-10685) + * Keep the file open in trySkipCache (CASSANDRA-10669) + * Updated trigger example (CASSANDRA-10257) +Merged from 2.2: + * Fix regression on split size in CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) + * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large buffers (CASSANDRA-10592) * Show CQL help in cqlsh in web browser (CASSANDRA-7225) * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775) * Reject index queries while the index is building (CASSANDRA-8505) http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/conf/cassandra.yaml -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/src/java/org/apache/cassandra/config/Config.java -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/src/java/org/apache/cassandra/config/DatabaseDescriptor.java -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/d55a51e9/src/java/org/apache/cassandra/net/MessagingService.j
[1/2] cassandra git commit: Add property to allow listening on broadcast_address (CASSANDRA-9748)
Repository: cassandra
Updated Branches:
refs/heads/cassandra-3.0 65885e7fc -> d55a51e95
Add property to allow listening on broadcast_address (CASSANDRA-9748)
patch by pauloricardomg; reviewed by aweisberg for CASSANDRA-9748
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/94c361d1
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/94c361d1
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/94c361d1
Branch: refs/heads/cassandra-3.0
Commit: 94c361d1a7a63490f1b66f5b10e02579516c5eae
Parents: f166749
Author: Paulo Motta
Authored: Thu Nov 26 13:00:20 2015 -0800
Committer: Sylvain Lebresne
Committed: Fri Dec 11 17:56:45 2015 +0100
--
CHANGES.txt | 1 +
conf/cassandra.yaml | 8
.../org/apache/cassandra/config/Config.java | 1 +
.../cassandra/config/DatabaseDescriptor.java| 5 +
.../locator/ReconnectableSnitchHelper.java | 2 +-
.../apache/cassandra/net/MessagingService.java | 20
.../cassandra/service/StorageService.java | 8
.../org/apache/cassandra/utils/FBUtilities.java | 16
.../apache/cassandra/service/RemoveTest.java| 2 +-
9 files changed, 53 insertions(+), 10 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 5da0d42..035e471 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.2.5
+ * Add property to allow listening on broadcast interface (CASSANDRA-9748)
* Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
* Better handling of SSL connection errors inter-node (CASSANDRA-10816)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/conf/cassandra.yaml
--
diff --git a/conf/cassandra.yaml b/conf/cassandra.yaml
index dc4ef32..ec30488 100644
--- a/conf/cassandra.yaml
+++ b/conf/cassandra.yaml
@@ -421,6 +421,14 @@ listen_address: localhost
# Leaving this blank will set it to the same value as listen_address
# broadcast_address: 1.2.3.4
+# When using multiple physical network interfaces, set this
+# to true to listen on broadcast_address in addition to
+# the listen_address, allowing nodes to communicate in both
+# interfaces.
+# Ignore this property if the network configuration automatically
+# routes between the public and private networks such as EC2.
+# listen_on_broadcast_address: false
+
# Internode authentication backend, implementing IInternodeAuthenticator;
# used to allow/disallow connections from peer nodes.
# internode_authenticator:
org.apache.cassandra.auth.AllowAllInternodeAuthenticator
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/config/Config.java
--
diff --git a/src/java/org/apache/cassandra/config/Config.java
b/src/java/org/apache/cassandra/config/Config.java
index a8be5f4..c8ce0d7 100644
--- a/src/java/org/apache/cassandra/config/Config.java
+++ b/src/java/org/apache/cassandra/config/Config.java
@@ -112,6 +112,7 @@ public class Config
public String listen_interface;
public Boolean listen_interface_prefer_ipv6 = false;
public String broadcast_address;
+public Boolean listen_on_broadcast_address = false;
public String internode_authenticator;
/* intentionally left set to true, despite being set to false in stock 2.2
cassandra.yaml
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
--
diff --git a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
index 4fcc1fe..af0595d 100644
--- a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
+++ b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
@@ -1226,6 +1226,11 @@ public class DatabaseDescriptor
return broadcastAddress;
}
+public static Boolean shouldListenOnBroadcastAddress()
+{
+return conf.listen_on_broadcast_address;
+}
+
public static IInternodeAuthenticator getInternodeAuthenticator()
{
return internodeAuthenticator;
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/locator/ReconnectableSnitchHelper.java
--
diff --git
a/src/java/org/apache/cassandra/locator/ReconnectableSn
cassandra git commit: Add property to allow listening on broadcast_address (CASSANDRA-9748)
Repository: cassandra
Updated Branches:
refs/heads/cassandra-2.2 f16674949 -> 94c361d1a
Add property to allow listening on broadcast_address (CASSANDRA-9748)
patch by pauloricardomg; reviewed by aweisberg for CASSANDRA-9748
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/94c361d1
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/94c361d1
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/94c361d1
Branch: refs/heads/cassandra-2.2
Commit: 94c361d1a7a63490f1b66f5b10e02579516c5eae
Parents: f166749
Author: Paulo Motta
Authored: Thu Nov 26 13:00:20 2015 -0800
Committer: Sylvain Lebresne
Committed: Fri Dec 11 17:56:45 2015 +0100
--
CHANGES.txt | 1 +
conf/cassandra.yaml | 8
.../org/apache/cassandra/config/Config.java | 1 +
.../cassandra/config/DatabaseDescriptor.java| 5 +
.../locator/ReconnectableSnitchHelper.java | 2 +-
.../apache/cassandra/net/MessagingService.java | 20
.../cassandra/service/StorageService.java | 8
.../org/apache/cassandra/utils/FBUtilities.java | 16
.../apache/cassandra/service/RemoveTest.java| 2 +-
9 files changed, 53 insertions(+), 10 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 5da0d42..035e471 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.2.5
+ * Add property to allow listening on broadcast interface (CASSANDRA-9748)
* Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
* Better handling of SSL connection errors inter-node (CASSANDRA-10816)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/conf/cassandra.yaml
--
diff --git a/conf/cassandra.yaml b/conf/cassandra.yaml
index dc4ef32..ec30488 100644
--- a/conf/cassandra.yaml
+++ b/conf/cassandra.yaml
@@ -421,6 +421,14 @@ listen_address: localhost
# Leaving this blank will set it to the same value as listen_address
# broadcast_address: 1.2.3.4
+# When using multiple physical network interfaces, set this
+# to true to listen on broadcast_address in addition to
+# the listen_address, allowing nodes to communicate in both
+# interfaces.
+# Ignore this property if the network configuration automatically
+# routes between the public and private networks such as EC2.
+# listen_on_broadcast_address: false
+
# Internode authentication backend, implementing IInternodeAuthenticator;
# used to allow/disallow connections from peer nodes.
# internode_authenticator:
org.apache.cassandra.auth.AllowAllInternodeAuthenticator
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/config/Config.java
--
diff --git a/src/java/org/apache/cassandra/config/Config.java
b/src/java/org/apache/cassandra/config/Config.java
index a8be5f4..c8ce0d7 100644
--- a/src/java/org/apache/cassandra/config/Config.java
+++ b/src/java/org/apache/cassandra/config/Config.java
@@ -112,6 +112,7 @@ public class Config
public String listen_interface;
public Boolean listen_interface_prefer_ipv6 = false;
public String broadcast_address;
+public Boolean listen_on_broadcast_address = false;
public String internode_authenticator;
/* intentionally left set to true, despite being set to false in stock 2.2
cassandra.yaml
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
--
diff --git a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
index 4fcc1fe..af0595d 100644
--- a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
+++ b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
@@ -1226,6 +1226,11 @@ public class DatabaseDescriptor
return broadcastAddress;
}
+public static Boolean shouldListenOnBroadcastAddress()
+{
+return conf.listen_on_broadcast_address;
+}
+
public static IInternodeAuthenticator getInternodeAuthenticator()
{
return internodeAuthenticator;
http://git-wip-us.apache.org/repos/asf/cassandra/blob/94c361d1/src/java/org/apache/cassandra/locator/ReconnectableSnitchHelper.java
--
diff --git
a/src/java/org/apache/cassandra/locator/ReconnectableSn
[jira] [Commented] (CASSANDRA-10822) SSTable data loss when upgrading with row tombstone present
[
https://issues.apache.org/jira/browse/CASSANDRA-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053008#comment-15053008
]
Russ Hatch commented on CASSANDRA-10822:
[~slebresne] Ran against [~blambov]'s branch this morning, 20 repetitions of
the test pass fine. (I ran multiple times to be sure, because when running
against 3.0 as a control, I was only intermittently seeing the issue this
morning. I'll work to make the test more deterministic however).
This test is running an upgrade on two nodes, cl.one, rf=1, are there any other
cases that might be useful to keep as regression tests going forward?
> SSTable data loss when upgrading with row tombstone present
> ---
>
> Key: CASSANDRA-10822
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10822
> Project: Cassandra
> Issue Type: Bug
>Reporter: Andy Tolbert
>Assignee: Branimir Lambov
>Priority: Critical
> Fix For: 3.0.x, 3.x
>
>
> I ran into an issue when upgrading between 2.1.11 to 3.0.0 (and also
> cassandra-3.0 branch) where subsequent rows were lost within a partition
> where there is a row tombstone present.
> Here's a scenario that reproduces the issue.
> Using ccm create a single node cluster at 2.1.11:
> {{ccm create -n 1 -v 2.1.11 -s financial}}
> Run the following queries to create schema, populate some data and then
> delete some data for november:
> {noformat}
> drop keyspace if exists financial;
> create keyspace if not exists financial with replication = {'class':
> 'SimpleStrategy', 'replication_factor' : 1 };
> create table if not exists financial.symbol_history (
> symbol text,
> name text static,
> year int,
> month int,
> day int,
> volume bigint,
> close double,
> open double,
> low double,
> high double,
> primary key((symbol, year), month, day)
> ) with CLUSTERING ORDER BY (month desc, day desc);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 1, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 2, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 3, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 4, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 5, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 6, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 7, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 8, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 9, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 10, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 11, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 12, 1, 100);
> delete from financial.symbol_history where symbol='CORP' and year = 2004 and
> month=11;
> {noformat}
> Flush and run sstable2json on the sole Data.db file:
> {noformat}
> ccm node1 flush
> sstable2json /path/to/file.db
> {noformat}
> The output should look like the following:
> {code}
> [
> {"key": "CORP:2004",
> "cells": [["::name","MegaCorp",1449457517033030],
>["12:1:","",1449457517033030],
>["12:1:volume","100",1449457517033030],
>["11:_","11:!",1449457564983269,"t",1449457564],
>["10:1:","",1449457516313738],
>["10:1:volume","100",1449457516313738],
>["9:1:","",1449457516310205],
>["9:1:volume","100",1449457516310205],
>["8:1:","",1449457516235664],
>["8:1:volume","100",1449457516235664],
>["7:1:","",1449457516233535],
>["7:1:volume","100",1449457516233535],
>["6:1:","",1449457516231458],
>["6:1:volume","100",1449457516231458],
>["5:1:","",1449457516228307],
>["5:1:volume","100",1449457516228307],
>["4:1:","",1449457516225415],
>["4:1:volume","100",1449457516225415],
>["3:1:","",1449457516222811],
>["3:1:volume","100",1449457516222811],
>["2:1:","",1449457516220301],
>["2:1:volum
[3/4] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0
Merge branch 'cassandra-2.2' into cassandra-3.0 Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/65885e7f Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/65885e7f Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/65885e7f Branch: refs/heads/trunk Commit: 65885e7fc356c342331aec11667b5abdc28897b6 Parents: b55523e f166749 Author: Marcus Eriksson Authored: Fri Dec 11 17:34:21 2015 +0100 Committer: Marcus Eriksson Committed: Fri Dec 11 17:37:41 2015 +0100 -- CHANGES.txt | 3 + .../cassandra/db/compaction/CompactionInfo.java | 14 +- .../db/compaction/CompactionManager.java| 15 + .../cassandra/db/compaction/OperationType.java | 3 +- .../io/sstable/IndexSummaryManager.java | 279 +-- .../io/sstable/IndexSummaryRedistribution.java | 349 +++ .../io/sstable/IndexSummaryManagerTest.java | 80 - 7 files changed, 462 insertions(+), 281 deletions(-) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/65885e7f/CHANGES.txt -- diff --cc CHANGES.txt index 9c01160,5da0d42..5932dbb --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -1,34 -1,13 +1,37 @@@ -2.2.5 - * Fix regression in split size on CqlInputFormat (CASSANDRA-10835) - * Better handling of SSL connection errors inter-node (CASSANDRA-10816) - * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) - * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) ++3.0.2 + Merged from 2.1: + * Allow cancellation of index summary redistribution (CASSANDRA-8805) - * Fix Stress profile parsing on Windows (CASSANDRA-10808) - -2.2.4 +3.0.1 + * Avoid MV race during node decommission (CASSANDRA-10674) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Handle single-column deletions correction in materialized views + when the column is part of the view primary key (CASSANDRA-10796) + * Fix issue with datadir migration on upgrade (CASSANDRA-10788) + * Fix bug with range tombstones on reverse queries and test coverage for + AbstractBTreePartition (CASSANDRA-10059) + * Remove 64k limit on collection elements (CASSANDRA-10374) + * Remove unclear Indexer.indexes() method (CASSANDRA-10690) + * Fix NPE on stream read error (CASSANDRA-10771) + * Normalize cqlsh DESC output (CASSANDRA-10431) + * Rejects partition range deletions when columns are specified (CASSANDRA-10739) + * Fix error when saving cached key for old format sstable (CASSANDRA-10778) + * Invalidate prepared statements on DROP INDEX (CASSANDRA-10758) + * Fix SELECT statement with IN restrictions on partition key, + ORDER BY and LIMIT (CASSANDRA-10729) + * Improve stress performance over 1k threads (CASSANDRA-7217) + * Wait for migration responses to complete before bootstrapping (CASSANDRA-10731) + * Unable to create a function with argument of type Inet (CASSANDRA-10741) + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717) + * Correctly preserve deletion info on updated rows when notifying indexers + of single-row deletions (CASSANDRA-10694) + * Notify indexers of partition delete during cleanup (CASSANDRA-10685) + * Keep the file open in trySkipCache (CASSANDRA-10669) + * Updated trigger example (CASSANDRA-10257) +Merged from 2.2: + * Fix regression on split size in CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) + * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large buffers (CASSANDRA-10592) * Show CQL help in cqlsh in web browser (CASSANDRA-7225) * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775) * Reject index queries while the index is building (CASSANDRA-8505) http://git-wip-us.apache.org/repos/asf/cassandra/blob/65885e7f/src/java/org/apache/cassandra/db/compaction/CompactionManager.java -- diff --cc src/java/org/apache/cassandra/db/compaction/CompactionManager.java index 3ce7d2c,ba9c25e..bd950e3 --- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java +++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java @@@ -50,11 -47,7 +50,12 @@@ import org.apache.cassandra.db.view.Vie import org.apache.cassandra.dht.Bounds; import org.apache.cassandra.dht.Range; import org.apache.cassandra.dht.Token; -import org.apache.cassandra.io.sstable.*; +import org.apache.cassandra.index.SecondaryIndexBuilder; +import org.apache.cassandra.io.sstable.Descriptor; +import org.apache.cassandra.io.sstable.ISSTableScanner; ++import org.apache
[jira] [Updated] (CASSANDRA-10843) compaction data_size_tests are failing
[
https://issues.apache.org/jira/browse/CASSANDRA-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philip Thompson updated CASSANDRA-10843:
Description:
{{compaction_test.TestCompaction_with_LeveledCompactionStrategy.data_size_test}}
as well as the data_size tests for STCS and DTCS are failing. See
http://cassci.datastax.com/job/cassandra-2.1_dtest/373/testReport/
These tests write out some data, check live size, compact, then check live size
again. On 2.1 and 2.2, we are seeing an increase in live size after the
compaction. This is not occurring on 3.0. I cannot reproduce locally on OSX.
> compaction data_size_tests are failing
> --
>
> Key: CASSANDRA-10843
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10843
> Project: Cassandra
> Issue Type: Sub-task
> Components: Compaction, Testing
>Reporter: Philip Thompson
> Fix For: 2.1.x, 2.2.x
>
>
> {{compaction_test.TestCompaction_with_LeveledCompactionStrategy.data_size_test}}
> as well as the data_size tests for STCS and DTCS are failing. See
> http://cassci.datastax.com/job/cassandra-2.1_dtest/373/testReport/
> These tests write out some data, check live size, compact, then check live
> size again. On 2.1 and 2.2, we are seeing an increase in live size after the
> compaction. This is not occurring on 3.0. I cannot reproduce locally on OSX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10843) compaction data_size_tests are failing
[ https://issues.apache.org/jira/browse/CASSANDRA-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Thompson updated CASSANDRA-10843: Summary: compaction data_size_tests are failing (was: compa) > compaction data_size_tests are failing > -- > > Key: CASSANDRA-10843 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10843 > Project: Cassandra > Issue Type: Sub-task > Components: Compaction, Testing >Reporter: Philip Thompson > Fix For: 2.1.x, 2.2.x > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CASSANDRA-10843) compa
Philip Thompson created CASSANDRA-10843: --- Summary: compa Key: CASSANDRA-10843 URL: https://issues.apache.org/jira/browse/CASSANDRA-10843 Project: Cassandra Issue Type: Sub-task Components: Compaction, Testing Reporter: Philip Thompson Fix For: 2.1.x, 2.2.x -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[1/4] cassandra git commit: Allow cancellation of index summary redistribution
Repository: cassandra
Updated Branches:
refs/heads/trunk 2cd18ef5a -> 3f79c5baa
Allow cancellation of index summary redistribution
Patch by Carl Yeksigian; reviewed by marcuse for CASSANDRA-8805
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/fc7075a4
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/fc7075a4
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/fc7075a4
Branch: refs/heads/trunk
Commit: fc7075a41837301f3866333e0eb5c464715d888c
Parents: 95dab27
Author: Carl Yeksigian
Authored: Tue Dec 8 12:22:25 2015 -0500
Committer: Marcus Eriksson
Committed: Fri Dec 11 17:20:18 2015 +0100
--
CHANGES.txt | 1 +
.../cassandra/db/compaction/CompactionInfo.java | 14 +-
.../db/compaction/CompactionManager.java| 14 +
.../cassandra/db/compaction/OperationType.java | 3 +-
.../io/sstable/IndexSummaryManager.java | 265 +--
.../io/sstable/IndexSummaryRedistribution.java | 338 +++
.../io/sstable/IndexSummaryManagerTest.java | 69 +++-
7 files changed, 435 insertions(+), 269 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 46cda65..2ee8b07 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
index d086eef..e88143e 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
@@ -98,9 +98,17 @@ public final class CompactionInfo implements Serializable
public String toString()
{
StringBuilder buff = new StringBuilder();
-buff.append(getTaskType()).append('@').append(getId());
-buff.append('(').append(getKeyspace()).append(",
").append(getColumnFamily());
-buff.append(",
").append(getCompleted()).append('/').append(getTotal());
+buff.append(getTaskType());
+if (cfm != null)
+{
+buff.append('@').append(getId()).append('(');
+buff.append(getKeyspace()).append(",
").append(getColumnFamily()).append(", ");
+}
+else
+{
+buff.append('(');
+}
+buff.append(getCompleted()).append('/').append(getTotal());
return buff.append(')').append(unit).toString();
}
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
index 2630ba2..9bddaf5 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
@@ -1222,6 +1222,20 @@ public class CompactionManager implements
CompactionManagerMBean
return executor.submit(runnable);
}
+public List
runIndexSummaryRedistribution(IndexSummaryRedistribution redistribution) throws
IOException
+{
+metrics.beginCompaction(redistribution);
+
+try
+{
+return redistribution.redistributeSummaries();
+}
+finally
+{
+metrics.finishCompaction(redistribution);
+}
+}
+
static int getDefaultGcBefore(ColumnFamilyStore cfs)
{
// 2ndary indexes have ExpiringColumns too, so we need to purge
tombstones deleted before now. We do not need to
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/OperationType.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/OperationType.java
b/src/java/org/apache/cassandra/db/compaction/OperationType.java
index 15d18f6..475b591 100644
--- a/src/java/org/apache/cassandra/db/compaction/OperationType.java
+++ b/src/java/org/apache/cassandra/db/compaction/OperationType.java
@@ -31,7 +31,8 @@ public enum OperationType
/** Compaction for tombstone removal */
[2/3] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2
Merge branch 'cassandra-2.1' into cassandra-2.2
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f1667494
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f1667494
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f1667494
Branch: refs/heads/cassandra-3.0
Commit: f16674949592b518ba9da837b70665df10832e9b
Parents: 7dd6b7d fc7075a
Author: Marcus Eriksson
Authored: Fri Dec 11 17:32:31 2015 +0100
Committer: Marcus Eriksson
Committed: Fri Dec 11 17:32:31 2015 +0100
--
CHANGES.txt | 1 +
.../cassandra/db/compaction/CompactionInfo.java | 14 +-
.../db/compaction/CompactionManager.java| 14 +
.../cassandra/db/compaction/OperationType.java | 3 +-
.../io/sstable/IndexSummaryManager.java | 279 +--
.../io/sstable/IndexSummaryRedistribution.java | 349 +++
.../io/sstable/IndexSummaryManagerTest.java | 83 -
7 files changed, 459 insertions(+), 284 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/CHANGES.txt
--
diff --cc CHANGES.txt
index 30a76a9,2ee8b07..5da0d42
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,31 -1,10 +1,32 @@@
-2.1.13
- * Allow cancellation of index summary redistribution (CASSANDRA-8805)
+2.2.5
+ * Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
+ * Better handling of SSL connection errors inter-node (CASSANDRA-10816)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
+ * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761)
+Merged from 2.1:
++ * Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
-
-2.1.12
+2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
+ * Reject index queries while the index is building (CASSANDRA-8505)
+ * CQL.textile syntax incorrectly includes optional keyspace for aggregate
SFUNC and FINALFUNC (CASSANDRA-10747)
+ * Fix JSON update with prepared statements (CASSANDRA-10631)
+ * Don't do anticompaction after subrange repair (CASSANDRA-10422)
+ * Fix SimpleDateType type compatibility (CASSANDRA-10027)
+ * (Hadoop) fix splits calculation (CASSANDRA-10640)
+ * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
+ * (cqlsh) show partial trace if incomplete after max_trace_wait
(CASSANDRA-7645)
+ * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
+ * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
+ * Expose phi values from failure detector via JMX and tweak debug
+ and trace logging (CASSANDRA-9526)
+ * Fix RangeNamesQueryPager (CASSANDRA-10509)
+ * Deprecate Pig support (CASSANDRA-10542)
+ * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
+ * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large
buffers (CASSANDRA-10592)
+Merged from 2.1:
* Fix incremental repair hang when replica is down (CASSANDRA-10288)
* Avoid writing range tombstones after END_OF_ROW marker (CASSANDRA-10791)
* Optimize the way we check if a token is repaired in anticompaction
(CASSANDRA-10768)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
--
diff --cc src/java/org/apache/cassandra/db/compaction/CompactionManager.java
index 65f93c0,9bddaf5..ba9c25e
--- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
@@@ -1345,7 -1222,21 +1345,21 @@@ public class CompactionManager implemen
return executor.submit(runnable);
}
+ public List
runIndexSummaryRedistribution(IndexSummaryRedistribution redistribution) throws
IOException
+ {
+ metrics.beginCompaction(redistribution);
+
+ try
+ {
+ return redistribution.redistributeSummaries();
+ }
+ finally
+ {
+ metrics.finishCompaction(redistribution);
+ }
+ }
+
-static int getDefaultGcBefore(ColumnFamilyStore cfs)
+public static int getDefaultGcBefore(ColumnFamilyStore cfs)
{
// 2ndary indexes have ExpiringColumns too, so we need to purge
tombstones deleted before now. We do not need to
// add any G
[2/2] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2
Merge branch 'cassandra-2.1' into cassandra-2.2
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f1667494
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f1667494
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f1667494
Branch: refs/heads/cassandra-2.2
Commit: f16674949592b518ba9da837b70665df10832e9b
Parents: 7dd6b7d fc7075a
Author: Marcus Eriksson
Authored: Fri Dec 11 17:32:31 2015 +0100
Committer: Marcus Eriksson
Committed: Fri Dec 11 17:32:31 2015 +0100
--
CHANGES.txt | 1 +
.../cassandra/db/compaction/CompactionInfo.java | 14 +-
.../db/compaction/CompactionManager.java| 14 +
.../cassandra/db/compaction/OperationType.java | 3 +-
.../io/sstable/IndexSummaryManager.java | 279 +--
.../io/sstable/IndexSummaryRedistribution.java | 349 +++
.../io/sstable/IndexSummaryManagerTest.java | 83 -
7 files changed, 459 insertions(+), 284 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/CHANGES.txt
--
diff --cc CHANGES.txt
index 30a76a9,2ee8b07..5da0d42
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,31 -1,10 +1,32 @@@
-2.1.13
- * Allow cancellation of index summary redistribution (CASSANDRA-8805)
+2.2.5
+ * Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
+ * Better handling of SSL connection errors inter-node (CASSANDRA-10816)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
+ * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761)
+Merged from 2.1:
++ * Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
-
-2.1.12
+2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
+ * Reject index queries while the index is building (CASSANDRA-8505)
+ * CQL.textile syntax incorrectly includes optional keyspace for aggregate
SFUNC and FINALFUNC (CASSANDRA-10747)
+ * Fix JSON update with prepared statements (CASSANDRA-10631)
+ * Don't do anticompaction after subrange repair (CASSANDRA-10422)
+ * Fix SimpleDateType type compatibility (CASSANDRA-10027)
+ * (Hadoop) fix splits calculation (CASSANDRA-10640)
+ * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
+ * (cqlsh) show partial trace if incomplete after max_trace_wait
(CASSANDRA-7645)
+ * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
+ * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
+ * Expose phi values from failure detector via JMX and tweak debug
+ and trace logging (CASSANDRA-9526)
+ * Fix RangeNamesQueryPager (CASSANDRA-10509)
+ * Deprecate Pig support (CASSANDRA-10542)
+ * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
+ * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large
buffers (CASSANDRA-10592)
+Merged from 2.1:
* Fix incremental repair hang when replica is down (CASSANDRA-10288)
* Avoid writing range tombstones after END_OF_ROW marker (CASSANDRA-10791)
* Optimize the way we check if a token is repaired in anticompaction
(CASSANDRA-10768)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
--
diff --cc src/java/org/apache/cassandra/db/compaction/CompactionManager.java
index 65f93c0,9bddaf5..ba9c25e
--- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
@@@ -1345,7 -1222,21 +1345,21 @@@ public class CompactionManager implemen
return executor.submit(runnable);
}
+ public List
runIndexSummaryRedistribution(IndexSummaryRedistribution redistribution) throws
IOException
+ {
+ metrics.beginCompaction(redistribution);
+
+ try
+ {
+ return redistribution.redistributeSummaries();
+ }
+ finally
+ {
+ metrics.finishCompaction(redistribution);
+ }
+ }
+
-static int getDefaultGcBefore(ColumnFamilyStore cfs)
+public static int getDefaultGcBefore(ColumnFamilyStore cfs)
{
// 2ndary indexes have ExpiringColumns too, so we need to purge
tombstones deleted before now. We do not need to
// add any G
[4/4] cassandra git commit: Merge branch 'cassandra-3.0' into trunk
Merge branch 'cassandra-3.0' into trunk Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/3f79c5ba Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/3f79c5ba Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/3f79c5ba Branch: refs/heads/trunk Commit: 3f79c5baae355924866b4997b18960b6590f5763 Parents: 2cd18ef 65885e7 Author: Marcus Eriksson Authored: Fri Dec 11 17:43:02 2015 +0100 Committer: Marcus Eriksson Committed: Fri Dec 11 17:43:02 2015 +0100 -- CHANGES.txt | 2 + .../cassandra/db/compaction/CompactionInfo.java | 14 +- .../db/compaction/CompactionManager.java| 15 + .../cassandra/db/compaction/OperationType.java | 3 +- .../io/sstable/IndexSummaryManager.java | 279 +-- .../io/sstable/IndexSummaryRedistribution.java | 349 +++ .../io/sstable/IndexSummaryManagerTest.java | 80 - 7 files changed, 461 insertions(+), 281 deletions(-) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/3f79c5ba/CHANGES.txt -- diff --cc CHANGES.txt index 296d3cd,5932dbb..fad4bb2 --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -1,23 -1,7 +1,25 @@@ -3.0.2 +3.2 + * Add compressor name in sstablemetadata output (CASSANDRA-9879) + * Fix type casting for counter columns (CASSANDRA-10824) + * Prevent running Cassandra as root (CASSANDRA-8142) + * bound maximum in-flight commit log replay mutation bytes to 64 megabytes (CASSANDRA-8639) + * Normalize all scripts (CASSANDRA-10679) + * Make compression ratio much more accurate (CASSANDRA-10225) + * Optimize building of Clustering object when only one is created (CASSANDRA-10409) + * Make index building pluggable (CASSANDRA-10681) + * Add sstable flush observer (CASSANDRA-10678) + * Improve NTS endpoints calculation (CASSANDRA-10200) + * Improve performance of the folderSize function (CASSANDRA-10677) + * Add support for type casting in selection clause (CASSANDRA-10310) + * Added graphing option to cassandra-stress (CASSANDRA-7918) + * Abort in-progress queries that time out (CASSANDRA-7392) + * Add transparent data encryption core classes (CASSANDRA-9945) + Merged from 2.1: + * Allow cancellation of index summary redistribution (CASSANDRA-8805) -3.0.1 + + +3.1 +Merged from 3.0: * Avoid MV race during node decommission (CASSANDRA-10674) * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) * Handle single-column deletions correction in materialized views http://git-wip-us.apache.org/repos/asf/cassandra/blob/3f79c5ba/src/java/org/apache/cassandra/db/compaction/CompactionManager.java --
[2/4] cassandra git commit: Merge branch 'cassandra-2.1' into cassandra-2.2
Merge branch 'cassandra-2.1' into cassandra-2.2
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f1667494
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f1667494
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f1667494
Branch: refs/heads/trunk
Commit: f16674949592b518ba9da837b70665df10832e9b
Parents: 7dd6b7d fc7075a
Author: Marcus Eriksson
Authored: Fri Dec 11 17:32:31 2015 +0100
Committer: Marcus Eriksson
Committed: Fri Dec 11 17:32:31 2015 +0100
--
CHANGES.txt | 1 +
.../cassandra/db/compaction/CompactionInfo.java | 14 +-
.../db/compaction/CompactionManager.java| 14 +
.../cassandra/db/compaction/OperationType.java | 3 +-
.../io/sstable/IndexSummaryManager.java | 279 +--
.../io/sstable/IndexSummaryRedistribution.java | 349 +++
.../io/sstable/IndexSummaryManagerTest.java | 83 -
7 files changed, 459 insertions(+), 284 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/CHANGES.txt
--
diff --cc CHANGES.txt
index 30a76a9,2ee8b07..5da0d42
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,31 -1,10 +1,32 @@@
-2.1.13
- * Allow cancellation of index summary redistribution (CASSANDRA-8805)
+2.2.5
+ * Fix regression in split size on CqlInputFormat (CASSANDRA-10835)
+ * Better handling of SSL connection errors inter-node (CASSANDRA-10816)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
+ * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761)
+Merged from 2.1:
++ * Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
-
-2.1.12
+2.2.4
+ * Show CQL help in cqlsh in web browser (CASSANDRA-7225)
+ * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775)
+ * Reject index queries while the index is building (CASSANDRA-8505)
+ * CQL.textile syntax incorrectly includes optional keyspace for aggregate
SFUNC and FINALFUNC (CASSANDRA-10747)
+ * Fix JSON update with prepared statements (CASSANDRA-10631)
+ * Don't do anticompaction after subrange repair (CASSANDRA-10422)
+ * Fix SimpleDateType type compatibility (CASSANDRA-10027)
+ * (Hadoop) fix splits calculation (CASSANDRA-10640)
+ * (Hadoop) ensure that Cluster instances are always closed (CASSANDRA-10058)
+ * (cqlsh) show partial trace if incomplete after max_trace_wait
(CASSANDRA-7645)
+ * Use most up-to-date version of schema for system tables (CASSANDRA-10652)
+ * Deprecate memory_allocator in cassandra.yaml (CASSANDRA-10581,10628)
+ * Expose phi values from failure detector via JMX and tweak debug
+ and trace logging (CASSANDRA-9526)
+ * Fix RangeNamesQueryPager (CASSANDRA-10509)
+ * Deprecate Pig support (CASSANDRA-10542)
+ * Reduce contention getting instances of CompositeType (CASSANDRA-10433)
+ * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large
buffers (CASSANDRA-10592)
+Merged from 2.1:
* Fix incremental repair hang when replica is down (CASSANDRA-10288)
* Avoid writing range tombstones after END_OF_ROW marker (CASSANDRA-10791)
* Optimize the way we check if a token is repaired in anticompaction
(CASSANDRA-10768)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/f1667494/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
--
diff --cc src/java/org/apache/cassandra/db/compaction/CompactionManager.java
index 65f93c0,9bddaf5..ba9c25e
--- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
@@@ -1345,7 -1222,21 +1345,21 @@@ public class CompactionManager implemen
return executor.submit(runnable);
}
+ public List
runIndexSummaryRedistribution(IndexSummaryRedistribution redistribution) throws
IOException
+ {
+ metrics.beginCompaction(redistribution);
+
+ try
+ {
+ return redistribution.redistributeSummaries();
+ }
+ finally
+ {
+ metrics.finishCompaction(redistribution);
+ }
+ }
+
-static int getDefaultGcBefore(ColumnFamilyStore cfs)
+public static int getDefaultGcBefore(ColumnFamilyStore cfs)
{
// 2ndary indexes have ExpiringColumns too, so we need to purge
tombstones deleted before now. We do not need to
// add any GcGrace h
[1/3] cassandra git commit: Allow cancellation of index summary redistribution
Repository: cassandra
Updated Branches:
refs/heads/cassandra-3.0 b55523e97 -> 65885e7fc
Allow cancellation of index summary redistribution
Patch by Carl Yeksigian; reviewed by marcuse for CASSANDRA-8805
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/fc7075a4
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/fc7075a4
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/fc7075a4
Branch: refs/heads/cassandra-3.0
Commit: fc7075a41837301f3866333e0eb5c464715d888c
Parents: 95dab27
Author: Carl Yeksigian
Authored: Tue Dec 8 12:22:25 2015 -0500
Committer: Marcus Eriksson
Committed: Fri Dec 11 17:20:18 2015 +0100
--
CHANGES.txt | 1 +
.../cassandra/db/compaction/CompactionInfo.java | 14 +-
.../db/compaction/CompactionManager.java| 14 +
.../cassandra/db/compaction/OperationType.java | 3 +-
.../io/sstable/IndexSummaryManager.java | 265 +--
.../io/sstable/IndexSummaryRedistribution.java | 338 +++
.../io/sstable/IndexSummaryManagerTest.java | 69 +++-
7 files changed, 435 insertions(+), 269 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 46cda65..2ee8b07 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
index d086eef..e88143e 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
@@ -98,9 +98,17 @@ public final class CompactionInfo implements Serializable
public String toString()
{
StringBuilder buff = new StringBuilder();
-buff.append(getTaskType()).append('@').append(getId());
-buff.append('(').append(getKeyspace()).append(",
").append(getColumnFamily());
-buff.append(",
").append(getCompleted()).append('/').append(getTotal());
+buff.append(getTaskType());
+if (cfm != null)
+{
+buff.append('@').append(getId()).append('(');
+buff.append(getKeyspace()).append(",
").append(getColumnFamily()).append(", ");
+}
+else
+{
+buff.append('(');
+}
+buff.append(getCompleted()).append('/').append(getTotal());
return buff.append(')').append(unit).toString();
}
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
index 2630ba2..9bddaf5 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
@@ -1222,6 +1222,20 @@ public class CompactionManager implements
CompactionManagerMBean
return executor.submit(runnable);
}
+public List
runIndexSummaryRedistribution(IndexSummaryRedistribution redistribution) throws
IOException
+{
+metrics.beginCompaction(redistribution);
+
+try
+{
+return redistribution.redistributeSummaries();
+}
+finally
+{
+metrics.finishCompaction(redistribution);
+}
+}
+
static int getDefaultGcBefore(ColumnFamilyStore cfs)
{
// 2ndary indexes have ExpiringColumns too, so we need to purge
tombstones deleted before now. We do not need to
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/OperationType.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/OperationType.java
b/src/java/org/apache/cassandra/db/compaction/OperationType.java
index 15d18f6..475b591 100644
--- a/src/java/org/apache/cassandra/db/compaction/OperationType.java
+++ b/src/java/org/apache/cassandra/db/compaction/OperationType.java
@@ -31,7 +31,8 @@ public enum OperationType
/** Compaction for tombstone
[1/2] cassandra git commit: Allow cancellation of index summary redistribution
Repository: cassandra
Updated Branches:
refs/heads/cassandra-2.2 7dd6b7de2 -> f16674949
Allow cancellation of index summary redistribution
Patch by Carl Yeksigian; reviewed by marcuse for CASSANDRA-8805
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/fc7075a4
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/fc7075a4
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/fc7075a4
Branch: refs/heads/cassandra-2.2
Commit: fc7075a41837301f3866333e0eb5c464715d888c
Parents: 95dab27
Author: Carl Yeksigian
Authored: Tue Dec 8 12:22:25 2015 -0500
Committer: Marcus Eriksson
Committed: Fri Dec 11 17:20:18 2015 +0100
--
CHANGES.txt | 1 +
.../cassandra/db/compaction/CompactionInfo.java | 14 +-
.../db/compaction/CompactionManager.java| 14 +
.../cassandra/db/compaction/OperationType.java | 3 +-
.../io/sstable/IndexSummaryManager.java | 265 +--
.../io/sstable/IndexSummaryRedistribution.java | 338 +++
.../io/sstable/IndexSummaryManagerTest.java | 69 +++-
7 files changed, 435 insertions(+), 269 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 46cda65..2ee8b07 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
index d086eef..e88143e 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
@@ -98,9 +98,17 @@ public final class CompactionInfo implements Serializable
public String toString()
{
StringBuilder buff = new StringBuilder();
-buff.append(getTaskType()).append('@').append(getId());
-buff.append('(').append(getKeyspace()).append(",
").append(getColumnFamily());
-buff.append(",
").append(getCompleted()).append('/').append(getTotal());
+buff.append(getTaskType());
+if (cfm != null)
+{
+buff.append('@').append(getId()).append('(');
+buff.append(getKeyspace()).append(",
").append(getColumnFamily()).append(", ");
+}
+else
+{
+buff.append('(');
+}
+buff.append(getCompleted()).append('/').append(getTotal());
return buff.append(')').append(unit).toString();
}
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
index 2630ba2..9bddaf5 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
@@ -1222,6 +1222,20 @@ public class CompactionManager implements
CompactionManagerMBean
return executor.submit(runnable);
}
+public List
runIndexSummaryRedistribution(IndexSummaryRedistribution redistribution) throws
IOException
+{
+metrics.beginCompaction(redistribution);
+
+try
+{
+return redistribution.redistributeSummaries();
+}
+finally
+{
+metrics.finishCompaction(redistribution);
+}
+}
+
static int getDefaultGcBefore(ColumnFamilyStore cfs)
{
// 2ndary indexes have ExpiringColumns too, so we need to purge
tombstones deleted before now. We do not need to
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/OperationType.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/OperationType.java
b/src/java/org/apache/cassandra/db/compaction/OperationType.java
index 15d18f6..475b591 100644
--- a/src/java/org/apache/cassandra/db/compaction/OperationType.java
+++ b/src/java/org/apache/cassandra/db/compaction/OperationType.java
@@ -31,7 +31,8 @@ public enum OperationType
/** Compaction for tombstone
[3/3] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0
Merge branch 'cassandra-2.2' into cassandra-3.0 Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/65885e7f Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/65885e7f Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/65885e7f Branch: refs/heads/cassandra-3.0 Commit: 65885e7fc356c342331aec11667b5abdc28897b6 Parents: b55523e f166749 Author: Marcus Eriksson Authored: Fri Dec 11 17:34:21 2015 +0100 Committer: Marcus Eriksson Committed: Fri Dec 11 17:37:41 2015 +0100 -- CHANGES.txt | 3 + .../cassandra/db/compaction/CompactionInfo.java | 14 +- .../db/compaction/CompactionManager.java| 15 + .../cassandra/db/compaction/OperationType.java | 3 +- .../io/sstable/IndexSummaryManager.java | 279 +-- .../io/sstable/IndexSummaryRedistribution.java | 349 +++ .../io/sstable/IndexSummaryManagerTest.java | 80 - 7 files changed, 462 insertions(+), 281 deletions(-) -- http://git-wip-us.apache.org/repos/asf/cassandra/blob/65885e7f/CHANGES.txt -- diff --cc CHANGES.txt index 9c01160,5da0d42..5932dbb --- a/CHANGES.txt +++ b/CHANGES.txt @@@ -1,34 -1,13 +1,37 @@@ -2.2.5 - * Fix regression in split size on CqlInputFormat (CASSANDRA-10835) - * Better handling of SSL connection errors inter-node (CASSANDRA-10816) - * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) - * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) ++3.0.2 + Merged from 2.1: + * Allow cancellation of index summary redistribution (CASSANDRA-8805) - * Fix Stress profile parsing on Windows (CASSANDRA-10808) - -2.2.4 +3.0.1 + * Avoid MV race during node decommission (CASSANDRA-10674) + * Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474) + * Handle single-column deletions correction in materialized views + when the column is part of the view primary key (CASSANDRA-10796) + * Fix issue with datadir migration on upgrade (CASSANDRA-10788) + * Fix bug with range tombstones on reverse queries and test coverage for + AbstractBTreePartition (CASSANDRA-10059) + * Remove 64k limit on collection elements (CASSANDRA-10374) + * Remove unclear Indexer.indexes() method (CASSANDRA-10690) + * Fix NPE on stream read error (CASSANDRA-10771) + * Normalize cqlsh DESC output (CASSANDRA-10431) + * Rejects partition range deletions when columns are specified (CASSANDRA-10739) + * Fix error when saving cached key for old format sstable (CASSANDRA-10778) + * Invalidate prepared statements on DROP INDEX (CASSANDRA-10758) + * Fix SELECT statement with IN restrictions on partition key, + ORDER BY and LIMIT (CASSANDRA-10729) + * Improve stress performance over 1k threads (CASSANDRA-7217) + * Wait for migration responses to complete before bootstrapping (CASSANDRA-10731) + * Unable to create a function with argument of type Inet (CASSANDRA-10741) + * Fix backward incompatibiliy in CqlInputFormat (CASSANDRA-10717) + * Correctly preserve deletion info on updated rows when notifying indexers + of single-row deletions (CASSANDRA-10694) + * Notify indexers of partition delete during cleanup (CASSANDRA-10685) + * Keep the file open in trySkipCache (CASSANDRA-10669) + * Updated trigger example (CASSANDRA-10257) +Merged from 2.2: + * Fix regression on split size in CqlInputFormat (CASSANDRA-10835) + * Better handling of SSL connection errors inter-node (CASSANDRA-10816) + * Verify tables in pseudo-system keyspaces at startup (CASSANDRA-10761) + * Fix IllegalArgumentException in DataOutputBuffer.reallocate for large buffers (CASSANDRA-10592) * Show CQL help in cqlsh in web browser (CASSANDRA-7225) * Serialize on disk the proper SSTable compression ratio (CASSANDRA-10775) * Reject index queries while the index is building (CASSANDRA-8505) http://git-wip-us.apache.org/repos/asf/cassandra/blob/65885e7f/src/java/org/apache/cassandra/db/compaction/CompactionManager.java -- diff --cc src/java/org/apache/cassandra/db/compaction/CompactionManager.java index 3ce7d2c,ba9c25e..bd950e3 --- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java +++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java @@@ -50,11 -47,7 +50,12 @@@ import org.apache.cassandra.db.view.Vie import org.apache.cassandra.dht.Bounds; import org.apache.cassandra.dht.Range; import org.apache.cassandra.dht.Token; -import org.apache.cassandra.io.sstable.*; +import org.apache.cassandra.index.SecondaryIndexBuilder; +import org.apache.cassandra.io.sstable.Descriptor; +import org.apache.cassandra.io.sstable.ISSTableScanner; ++import or
cassandra git commit: Allow cancellation of index summary redistribution
Repository: cassandra
Updated Branches:
refs/heads/cassandra-2.1 95dab2730 -> fc7075a41
Allow cancellation of index summary redistribution
Patch by Carl Yeksigian; reviewed by marcuse for CASSANDRA-8805
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/fc7075a4
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/fc7075a4
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/fc7075a4
Branch: refs/heads/cassandra-2.1
Commit: fc7075a41837301f3866333e0eb5c464715d888c
Parents: 95dab27
Author: Carl Yeksigian
Authored: Tue Dec 8 12:22:25 2015 -0500
Committer: Marcus Eriksson
Committed: Fri Dec 11 17:20:18 2015 +0100
--
CHANGES.txt | 1 +
.../cassandra/db/compaction/CompactionInfo.java | 14 +-
.../db/compaction/CompactionManager.java| 14 +
.../cassandra/db/compaction/OperationType.java | 3 +-
.../io/sstable/IndexSummaryManager.java | 265 +--
.../io/sstable/IndexSummaryRedistribution.java | 338 +++
.../io/sstable/IndexSummaryManagerTest.java | 69 +++-
7 files changed, 435 insertions(+), 269 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 46cda65..2ee8b07 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
2.1.13
+ * Allow cancellation of index summary redistribution (CASSANDRA-8805)
* Disable reloading of GossipingPropertyFileSnitch (CASSANDRA-9474)
* Fix Stress profile parsing on Windows (CASSANDRA-10808)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
index d086eef..e88143e 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionInfo.java
@@ -98,9 +98,17 @@ public final class CompactionInfo implements Serializable
public String toString()
{
StringBuilder buff = new StringBuilder();
-buff.append(getTaskType()).append('@').append(getId());
-buff.append('(').append(getKeyspace()).append(",
").append(getColumnFamily());
-buff.append(",
").append(getCompleted()).append('/').append(getTotal());
+buff.append(getTaskType());
+if (cfm != null)
+{
+buff.append('@').append(getId()).append('(');
+buff.append(getKeyspace()).append(",
").append(getColumnFamily()).append(", ");
+}
+else
+{
+buff.append('(');
+}
+buff.append(getCompleted()).append('/').append(getTotal());
return buff.append(')').append(unit).toString();
}
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
index 2630ba2..9bddaf5 100644
--- a/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
+++ b/src/java/org/apache/cassandra/db/compaction/CompactionManager.java
@@ -1222,6 +1222,20 @@ public class CompactionManager implements
CompactionManagerMBean
return executor.submit(runnable);
}
+public List
runIndexSummaryRedistribution(IndexSummaryRedistribution redistribution) throws
IOException
+{
+metrics.beginCompaction(redistribution);
+
+try
+{
+return redistribution.redistributeSummaries();
+}
+finally
+{
+metrics.finishCompaction(redistribution);
+}
+}
+
static int getDefaultGcBefore(ColumnFamilyStore cfs)
{
// 2ndary indexes have ExpiringColumns too, so we need to purge
tombstones deleted before now. We do not need to
http://git-wip-us.apache.org/repos/asf/cassandra/blob/fc7075a4/src/java/org/apache/cassandra/db/compaction/OperationType.java
--
diff --git a/src/java/org/apache/cassandra/db/compaction/OperationType.java
b/src/java/org/apache/cassandra/db/compaction/OperationType.java
index 15d18f6..475b591 100644
--- a/src/java/org/apache/cassandra/db/compaction/OperationType.java
+++ b/src/java/org/apache/cassandra/db/compaction/OperationType.java
@@ -31,7 +31,8 @@ public enum OperationType
/** Compaction for tombstone
[jira] [Updated] (CASSANDRA-10837) Cluster/session should be closed in Cassandra Hadoop Input/Output classes
[
https://issues.apache.org/jira/browse/CASSANDRA-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksey Yeschenko updated CASSANDRA-10837:
--
Reviewer: Benjamin Lerer
> Cluster/session should be closed in Cassandra Hadoop Input/Output classes
> -
>
> Key: CASSANDRA-10837
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10837
> Project: Cassandra
> Issue Type: Bug
>Reporter: Alex Liu
>Assignee: Alex Liu
> Attachments: 10837-3.0-branch.txt, 10837-v2-3.0-branch.txt
>
>
> See a lot of following warnings during Hadoop job running
> {code}
> ERROR 11:37:45 LEAK: You are creating too many HashedWheelTimer instances.
> HashedWheelTimer is a shared resource that must be reused across the JVM,so
> that only a few instances are created.
> {code}
> Each cluster/session needs be closed and a shared HashedWheelTimer may reduce
> the resource leakage.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10838) print 3.0 statistics in sstablemetadata command output
[ https://issues.apache.org/jira/browse/CASSANDRA-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua McKenzie updated CASSANDRA-10838: Reviewer: Yuki Morishita > print 3.0 statistics in sstablemetadata command output > -- > > Key: CASSANDRA-10838 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10838 > Project: Cassandra > Issue Type: Improvement > Components: Tools >Reporter: Shogo Hoshii >Priority: Minor > Fix For: 3.x > > Attachments: CASSANDRA-10838.txt, sample_result.txt > > > In CASSANDRA-7159, some statistics were added in 2.1.x, and in version 3.0, > we can print additional statistics. > So I would like to print them in sstablemetadata output. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10725) Stress gives "Unknown keyspace" error when a map type is used in user profile
[
https://issues.apache.org/jira/browse/CASSANDRA-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052984#comment-15052984
]
T Jake Luciani commented on CASSANDRA-10725:
This looks like a duplicate of CASSANDRA-9984
> Stress gives "Unknown keyspace" error when a map type is used in user profile
> -
>
> Key: CASSANDRA-10725
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10725
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
>Reporter: Sebastian Estevez
>Assignee: Michael Edge
>Priority: Minor
> Labels: stress, tools
> Fix For: 2.2.x, 3.x
>
> Attachments: CASSANDRA-3.0-10725-Cassandra-Stress.patch
>
>
> Steps to reproduce:
> copy the following stress.yaml:
> {code}# Keyspace Name
> keyspace: autogeneratedtest
>
> # The CQL for creating a keyspace (optional if it already exists)
> keyspace_definition: |
> CREATE KEYSPACE autogeneratedtest WITH replication = {'class':
> 'SimpleStrategy', 'replication_factor': 1};
>
> # Table name
> table: smartcity_data
>
> # The CQL for creating a table you wish to stress (optional if it already
> exists)
> table_definition:
> CREATE TABLE smartcity_data (
> device text,
> reporter text,
> time timestamp,
> data_ map,
> metadata_ text,
> solr_query text,
> timeack timestamp,
> timefalse timestamp,
> timeresolved timestamp,
> PRIMARY KEY (device, reporter, time)
> )
> ### Column Distribution Specifications ###
>
> columnspec:
> - name: device
> size: fixed(10)
> population: uniform(1..10)
>
> - name: reporter
> size: fixed(10)
> population: uniform(1..10)
>
> - name: time
> size: fixed(10)
> population: uniform(1..10)
>
> - name: data_
> size: fixed(10)
> population: uniform(1..10)
>
> - name: metadata_
> size: fixed(10)
> population: uniform(1..10)
>
> - name: solr_query
> size: fixed(10)
> population: uniform(1..10)
>
> - name: timeack
> size: fixed(10)
> population: uniform(1..10)
>
> - name: timefalse
> size: fixed(10)
> population: uniform(1..10)
>
> - name: timeresolved
> size: fixed(10)
> population: uniform(1..10)
>
>
> ### Batch Ratio Distribution Specifications ###
>
> insert:
> partitions: fixed(1)# Our partition key is the domain so only
> insert one per batch
>
> select: fixed(1)/1000# We have 1000 posts per domain so 1/1000
> will allow 1 post per batch
>
> batchtype: UNLOGGED # Unlogged batches
>
>
> #
> # A list of queries you wish to run against the schema
> #
> queries:
>likelyquery0:
> cql: Select * from smartcity_data where device = ?
> fields: samerow
>likelyquery1:
> cql: Select * from smartcity_data where device = ? and reporter = ?
> fields: samerow
>likelyquery2:
> cql: Select * from smartcity_data where device = ? and reporter = ? and
> time = ?
> fields: samerow{code}
> and run:
> {code}cassandra-stress user profile=stress.yaml ops\(insert=1\) n=10 -rate
> threads=1
> There was a problem parsing the table cql: Unknown keyspace
> autogeneratedtest{code}
> You'll see the following error:
> {quote}
> There was a problem parsing the table cql: Unknown keyspace autogeneratedtest
> {quote}
> The error should instead state:
> {quote}Maps are not currently supported in cassandra-stress{quote}
> If you replace `data_ map`, with `data_ text` it works fine.
> Related: CASSANDRA-9091
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10795) Improve Failure Detector Unknown EP message
[ https://issues.apache.org/jira/browse/CASSANDRA-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua McKenzie updated CASSANDRA-10795: Reviewer: Carl Yeksigian > Improve Failure Detector Unknown EP message > --- > > Key: CASSANDRA-10795 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10795 > Project: Cassandra > Issue Type: Bug >Reporter: Anthony Cozzie >Assignee: Anthony Cozzie >Priority: Minor > Fix For: 3.2 > > Attachments: trunk-10795.txt > > > When the failure detector is asked whether an unknown endpoint is alive, it > prints an uninformative error message. This patch adds a stack trace to the > print statement. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10793) ohc should be in the all-pom section of build.xml
[ https://issues.apache.org/jira/browse/CASSANDRA-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Yeschenko updated CASSANDRA-10793: -- Reviewer: Jeremiah Jordan > ohc should be in the all-pom section of build.xml > - > > Key: CASSANDRA-10793 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10793 > Project: Cassandra > Issue Type: Bug > Components: Packaging >Reporter: Jeremiah Jordan >Assignee: Robert Stupp > Fix For: 3.0.x > > > ohc-core/ohc-core-j8 should be included in the section of the build.xml. Otherwise when getting cassandra-all from maven > row cache doesn't work. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-9318) Bound the number of in-flight requests at the coordinator
[ https://issues.apache.org/jira/browse/CASSANDRA-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ariel Weisberg updated CASSANDRA-9318: -- Component/s: Streaming and Messaging Local Write-Read Paths > Bound the number of in-flight requests at the coordinator > - > > Key: CASSANDRA-9318 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9318 > Project: Cassandra > Issue Type: Improvement > Components: Local Write-Read Paths, Streaming and Messaging >Reporter: Ariel Weisberg >Assignee: Ariel Weisberg > Fix For: 2.1.x, 2.2.x > > > It's possible to somewhat bound the amount of load accepted into the cluster > by bounding the number of in-flight requests and request bytes. > An implementation might do something like track the number of outstanding > bytes and requests and if it reaches a high watermark disable read on client > connections until it goes back below some low watermark. > Need to make sure that disabling read on the client connection won't > introduce other issues. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10750) Minor code improvements
[ https://issues.apache.org/jira/browse/CASSANDRA-10750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua McKenzie updated CASSANDRA-10750: Reviewer: Stefania > Minor code improvements > --- > > Key: CASSANDRA-10750 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10750 > Project: Cassandra > Issue Type: Improvement >Reporter: Robert Stupp >Assignee: Robert Stupp >Priority: Minor > > Went though several IDE inspections and found some places in the code that > could be improved. These are just minor improvements and no bug fixes (except > one minor "theoretical" thing). > The [branch on github against > trunk|https://github.com/snazy/cassandra/tree/10750-code-opts-trunk] contains > a series of commits: > * simplify Mutation.apply to remove the casts > * "minor code improvements" just replaces some expressions that are > effectively constant > * remove unused assignments (probably just cosmetic) > * collapse identical if-branches (probably just cosmetic) > * empty array constants > * fix printf usage (could potentially raise an exception in printf) > * replace tail-recursion in some critical sections (as the JVM cannot > optimize that AFAIK) > * remove methods identical to their super methods (probably just cosmetic) > [cassci results > here|http://cassci.datastax.com/view/Dev/view/snazy/search/?q=snazy-10750-] -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10725) Stress gives "Unknown keyspace" error when a map type is used in user profile
[
https://issues.apache.org/jira/browse/CASSANDRA-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joshua McKenzie updated CASSANDRA-10725:
Reviewer: T Jake Luciani
> Stress gives "Unknown keyspace" error when a map type is used in user profile
> -
>
> Key: CASSANDRA-10725
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10725
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
>Reporter: Sebastian Estevez
>Assignee: Michael Edge
>Priority: Minor
> Labels: stress, tools
> Fix For: 2.2.x, 3.x
>
> Attachments: CASSANDRA-3.0-10725-Cassandra-Stress.patch
>
>
> Steps to reproduce:
> copy the following stress.yaml:
> {code}# Keyspace Name
> keyspace: autogeneratedtest
>
> # The CQL for creating a keyspace (optional if it already exists)
> keyspace_definition: |
> CREATE KEYSPACE autogeneratedtest WITH replication = {'class':
> 'SimpleStrategy', 'replication_factor': 1};
>
> # Table name
> table: smartcity_data
>
> # The CQL for creating a table you wish to stress (optional if it already
> exists)
> table_definition:
> CREATE TABLE smartcity_data (
> device text,
> reporter text,
> time timestamp,
> data_ map,
> metadata_ text,
> solr_query text,
> timeack timestamp,
> timefalse timestamp,
> timeresolved timestamp,
> PRIMARY KEY (device, reporter, time)
> )
> ### Column Distribution Specifications ###
>
> columnspec:
> - name: device
> size: fixed(10)
> population: uniform(1..10)
>
> - name: reporter
> size: fixed(10)
> population: uniform(1..10)
>
> - name: time
> size: fixed(10)
> population: uniform(1..10)
>
> - name: data_
> size: fixed(10)
> population: uniform(1..10)
>
> - name: metadata_
> size: fixed(10)
> population: uniform(1..10)
>
> - name: solr_query
> size: fixed(10)
> population: uniform(1..10)
>
> - name: timeack
> size: fixed(10)
> population: uniform(1..10)
>
> - name: timefalse
> size: fixed(10)
> population: uniform(1..10)
>
> - name: timeresolved
> size: fixed(10)
> population: uniform(1..10)
>
>
> ### Batch Ratio Distribution Specifications ###
>
> insert:
> partitions: fixed(1)# Our partition key is the domain so only
> insert one per batch
>
> select: fixed(1)/1000# We have 1000 posts per domain so 1/1000
> will allow 1 post per batch
>
> batchtype: UNLOGGED # Unlogged batches
>
>
> #
> # A list of queries you wish to run against the schema
> #
> queries:
>likelyquery0:
> cql: Select * from smartcity_data where device = ?
> fields: samerow
>likelyquery1:
> cql: Select * from smartcity_data where device = ? and reporter = ?
> fields: samerow
>likelyquery2:
> cql: Select * from smartcity_data where device = ? and reporter = ? and
> time = ?
> fields: samerow{code}
> and run:
> {code}cassandra-stress user profile=stress.yaml ops\(insert=1\) n=10 -rate
> threads=1
> There was a problem parsing the table cql: Unknown keyspace
> autogeneratedtest{code}
> You'll see the following error:
> {quote}
> There was a problem parsing the table cql: Unknown keyspace autogeneratedtest
> {quote}
> The error should instead state:
> {quote}Maps are not currently supported in cassandra-stress{quote}
> If you replace `data_ map`, with `data_ text` it works fine.
> Related: CASSANDRA-9091
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-9179) Unable to "point in time" restore if table/cf has been recreated
[ https://issues.apache.org/jira/browse/CASSANDRA-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Lebresne updated CASSANDRA-9179: Reviewer: Marcus Eriksson Component/s: (was: CQL) > Unable to "point in time" restore if table/cf has been recreated > > > Key: CASSANDRA-9179 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9179 > Project: Cassandra > Issue Type: Bug > Components: CQL, Distributed Metadata >Reporter: Jon Moses >Assignee: Branimir Lambov > Labels: doc-impacting > > With Cassandra 2.1, and the addition of the CF UUID, the ability to do a > "point in time" restore by restoring a snapshot and replaying commitlogs is > lost if the table has been dropped and recreated. > When the table is recreated, the cf_id changes, and the commitlog replay > mechanism skips the desired mutations as the cf_id no longer matches what's > present in the schema. > There should exist a way to inform the replay that you want the mutations > replayed even if the cf_id doesn't match. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10593) Unintended interactions between commitlog archiving and commitlog recycling
[
https://issues.apache.org/jira/browse/CASSANDRA-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joshua McKenzie updated CASSANDRA-10593:
Component/s: Local Write-Read Paths
> Unintended interactions between commitlog archiving and commitlog recycling
> ---
>
> Key: CASSANDRA-10593
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10593
> Project: Cassandra
> Issue Type: Bug
> Components: Local Write-Read Paths
>Reporter: J.B. Langston
>Assignee: Ariel Weisberg
> Attachments: cassandra.yaml, commitlog_archiving.properties,
> system.log
>
>
> Currently the comments in commitlog_archiving.properties suggest using either
> cp or ln for the archive_command.
> Using ln is problematic because commitlog recycling marks segments as
> recycled once the corresponding memtables are flushed and Cassandra will no
> longer replay them. This means it's only possible to do PITR on any records
> that were written since the last flush.
> Using cp works, and this is currently how OpsCenter does for PITR, however
> [~brandon.williams] has pointed out this could have some performance impact
> because of the additional I/O overhead of copying the commitlog segments.
> Starting in 2.1, we can disable commit log recycling in cassandra.yaml so I
> thought this would allow me to do PITR without the extra overhead of using
> cp. However, when I disable commitlog recycling and try to do a PITR,
> Cassandra blows up when trying to replay the restored commit logs:
> {code}
> ERROR 16:56:42 Exception encountered during startup
> java.lang.IllegalStateException: Cannot safely construct descriptor for
> segment, as name and header descriptors do not match ((4,1445878452545) vs
> (4,1445876822565)): /opt/dse/backup/CommitLog-4-1445876822565.log
> at
> org.apache.cassandra.db.commitlog.CommitLogArchiver.maybeRestoreArchive(CommitLogArchiver.java:207)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:116)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:352)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at com.datastax.bdp.server.DseDaemon.setup(DseDaemon.java:335)
> ~[dse-core-4.8.0.jar:4.8.0]
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:537)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at com.datastax.bdp.DseModule.main(DseModule.java:75)
> [dse-core-4.8.0.jar:4.8.0]
> java.lang.IllegalStateException: Cannot safely construct descriptor for
> segment, as name and header descriptors do not match ((4,1445878452545) vs
> (4,1445876822565)): /opt/dse/backup/CommitLog-4-1445876822565.log
> at
> org.apache.cassandra.db.commitlog.CommitLogArchiver.maybeRestoreArchive(CommitLogArchiver.java:207)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:116)
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:352)
> at com.datastax.bdp.server.DseDaemon.setup(DseDaemon.java:335)
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:537)
> at com.datastax.bdp.DseModule.main(DseModule.java:75)
> Exception encountered during startup: Cannot safely construct descriptor for
> segment, as name and header descriptors do not match ((4,1445878452545) vs
> (4,1445876822565)): /opt/dse/backup/CommitLog-4-1445876822565.log
> INFO 16:56:42 DSE shutting down...
> INFO 16:56:42 All plugins are stopped.
> ERROR 16:56:42 Exception in thread Thread[Thread-2,5,main]
> java.lang.AssertionError: null
> at
> org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1403)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at com.datastax.bdp.gms.DseState.setActiveStatus(DseState.java:196)
> ~[dse-core-4.8.0.jar:4.8.0]
> at com.datastax.bdp.server.DseDaemon.preStop(DseDaemon.java:426)
> ~[dse-core-4.8.0.jar:4.8.0]
> at com.datastax.bdp.server.DseDaemon.safeStop(DseDaemon.java:436)
> ~[dse-core-4.8.0.jar:4.8.0]
> at com.datastax.bdp.server.DseDaemon$1.run(DseDaemon.java:676)
> ~[dse-core-4.8.0.jar:4.8.0]
> at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_31]
> {code}
> For the sake of completeness, I also tested using cp for the archive_command
> and commitlog recycling disabled, and PITR works as expected, but this of
> course defeats the point.
> It would be good to have some guidance on what is supported here. If ln isn't
> expected to work at all, it shouldn't be documented as an acceptable option
> for the archive_command in commitlog_archiving.properties. If it should work
> with commitlog recycling disabled, t
[jira] [Updated] (CASSANDRA-10593) Unintended interactions between commitlog archiving and commitlog recycling
[
https://issues.apache.org/jira/browse/CASSANDRA-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sylvain Lebresne updated CASSANDRA-10593:
-
Reviewer: Branimir Lambov
> Unintended interactions between commitlog archiving and commitlog recycling
> ---
>
> Key: CASSANDRA-10593
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10593
> Project: Cassandra
> Issue Type: Bug
> Components: Local Write-Read Paths
>Reporter: J.B. Langston
>Assignee: Ariel Weisberg
> Attachments: cassandra.yaml, commitlog_archiving.properties,
> system.log
>
>
> Currently the comments in commitlog_archiving.properties suggest using either
> cp or ln for the archive_command.
> Using ln is problematic because commitlog recycling marks segments as
> recycled once the corresponding memtables are flushed and Cassandra will no
> longer replay them. This means it's only possible to do PITR on any records
> that were written since the last flush.
> Using cp works, and this is currently how OpsCenter does for PITR, however
> [~brandon.williams] has pointed out this could have some performance impact
> because of the additional I/O overhead of copying the commitlog segments.
> Starting in 2.1, we can disable commit log recycling in cassandra.yaml so I
> thought this would allow me to do PITR without the extra overhead of using
> cp. However, when I disable commitlog recycling and try to do a PITR,
> Cassandra blows up when trying to replay the restored commit logs:
> {code}
> ERROR 16:56:42 Exception encountered during startup
> java.lang.IllegalStateException: Cannot safely construct descriptor for
> segment, as name and header descriptors do not match ((4,1445878452545) vs
> (4,1445876822565)): /opt/dse/backup/CommitLog-4-1445876822565.log
> at
> org.apache.cassandra.db.commitlog.CommitLogArchiver.maybeRestoreArchive(CommitLogArchiver.java:207)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:116)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:352)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at com.datastax.bdp.server.DseDaemon.setup(DseDaemon.java:335)
> ~[dse-core-4.8.0.jar:4.8.0]
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:537)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at com.datastax.bdp.DseModule.main(DseModule.java:75)
> [dse-core-4.8.0.jar:4.8.0]
> java.lang.IllegalStateException: Cannot safely construct descriptor for
> segment, as name and header descriptors do not match ((4,1445878452545) vs
> (4,1445876822565)): /opt/dse/backup/CommitLog-4-1445876822565.log
> at
> org.apache.cassandra.db.commitlog.CommitLogArchiver.maybeRestoreArchive(CommitLogArchiver.java:207)
> at
> org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:116)
> at
> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:352)
> at com.datastax.bdp.server.DseDaemon.setup(DseDaemon.java:335)
> at
> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:537)
> at com.datastax.bdp.DseModule.main(DseModule.java:75)
> Exception encountered during startup: Cannot safely construct descriptor for
> segment, as name and header descriptors do not match ((4,1445878452545) vs
> (4,1445876822565)): /opt/dse/backup/CommitLog-4-1445876822565.log
> INFO 16:56:42 DSE shutting down...
> INFO 16:56:42 All plugins are stopped.
> ERROR 16:56:42 Exception in thread Thread[Thread-2,5,main]
> java.lang.AssertionError: null
> at
> org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1403)
> ~[cassandra-all-2.1.9.791.jar:2.1.9.791]
> at com.datastax.bdp.gms.DseState.setActiveStatus(DseState.java:196)
> ~[dse-core-4.8.0.jar:4.8.0]
> at com.datastax.bdp.server.DseDaemon.preStop(DseDaemon.java:426)
> ~[dse-core-4.8.0.jar:4.8.0]
> at com.datastax.bdp.server.DseDaemon.safeStop(DseDaemon.java:436)
> ~[dse-core-4.8.0.jar:4.8.0]
> at com.datastax.bdp.server.DseDaemon$1.run(DseDaemon.java:676)
> ~[dse-core-4.8.0.jar:4.8.0]
> at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_31]
> {code}
> For the sake of completeness, I also tested using cp for the archive_command
> and commitlog recycling disabled, and PITR works as expected, but this of
> course defeats the point.
> It would be good to have some guidance on what is supported here. If ln isn't
> expected to work at all, it shouldn't be documented as an acceptable option
> for the archive_command in commitlog_archiving.properties. If it should work
> with commitlog recycling disabled, the bug c
[jira] [Updated] (CASSANDRA-9179) Unable to "point in time" restore if table/cf has been recreated
[ https://issues.apache.org/jira/browse/CASSANDRA-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Yeschenko updated CASSANDRA-9179: - Component/s: Distributed Metadata CQL > Unable to "point in time" restore if table/cf has been recreated > > > Key: CASSANDRA-9179 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9179 > Project: Cassandra > Issue Type: Bug > Components: CQL, Distributed Metadata >Reporter: Jon Moses >Assignee: Branimir Lambov > Labels: doc-impacting > > With Cassandra 2.1, and the addition of the CF UUID, the ability to do a > "point in time" restore by restoring a snapshot and replaying commitlogs is > lost if the table has been dropped and recreated. > When the table is recreated, the cf_id changes, and the commitlog replay > mechanism skips the desired mutations as the cf_id no longer matches what's > present in the schema. > There should exist a way to inform the replay that you want the mutations > replayed even if the cf_id doesn't match. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-7306) Support "edge dcs" with more flexible gossip
[ https://issues.apache.org/jira/browse/CASSANDRA-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua McKenzie updated CASSANDRA-7306: --- Component/s: Distributed Metadata > Support "edge dcs" with more flexible gossip > > > Key: CASSANDRA-7306 > URL: https://issues.apache.org/jira/browse/CASSANDRA-7306 > Project: Cassandra > Issue Type: Improvement > Components: Distributed Metadata >Reporter: Tupshin Harper >Assignee: Jeff Jirsa > Labels: ponies > > As Cassandra clusters get bigger and bigger, and their topology becomes more > complex, there is more and more need for a notion of "hub" and "spoke" > datacenters. > One of the big obstacles to supporting hundreds (or thousands) of remote dcs, > is the assumption that all dcs need to talk to each other (and be connected > all the time). > This ticket is a vague placeholder with the goals of achieving: > 1) better behavioral support for occasionally disconnected datacenters > 2) explicit support for custom dc to dc routing. A simple approach would be > an optional per-dc annotation of which other DCs that DC could gossip with. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-9179) Unable to "point in time" restore if table/cf has been recreated
[ https://issues.apache.org/jira/browse/CASSANDRA-9179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua McKenzie updated CASSANDRA-9179: --- Component/s: CQL > Unable to "point in time" restore if table/cf has been recreated > > > Key: CASSANDRA-9179 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9179 > Project: Cassandra > Issue Type: Bug > Components: CQL >Reporter: Jon Moses >Assignee: Branimir Lambov > Labels: doc-impacting > > With Cassandra 2.1, and the addition of the CF UUID, the ability to do a > "point in time" restore by restoring a snapshot and replaying commitlogs is > lost if the table has been dropped and recreated. > When the table is recreated, the cf_id changes, and the commitlog replay > mechanism skips the desired mutations as the cf_id no longer matches what's > present in the schema. > There should exist a way to inform the replay that you want the mutations > replayed even if the cf_id doesn't match. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10822) SSTable data loss when upgrading with row tombstone present
[
https://issues.apache.org/jira/browse/CASSANDRA-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sylvain Lebresne updated CASSANDRA-10822:
-
Reproduced In: 3.0.1, 3.0.0, 3.0.x (was: 3.0.0, 3.0.1, 3.0.x)
Reviewer: Sylvain Lebresne
> SSTable data loss when upgrading with row tombstone present
> ---
>
> Key: CASSANDRA-10822
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10822
> Project: Cassandra
> Issue Type: Bug
>Reporter: Andy Tolbert
>Assignee: Branimir Lambov
>Priority: Critical
> Fix For: 3.0.x, 3.x
>
>
> I ran into an issue when upgrading between 2.1.11 to 3.0.0 (and also
> cassandra-3.0 branch) where subsequent rows were lost within a partition
> where there is a row tombstone present.
> Here's a scenario that reproduces the issue.
> Using ccm create a single node cluster at 2.1.11:
> {{ccm create -n 1 -v 2.1.11 -s financial}}
> Run the following queries to create schema, populate some data and then
> delete some data for november:
> {noformat}
> drop keyspace if exists financial;
> create keyspace if not exists financial with replication = {'class':
> 'SimpleStrategy', 'replication_factor' : 1 };
> create table if not exists financial.symbol_history (
> symbol text,
> name text static,
> year int,
> month int,
> day int,
> volume bigint,
> close double,
> open double,
> low double,
> high double,
> primary key((symbol, year), month, day)
> ) with CLUSTERING ORDER BY (month desc, day desc);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 1, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 2, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 3, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 4, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 5, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 6, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 7, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 8, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 9, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 10, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 11, 1, 100);
> insert into financial.symbol_history (symbol, name, year, month, day, volume)
> values ('CORP', 'MegaCorp', 2004, 12, 1, 100);
> delete from financial.symbol_history where symbol='CORP' and year = 2004 and
> month=11;
> {noformat}
> Flush and run sstable2json on the sole Data.db file:
> {noformat}
> ccm node1 flush
> sstable2json /path/to/file.db
> {noformat}
> The output should look like the following:
> {code}
> [
> {"key": "CORP:2004",
> "cells": [["::name","MegaCorp",1449457517033030],
>["12:1:","",1449457517033030],
>["12:1:volume","100",1449457517033030],
>["11:_","11:!",1449457564983269,"t",1449457564],
>["10:1:","",1449457516313738],
>["10:1:volume","100",1449457516313738],
>["9:1:","",1449457516310205],
>["9:1:volume","100",1449457516310205],
>["8:1:","",1449457516235664],
>["8:1:volume","100",1449457516235664],
>["7:1:","",1449457516233535],
>["7:1:volume","100",1449457516233535],
>["6:1:","",1449457516231458],
>["6:1:volume","100",1449457516231458],
>["5:1:","",1449457516228307],
>["5:1:volume","100",1449457516228307],
>["4:1:","",1449457516225415],
>["4:1:volume","100",1449457516225415],
>["3:1:","",1449457516222811],
>["3:1:volume","100",1449457516222811],
>["2:1:","",1449457516220301],
>["2:1:volume","100",1449457516220301],
>["1:1:","",1449457516210758],
>["1:1:volume","100",1449457516210758]]}
> ]
> {code}
> Prepare for upgrade
> {noformat}
> ccm node1 nodetool snapshot financial
> ccm node1 nodetool drain
> ccm node1 stop
> {noformat}
> Upgrade to cassandra-3.0 and start the node
> {noformat}
> ccm node1 setdir -v git:cassandra-3.0
> ccm node1 start
> {
[jira] [Updated] (CASSANDRA-9923) stress write and counter_write hangs
[
https://issues.apache.org/jira/browse/CASSANDRA-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eduard Tudenhoefner updated CASSANDRA-9923:
---
Summary: stress write and counter_write hangs (was: stress against
counters hangs)
> stress write and counter_write hangs
>
>
> Key: CASSANDRA-9923
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9923
> Project: Cassandra
> Issue Type: Bug
>Reporter: Robert Stupp
> Labels: stress
>
> (Sorry for the vague description)
> I tried some cstar tests against counter columns. But all these tests against
> 2.1 and 2.2 ended (hang) during with the following output:
> {noformat}
> Created keyspaces. Sleeping 3s for propagation.
> Sleeping 2s...
> Warming up COUNTER_WRITE with 15 iterations...
> Running COUNTER_WRITE with 300 threads for 1500 iteration
> type, total ops,op/s,pk/s, row/s,mean, med, .95,
> .99,.999, max, time, stderr, errors, gc: #, max ms, sum ms,
> sdv ms, mb
> total, 98073, 98054, 98054, 98054, 3.1, 1.7, 8.9,
> 23.2,89.9, 107.7,1.0, 0.0, 0, 0, 0, 0,
> 0, 0
> total,188586, 72492, 72492, 72492, 4.1, 1.5,10.0,
> 61.4, 202.8, 214.7,2.2, 0.13101, 0, 3, 564, 564,
> 6,3447
> total,363880, 137986, 137986, 137986, 2.2, 1.4, 4.1,
> 9.6, 207.1, 253.3,3.5, 0.18684, 0, 0, 0, 0,
> 0, 0
> total,460122, 105062, 105062, 105062, 2.8, 1.4, 4.6,
> 14.7, 225.6, 236.2,4.4, 0.13969, 0, 1, 214, 214,
> 0,1199
> total,600625, 111453, 111453, 111453, 2.7, 1.4, 3.8,
> 10.4, 231.5, 241.6,5.7, 0.11366, 0, 2, 442, 442,
> 1,2389
> total,745680, 149583, 149583, 149583, 2.0, 1.4, 3.6,
> 6.7, 155.8, 159.7,6.7, 0.11318, 0, 0, 0, 0,
> 0, 0
> total,828453, 63632, 63632, 63632, 4.7, 1.4, 4.8,
> 261.9, 274.5, 279.3,8.0, 0.12645, 0, 3, 782, 782,
> 1,3542
> total, 1009560, 172429, 172429, 172429, 1.7, 1.4, 3.7,
> 6.1,16.2,29.7,9.0, 0.11629, 0, 0, 0, 0,
> 0, 0
> total, 1062409, 53860, 53860, 53860, 5.5, 1.3, 8.6,
> 270.3, 293.4, 324.3, 10.0, 0.12738, 0, 2, 542, 542,
> 7,2354
> total, 1186672, 96540, 96540, 96540, 3.1, 1.5, 5.9,
> 14.5, 266.4, 277.6, 11.3, 0.11451, 0, 1, 260, 260,
> 0,1183
> {noformat}
> ...
> {noformat}
> total, 4977251, 238, 238, 238, 0.7, 0.6, 0.7,
> 1.3, 3.4, 158.5, 352.3, 0.11749, 0, 0, 0, 0,
> 0, 0
> total, 4979839, 214, 214, 214, 0.6, 0.6, 0.7,
> 1.3, 2.5, 2.8, 364.4, 0.11761, 0, 0, 0, 0,
> 0, 0
> total, 4981729, 191, 191, 191, 0.6, 0.6, 0.7,
> 1.3, 3.2, 3.3, 374.3, 0.11774, 0, 0, 0, 0,
> 0, 0
> total, 4983362, 167, 167, 167, 0.8, 0.7, 1.8,
> 2.7, 3.9, 5.8, 384.0, 0.11787, 0, 0, 0, 0,
> 0, 0
> total, 4985171, 153, 153, 153, 0.7, 0.6, 1.2,
> 1.4, 2.0, 3.3, 395.9, 0.11799, 0, 0, 0, 0,
> 0, 0
> total, 4986684, 137, 137, 137, 0.7, 0.6, 0.8,
> 1.3, 2.0, 2.0, 406.9, 0.11812, 0, 0, 0, 0,
> 0, 0
> total, 4988410, 121, 121, 121, 0.7, 0.7, 0.8,
> 1.3, 2.0, 2.8, 421.1, 0.11824, 0, 0, 0, 0,
> 0, 0
> total, 4990216, 99, 99, 99, 0.7, 0.7, 0.8,
> 1.4, 2.6, 2.8, 439.5, 0.11836, 0, 0, 0, 0,
> 0, 0
> total, 4991765, 81, 81, 81, 0.8, 0.7, 0.8,
> 1.4,30.1,81.6, 458.7, 0.11848, 0, 1, 159, 159,
> 0,1179
> total, 4993731, 67, 67, 67, 0.7, 0.7, 0.8,
> 1.4, 3.2, 3.2, 488.1, 0.11860, 0, 0, 0, 0,
> 0, 0
> total, 4996565, 45, 45, 45, 0.9, 0.7, 0.9,
> 1.5,84.7, 218.3, 551.5, 0.11872, 0, 1, 248, 248,
> 0,1180
[jira] [Assigned] (CASSANDRA-10828) Allow usage of multiplier in the start value of cassandra-stress population sequence
[
https://issues.apache.org/jira/browse/CASSANDRA-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eduard Tudenhoefner reassigned CASSANDRA-10828:
---
Assignee: Eduard Tudenhoefner
> Allow usage of multiplier in the start value of cassandra-stress population
> sequence
>
>
> Key: CASSANDRA-10828
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10828
> Project: Cassandra
> Issue Type: Improvement
> Components: Tools
>Reporter: Eduard Tudenhoefner
>Assignee: Eduard Tudenhoefner
>Priority: Trivial
> Fix For: 2.1.x
>
> Attachments: cassandra-2.1-10828.txt
>
>
> Sometimes it would be useful to also use the multipliers *M/B/K* in the start
> value of a population sequence, such as in the below example:
> {code}
> cassandra-stress write n=100 -pop seq=1M..10M
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10842) compaction_throughput_tests are failing
[
https://issues.apache.org/jira/browse/CASSANDRA-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philip Thompson updated CASSANDRA-10842:
Fix Version/s: 2.2.x
2.1.x
> compaction_throughput_tests are failing
> ---
>
> Key: CASSANDRA-10842
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10842
> Project: Cassandra
> Issue Type: Sub-task
> Components: Compaction, Testing
>Reporter: Philip Thompson
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.x
>
>
> {{compaction_test.TestCompaction_with_DateTieredCompactionStrategy.compaction_throughput_test}}
> and
> {{compaction_test.TestCompaction_with_LeveledCompactionStrategy.compaction_throughput_test}}
> are failing on 3.0-head for the last two builds.
> See: http://cassci.datastax.com/job/cassandra-3.0_dtest/429/testReport/
> The test sets compaction throughput to 5, via nodetool, but is finding an
> average throughput greater than 5 in the logs. I cannot reproduce this
> locally on OSX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10842) compaction_throughput_tests are failing
[
https://issues.apache.org/jira/browse/CASSANDRA-10842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Philip Thompson updated CASSANDRA-10842:
Description:
{{compaction_test.TestCompaction_with_DateTieredCompactionStrategy.compaction_throughput_test}}
and
{{compaction_test.TestCompaction_with_LeveledCompactionStrategy.compaction_throughput_test}}
are failing on 3.0-head, 2.1-head, and 2.2-head for the last two builds.
See: http://cassci.datastax.com/job/cassandra-3.0_dtest/429/testReport/
The test sets compaction throughput to 5, via nodetool, but is finding an
average throughput greater than 5 in the logs. I cannot reproduce this locally
on OSX.
was:
{{compaction_test.TestCompaction_with_DateTieredCompactionStrategy.compaction_throughput_test}}
and
{{compaction_test.TestCompaction_with_LeveledCompactionStrategy.compaction_throughput_test}}
are failing on 3.0-head for the last two builds.
See: http://cassci.datastax.com/job/cassandra-3.0_dtest/429/testReport/
The test sets compaction throughput to 5, via nodetool, but is finding an
average throughput greater than 5 in the logs. I cannot reproduce this locally
on OSX.
> compaction_throughput_tests are failing
> ---
>
> Key: CASSANDRA-10842
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10842
> Project: Cassandra
> Issue Type: Sub-task
> Components: Compaction, Testing
>Reporter: Philip Thompson
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.x
>
>
> {{compaction_test.TestCompaction_with_DateTieredCompactionStrategy.compaction_throughput_test}}
> and
> {{compaction_test.TestCompaction_with_LeveledCompactionStrategy.compaction_throughput_test}}
> are failing on 3.0-head, 2.1-head, and 2.2-head for the last two builds.
> See: http://cassci.datastax.com/job/cassandra-3.0_dtest/429/testReport/
> The test sets compaction throughput to 5, via nodetool, but is finding an
> average throughput greater than 5 in the logs. I cannot reproduce this
> locally on OSX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (CASSANDRA-10842) compaction_throughput_tests are failing
Philip Thompson created CASSANDRA-10842:
---
Summary: compaction_throughput_tests are failing
Key: CASSANDRA-10842
URL: https://issues.apache.org/jira/browse/CASSANDRA-10842
Project: Cassandra
Issue Type: Sub-task
Components: Compaction, Testing
Reporter: Philip Thompson
Fix For: 3.0.x, 3.x
{{compaction_test.TestCompaction_with_DateTieredCompactionStrategy.compaction_throughput_test}}
and
{{compaction_test.TestCompaction_with_LeveledCompactionStrategy.compaction_throughput_test}}
are failing on 3.0-head for the last two builds.
See: http://cassci.datastax.com/job/cassandra-3.0_dtest/429/testReport/
The test sets compaction throughput to 5, via nodetool, but is finding an
average throughput greater than 5 in the logs. I cannot reproduce this locally
on OSX.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10807) Stress does not compiles within eclipse
[
https://issues.apache.org/jira/browse/CASSANDRA-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052903#comment-15052903
]
T Jake Luciani commented on CASSANDRA-10807:
+1
> Stress does not compiles within eclipse
> ---
>
> Key: CASSANDRA-10807
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10807
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
>Reporter: Benjamin Lerer
>Assignee: Benjamin Lerer
> Attachments: 10807-2.1.txt
>
>
> In Eclipse {{org.apache.cassandra.stress.settings.Lists}} and
> {{org.apache.cassandra.stress.settings.Sets}} do not compiles.
> It seems that in some case javac might not fully follow the JLS. I am not
> sure if it is really the case here but it would be nice if the code was
> compiling within Eclipse.
> After all, it is possible that there are other developers using Eclipse to
> work on Cassandra. Who knows? ;-)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-10664) Fix failing tests
[ https://issues.apache.org/jira/browse/CASSANDRA-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Thompson updated CASSANDRA-10664: Summary: Fix failing tests (was: Fix failing tests for 3.1) > Fix failing tests > - > > Key: CASSANDRA-10664 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10664 > Project: Cassandra > Issue Type: Test >Reporter: Sylvain Lebresne > Fix For: 3.0.x > > > This is the continuation of CASSANDRA-10166, just a meta-ticket to group all > tickets related to fixing any unit test or dtest. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10718) Group pending compactions based on table
[
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052876#comment-15052876
]
Taiyuan Zhang commented on CASSANDRA-10718:
---
Sorry, wasn't aware of the dtest... will remember next time.
> Group pending compactions based on table
>
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
> Issue Type: Improvement
>Reporter: Marcus Eriksson
>Assignee: Tushar Agrawal
>Priority: Minor
> Labels: lhf
> Fix For: 3.x
>
> Attachments: 10718-3.x.txt
>
>
> Currently we only give a global number on how many compactions are pending,
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10718) Group pending compactions based on table
[
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052839#comment-15052839
]
Marcus Eriksson commented on CASSANDRA-10718:
-
just running the tests - we parse the output of compactionstats in dtests so I
had to change the output a bit, updated patch here:
https://github.com/krummas/cassandra/commits/marcuse/10718 and test runs here:
http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-10718-dtest/
http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-10718-testall/
> Group pending compactions based on table
>
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
> Issue Type: Improvement
>Reporter: Marcus Eriksson
>Assignee: Tushar Agrawal
>Priority: Minor
> Labels: lhf
> Fix For: 3.x
>
> Attachments: 10718-3.x.txt
>
>
> Currently we only give a global number on how many compactions are pending,
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10718) Group pending compactions based on table
[
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052807#comment-15052807
]
Taiyuan Zhang commented on CASSANDRA-10718:
---
Thanks :)
> Group pending compactions based on table
>
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
> Issue Type: Improvement
>Reporter: Marcus Eriksson
>Assignee: Tushar Agrawal
>Priority: Minor
> Labels: lhf
> Fix For: 3.x
>
> Attachments: 10718-3.x.txt
>
>
> Currently we only give a global number on how many compactions are pending,
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10718) Group pending compactions based on table
[
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052806#comment-15052806
]
Marcus Eriksson commented on CASSANDRA-10718:
-
ah, of course, will get it committed, thanks
> Group pending compactions based on table
>
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
> Issue Type: Improvement
>Reporter: Marcus Eriksson
>Assignee: Tushar Agrawal
>Priority: Minor
> Labels: lhf
> Fix For: 3.x
>
> Attachments: 10718-3.x.txt
>
>
> Currently we only give a global number on how many compactions are pending,
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10718) Group pending compactions based on table
[
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052800#comment-15052800
]
Taiyuan Zhang commented on CASSANDRA-10718:
---
{{tableNameToCountMap}} is a map inside {{resultMap}}. {{resultMap}} is
returned whenever the user reads from {{pendingTasksByTableName}}.
> Group pending compactions based on table
>
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
> Issue Type: Improvement
>Reporter: Marcus Eriksson
>Assignee: Tushar Agrawal
>Priority: Minor
> Labels: lhf
> Fix For: 3.x
>
> Attachments: 10718-3.x.txt
>
>
> Currently we only give a global number on how many compactions are pending,
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CASSANDRA-9879) Add the name of the compressor in the output of sstablemetadata
[ https://issues.apache.org/jira/browse/CASSANDRA-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Eriksson updated CASSANDRA-9879: --- Fix Version/s: 3.2 > Add the name of the compressor in the output of sstablemetadata > --- > > Key: CASSANDRA-9879 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9879 > Project: Cassandra > Issue Type: Improvement > Components: Tools >Reporter: Nicolas Lalevée >Assignee: Nicolas Lalevée >Priority: Trivial > Fix For: 3.2 > > Attachments: > 0001-add-compressor-name-in-the-output-of-sstablemetadata.patch > > > Here is a simple patch to add to the output of sstablemetadata the name the > compressor used for the sstable. > I also made sstablemetadata embedded into the .deb distribution -- This message was sent by Atlassian JIRA (v6.3.4#6332)
cassandra git commit: Add compressor name in the output of sstablemetadata
Repository: cassandra
Updated Branches:
refs/heads/trunk 105ccb3d2 -> 2cd18ef5a
Add compressor name in the output of sstablemetadata
Patch by Nicolas Lalevee; reviewed by marcuse for CASSANDRA-9879
Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/2cd18ef5
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/2cd18ef5
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/2cd18ef5
Branch: refs/heads/trunk
Commit: 2cd18ef5a01a06d90e13e61971e5601c7de61e7c
Parents: 105ccb3
Author: Nicolas LaleveÌe
Authored: Thu Jul 23 15:05:00 2015 +0200
Committer: Marcus Eriksson
Committed: Fri Dec 11 14:38:34 2015 +0100
--
CHANGES.txt | 1 +
debian/cassandra.install | 1 +
.../org/apache/cassandra/tools/SSTableMetadataViewer.java | 10 +-
3 files changed, 11 insertions(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/cassandra/blob/2cd18ef5/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index dda12ba..296d3cd 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
3.2
+ * Add compressor name in sstablemetadata output (CASSANDRA-9879)
* Fix type casting for counter columns (CASSANDRA-10824)
* Prevent running Cassandra as root (CASSANDRA-8142)
* bound maximum in-flight commit log replay mutation bytes to 64 megabytes
(CASSANDRA-8639)
http://git-wip-us.apache.org/repos/asf/cassandra/blob/2cd18ef5/debian/cassandra.install
--
diff --git a/debian/cassandra.install b/debian/cassandra.install
index 1b66426..9bc05d9 100644
--- a/debian/cassandra.install
+++ b/debian/cassandra.install
@@ -19,6 +19,7 @@ bin/cqlsh.py usr/bin
bin/sstablescrub usr/bin
bin/sstableupgrade usr/bin
tools/bin/cassandra-stress usr/bin
+tools/bin/sstablemetadata usr/bin
lib/*.jar usr/share/cassandra/lib
lib/*.zip usr/share/cassandra/lib
lib/sigar-bin/* usr/share/cassandra/lib/sigar-bin
http://git-wip-us.apache.org/repos/asf/cassandra/blob/2cd18ef5/src/java/org/apache/cassandra/tools/SSTableMetadataViewer.java
--
diff --git a/src/java/org/apache/cassandra/tools/SSTableMetadataViewer.java
b/src/java/org/apache/cassandra/tools/SSTableMetadataViewer.java
index 3728d34..5b47004 100644
--- a/src/java/org/apache/cassandra/tools/SSTableMetadataViewer.java
+++ b/src/java/org/apache/cassandra/tools/SSTableMetadataViewer.java
@@ -23,6 +23,8 @@ import java.io.PrintStream;
import java.util.EnumSet;
import java.util.Map;
+import org.apache.cassandra.io.compress.CompressionMetadata;
+import org.apache.cassandra.io.sstable.Component;
import org.apache.cassandra.io.sstable.Descriptor;
import org.apache.cassandra.io.sstable.metadata.*;
@@ -54,6 +56,10 @@ public class SSTableMetadataViewer
ValidationMetadata validation = (ValidationMetadata)
metadata.get(MetadataType.VALIDATION);
StatsMetadata stats = (StatsMetadata)
metadata.get(MetadataType.STATS);
CompactionMetadata compaction = (CompactionMetadata)
metadata.get(MetadataType.COMPACTION);
+CompressionMetadata compression = null;
+File compressionFile = new
File(descriptor.filenameFor(Component.COMPRESSION_INFO));
+if (compressionFile.exists())
+compression = CompressionMetadata.create(fname);
out.printf("SSTable: %s%n", descriptor);
if (validation != null)
@@ -66,7 +72,9 @@ public class SSTableMetadataViewer
out.printf("Minimum timestamp: %s%n", stats.minTimestamp);
out.printf("Maximum timestamp: %s%n", stats.maxTimestamp);
out.printf("SSTable max local deletion time: %s%n",
stats.maxLocalDeletionTime);
-out.printf("Compression ratio: %s%n",
stats.compressionRatio);
+out.printf("Compressor: %s%n", compression != null ?
compression.compressor().getClass().getName() : "-");
+if (compression != null)
+out.printf("Compression ratio: %s%n",
stats.compressionRatio);
out.printf("Estimated droppable tombstones: %s%n",
stats.getEstimatedDroppableTombstoneRatio((int) (System.currentTimeMillis() /
1000)));
out.printf("SSTable Level: %d%n", stats.sstableLevel);
out.printf("Repaired at: %d%n", stats.repairedAt);
[jira] [Resolved] (CASSANDRA-10841) Datastax-agent 5.2.2 fails to work with Cassandra 3.1
[
https://issues.apache.org/jira/browse/CASSANDRA-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeremiah Jordan resolved CASSANDRA-10841.
-
Resolution: Invalid
> Datastax-agent 5.2.2 fails to work with Cassandra 3.1
> -
>
> Key: CASSANDRA-10841
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10841
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
>Reporter: Tomas Ramanauskas
>
> Hello,
> I had datastax-agent 5.2.2 working successfully with Cassandra 2.2.1.
> I upgraded Cassandra to 3.1 version and notices that there is no data in
> OpsCenter.
> Here is what I see in the log file:
> {code}
> root@sl-prod-cass-01:~# tail /var/log/datastax-agent/agent.log
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:25:58,020 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:27:02,017 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:27:02,039 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:28:06,036 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:28:06,047 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:29:10,044 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:29:10,055 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:30:14,058 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:30:14,071 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10841) Datastax-agent 5.2.2 fails to work with Cassandra 3.1
[
https://issues.apache.org/jira/browse/CASSANDRA-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052731#comment-15052731
]
Jeremiah Jordan commented on CASSANDRA-10841:
-
DataStax OpsCenter does not support Cassandra 3.0 yet. The DataStax Agent is
part of OpsCenter not Cassandra.
> Datastax-agent 5.2.2 fails to work with Cassandra 3.1
> -
>
> Key: CASSANDRA-10841
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10841
> Project: Cassandra
> Issue Type: Bug
> Components: Tools
>Reporter: Tomas Ramanauskas
>
> Hello,
> I had datastax-agent 5.2.2 working successfully with Cassandra 2.2.1.
> I upgraded Cassandra to 3.1 version and notices that there is no data in
> OpsCenter.
> Here is what I see in the log file:
> {code}
> root@sl-prod-cass-01:~# tail /var/log/datastax-agent/agent.log
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:25:58,020 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:27:02,017 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:27:02,039 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:28:06,036 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:28:06,047 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:29:10,044 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:29:10,055 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-4] 2015-12-11 12:30:14,058 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> ERROR [clojure-agent-send-off-pool-5] 2015-12-11 12:30:14,071 Can't connect
> to Cassandra (All host(s) tried for query failed (tried: /10.9.3.220:9042
> (com.datastax.driver.core.exceptions.InvalidQueryException: unconfigured
> table schema_keyspaces))), retrying soon.
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-10718) Group pending compactions based on table
[
https://issues.apache.org/jira/browse/CASSANDRA-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052729#comment-15052729
]
Marcus Eriksson commented on CASSANDRA-10718:
-
[~firstprayer] thanks, looks like you missed actually adding up the currently
ongoing compactions from {{tableNameToCountMap}} in {{pendingTasksByTableName}}
> Group pending compactions based on table
>
>
> Key: CASSANDRA-10718
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10718
> Project: Cassandra
> Issue Type: Improvement
>Reporter: Marcus Eriksson
>Assignee: Tushar Agrawal
>Priority: Minor
> Labels: lhf
> Fix For: 3.x
>
> Attachments: 10718-3.x.txt
>
>
> Currently we only give a global number on how many compactions are pending,
> we should group this on a per-table basis, example:
> {code}
> $ nodetool compactionstats
> pending tasks:
> - keyspace1.standard1: 10
> - other_ks.table: 2
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (CASSANDRA-10797) Bootstrap new node fails with OOM when streaming nodes contains thousands of sstables
[
https://issues.apache.org/jira/browse/CASSANDRA-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052692#comment-15052692
]
Paulo Motta edited comment on CASSANDRA-10797 at 12/11/15 12:46 PM:
As mentioned before I was able to reproduce the OOM with 1000 small sstables
and 50M heap. I attached a [ccm
cluster|https://issues.apache.org/jira/secure/attachment/12777032/dtest.tar.gz]
with 2 nodes. In order to reproduce, extract the {{dtest.tar.gz}} in the
{{~/.ccm}} folder, update the following properties to match your local
directories on {{dtest/node*/conf/cassandra.yaml}}: {{commitlog_directory}},
{{data_file_directories}} and {{saved_caches_directory}}. After that, run the
following commands:
{noformat}
ccm switch dtest
ccm node1 start
sleep 10
ccm node2 start (will throw OOM)
{noformat}
The main problem is that all {{SStableWriters}} remain open until the end of
the stream receive task, and these objects are quite large with indexes and
stats that are written to disk only when the {{SStableWriters}} are closed.
Before CASSANDRA-6503, {{SStableWriters}} were closed as soon as they were
received, and the stream receive task kept only the {{SStableReaders}} which
have a much smaller memory footprint. The main reason to defer the closing of
the {{SStableWriter}} to the end of the stream receive task was to keep
sstables temporary (with {{-tmp}} infix), avoiding stale sstables to reappear
if the machines are restarted after a failed repair session. A discussed
alternative was to close the {{SStableWriter}} without removing the {{-tmp}}
infix, and performing an atomic rename in the end of the stream task. However,
this alternative was disregarded as the {{SStableReader}} would need to be
closed and reopened in order to perform the atomic rename on non-posix systems
such as Windows.
CASSANDRA-6503 also introduced the {{StreamLockFile}} to remove already-closed
{{SStableWriters}} if the node goes down before these files are processed in
the end of the stream receive task. So, the proposed solution basically returns
to the previous behavior of closing {{SStableWriters}} as soon as they are
received, while adding already-closed-but-not-yet-live files to the
{{StreamLockFile}}. As soon as the sstables are added to the data tracker, the
{{StreamLockFile}} is removed. If the stream session fails before that, the
already-closed-but-not-yet-live sstables are cleaned up. If there is a failure
while adding files to the data tracker, only the files that were not yet added
to the data tracker are removed since they were already live. If the node goes
down during a stream session, the already-closed-but-not-yet-live sstables
present in the {{StreamLockFile}} are removed on the next startup as done today.
Since {{StreamLockFile}} is a much more critical component with this approach,
I added unit tests to verify that {{append}}, {{cleanup}}, {{skip}} and
{{delete}} are working correctly. We also need to ignore sstables that are
present on a {{StreamLockFile}} during {{nodetool refresh}}. I will do that
after first review if this approach is validated.
Below are some test results with and without the patch, with constrained (50M)
and unconstrained (500M) memory.
||*||unpatched||patched||
||constrained|!10797-nonpatched.png!|!10797-patched.png!|
||unconstrained|!10798-nonpatched-500M.png!|!10798-patched-500M.png!|
In the constrained case, the unpatched version OOM soon after starting
bootstrap while the patched version finished bootstrap successfully. In the
unconstrained case, the memory footprint is between 1/2 to 1/3 smaller, but the
difference is probably much larger in the case of large sstables.
Below is the initial patch and tests:
||2.1||
|[branch|https://github.com/apache/cassandra/compare/cassandra-2.1...pauloricardomg:2.1-10797]|
|[testall|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-2.1-10797-testall/lastCompletedBuild/testReport/]|
|[dtest|http://cassci.datastax.com/view/Dev/view/paulomotta/job/pauloricardomg-2.1-10797-dtest/lastCompletedBuild/testReport/]|
I will provide 2.2+ versions after review.
was (Author: pauloricardomg):
As mentioned before I was able to reproduce the OOM with 1000 small sstables
and 50M heap. I attached a [ccm
cluster|https://issues.apache.org/jira/secure/attachment/12777032/dtest.tar.gz]
with 2 nodes. In order to reproduce, extract the {{dtest.tar.gz}} in the
{{~/.ccm}} folder, update the following properties to match your local
directories on {{dtest/node*/conf/cassandra.yaml}}: {{commitlog_directory}},
{{data_file_directories}} and {{saved_caches_directory}}. After that, run the
following commands:
{noformat}
ccm switch dtest
ccm node1 start
sleep 10
ccm node2 start (will throw OOM)
{noformat}
The main problem is that all {{SStableWriters}} remain open until the end of
the stream
[jira] [Comment Edited] (CASSANDRA-10797) Bootstrap new node fails with OOM when streaming nodes contains thousands of sstables
[
https://issues.apache.org/jira/browse/CASSANDRA-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052692#comment-15052692
]
Paulo Motta edited comment on CASSANDRA-10797 at 12/11/15 12:43 PM:
As mentioned before I was able to reproduce the OOM with 1000 small sstables
and 50M heap. I attached a [ccm
cluster|https://issues.apache.org/jira/secure/attachment/12777032/dtest.tar.gz]
with 2 nodes. In order to reproduce, extract the {{dtest.tar.gz}} in the
{{~/.ccm}} folder, update the following properties to match your local
directories on {{dtest/node*/conf/cassandra.yaml}}: {{commitlog_directory}},
{{data_file_directories}} and {{saved_caches_directory}}. After that, run the
following commands:
{noformat}
ccm switch dtest
ccm node1 start
sleep 10
ccm node2 start (will throw OOM)
{noformat}
The main problem is that all {{SStableWriters}} remain open until the end of
the stream receive task, and these objects are quite large with indexes and
stats that are written to disk only when the {{SStableWriters}} are closed.
Before CASSANDRA-6503, {{SStableWriters}} were closed as soon as they were
received, and the stream receive task kept only the {{SStableReaders}} which
have a much smaller memory footprint. The main reason to defer the closing of
the {{SStableWriter}} to the end of the stream receive task was to keep
sstables temporary (with {{-tmp}} infix), avoiding stale sstables to reappear
if the machines are restarted after a failed repair session. A discussed
alternative was to close the {{SStableWriter}} without removing the {{-tmp}}
infix, and performing an atomic rename in the end of the stream task. However,
this alternative was disregarded as the {{SStableReader}} would need to be
closed and reopened in order to perform the atomic rename on non-posix systems
such as Windows.
CASSANDRA-6503 also introduced the {{StreamLockFile}} to remove already-closed
{{SStableWriters}} if the node goes down before these files are processed in
the end of the stream receive task. So, the proposed solution basically returns
to the previous behavior of closing {{SStableWriters}} as soon as they are
received, while adding already-closed-but-not-yet-live files to the
{{StreamLockFile}}. As soon as the sstables are added to the data tracker, the
{{StreamLockFile}} is removed. If the stream session fails before that, the
already-closed-but-not-yet-live sstables are cleaned up. If there is a failure
while adding files to the data tracker, only the files that were not yet added
to the data tracker are removed since they were already live. If the node goes
down during a stream session, the already-closed-but-not-yet-live sstables
present in the {{StreamLockFile}} are removed on the next startup as done today.
Since {{StreamLockFile}} is a much more critical component with this approach,
I added unit tests to verify that {{append}}, {{cleanup}}, {{skip}} and
{{delete}} are working correctly. We also need to ignore sstables that are
present on a {{StreamLockFile}} during {{nodetool refresh}}. I will do that
after first review if this approach is validated.
Below are some test results with and without the patch, with constrained (50M)
and unconstrained (500M) memory.
||*||unpatched||patched||
||constrained|!10797-nonpatched.png!|!10797-patched.png!|
||unconstrained|!10798-nonpatched-500M.png!|!10798-patched-500M.png!|
In the constrained case, the unpatched version OOM soon after starting
bootstrap while the patched version finished bootstrap successfully. In the
unconstrained case, the memory footprint is between 1/2 to 1/3 smaller, but the
difference is probably much larger in the case of large sstables.
I will provide 2.2+ versions after review.
was (Author: pauloricardomg):
As mentioned before I was able to reproduce the OOM with 1000 small sstables
and 50M heap. I attached a [ccm
cluster|https://issues.apache.org/jira/secure/attachment/12777032/dtest.tar.gz]
with 2 nodes. In order to reproduce, extract the {{dtest.tar.gz}} in the
{{~/.ccm}} folder, update the following properties to match your local
directories on {{dtest/node*/conf/cassandra.yaml}}: {{commitlog_directory}},
{{data_file_directories}} and {{saved_caches_directory}}. After that, run the
following commands:
{noformat}
ccm switch dtest
ccm node1 start
sleep 10
ccm node2 start (will throw OOM)
{noformat}
The main problem is that all {{SStableWriters}} remain open until the end of
the stream receive task, and these objects are quite large with indexes and
stats that are written to disk only when the {{SStableWriters}} are closed.
Before CASSANDRA-6503, {{SStableWriters}} were closed as soon as they were
received, and the stream receive task kept only the {{SStableReaders}} which
have a much smaller memory footprint. The main reason to defer the closing of
the {{SStableWriter}} to t
