[jira] [Commented] (CASSANDRA-11427) Range slice queries CL > ONE trigger read-repair of purgeable tombstones

2016-08-17 Thread mck (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425932#comment-15425932
 ] 

mck commented on CASSANDRA-11427:
-

This issue was rolled back in 2.2.8, via this commit 
https://github.com/apache/cassandra/commit/f28631e0cf1bc6cb6a1bdf7a4fa1f4af720a77b6
 (see CASSANDRA-12351 for more info).

> Range slice queries CL > ONE trigger read-repair of purgeable tombstones
> 
>
> Key: CASSANDRA-11427
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11427
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Stefan Podkowinski
>Assignee: Stefan Podkowinski
>Priority: Minor
> Fix For: 2.2.6
>
> Attachments: 11427-2.1.patch, 11427-2.2_v2.patch
>
>
> Range queries will trigger read repairs for purgeable tombstones on hosts 
> that already compacted given tombstones. Clusters with periodical jobs for 
> scanning data ranges will likely see tombstones ressurected through RRs just 
> to have them compacted again later at the destination host.
> Executing range queries (e.g. for reading token ranges) will compare the 
> actual data instead of using digests when executed with CL > ONE. Responses 
> will be consolidated by {{RangeSliceResponseResolver.Reducer}}, where the 
> result of {{RowDataResolver.resolveSuperset}} is used as the reference 
> version for the results. {{RowDataResolver.scheduleRepairs}} will then send 
> the superset to all nodes that returned a different result before. 
> Unfortunately this does also involve cases where the superset is just made up 
> of purgeable tombstone(s) that already have been compacted on the other 
> nodes. In this case a read-repair will be triggered for transfering the 
> purgeable tombstones to all other nodes nodes that returned an empty result.
> The issue can be reproduced with the provided dtest or manually using the 
> following steps:
> {noformat}
> create keyspace test1 with replication = { 'class' : 'SimpleStrategy', 
> 'replication_factor' : 2 };
> use test1;
> create table test1 ( a text, b text, primary key(a, b) ) WITH compaction = 
> {'class': 'SizeTieredCompactionStrategy', 'enabled': 'false'} AND 
> dclocal_read_repair_chance = 0 AND gc_grace_seconds = 0;
> delete from test1 where a = 'a';
> {noformat}
> {noformat}
> ccm flush;
> ccm node2 compact;
> {noformat}
> {noformat}
> use test1;
> consistency all;
> tracing on;
> select * from test1;
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (CASSANDRA-12488) dtest failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_0_x_To_indev_3_x.cql3_non_compound_range_tombstones_test

2016-08-17 Thread Joel Knighton (JIRA) 
Joel Knighton created CASSANDRA-12488:
-

 Summary: dtest failure in 
upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_0_x_To_indev_3_x.cql3_non_compound_range_tombstones_test
 Key: CASSANDRA-12488
 URL: https://issues.apache.org/jira/browse/CASSANDRA-12488
 Project: Cassandra
  Issue Type: Test
  Components: Testing
Reporter: Joel Knighton
Assignee: DS Test Eng


example failure:

http://cassci.datastax.com/job/cassandra-3.9_dtest_upgrade/lastCompletedBuild/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_3_0_x_To_indev_3_x/cql3_non_compound_range_tombstones_test

It looks like this is failing with a TimedOutException.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Assigned] (CASSANDRA-12487) RemoveTest.testBadHostId is flaky

2016-08-17 Thread Joel Knighton (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joel Knighton reassigned CASSANDRA-12487:
-

Assignee: Joel Knighton

> RemoveTest.testBadHostId is flaky
> -
>
> Key: CASSANDRA-12487
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12487
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Joel Knighton
>Assignee: Joel Knighton
>
> example failure: 
> http://cassci.datastax.com/job/cassandra-3.9_testall/80/testReport/junit/org.apache.cassandra.service/RemoveTest/testBadHostId/
> Stacktrace:
> {code}
> java.lang.NullPointerException
>   at 
> org.apache.cassandra.service.StorageService.isStatus(StorageService.java:2001)
>   at 
> org.apache.cassandra.service.StorageService.notifyJoined(StorageService.java:1980)
>   at 
> org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:2192)
>   at 
> org.apache.cassandra.service.StorageService.onChange(StorageService.java:1822)
>   at org.apache.cassandra.Util.createInitialRing(Util.java:211)
>   at org.apache.cassandra.service.RemoveTest.setup(RemoveTest.java:83)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-9541) RemoveTest.testRemoveHostId failed in trunk

2016-08-17 Thread Joel Knighton (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joel Knighton updated CASSANDRA-9541:
-
Component/s: Testing

> RemoveTest.testRemoveHostId failed in trunk
> ---
>
> Key: CASSANDRA-9541
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9541
> Project: Cassandra
>  Issue Type: Test
>  Components: Testing
>Reporter: Michael Shuler
>Assignee: Joel Knighton
>  Labels: test-failure
> Fix For: 3.x
>
>
> {noformat}
> java.lang.NullPointerException
>   at org.apache.cassandra.gms.Gossiper.getHostId(Gossiper.java:803)
>   at 
> org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:1865)
>   at 
> org.apache.cassandra.service.StorageService.onChange(StorageService.java:1621)
>   at org.apache.cassandra.Util.createInitialRing(Util.java:288)
>   at org.apache.cassandra.service.RemoveTest.setup(RemoveTest.java:79)
> {noformat}
> http://cassci.datastax.com/job/trunk_utest/236/testReport/org.apache.cassandra.service/RemoveTest/testRemoveHostId/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Assigned] (CASSANDRA-9541) RemoveTest.testRemoveHostId failed in trunk

2016-08-17 Thread Joel Knighton (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joel Knighton reassigned CASSANDRA-9541:


Assignee: Joel Knighton

> RemoveTest.testRemoveHostId failed in trunk
> ---
>
> Key: CASSANDRA-9541
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9541
> Project: Cassandra
>  Issue Type: Test
>  Components: Testing
>Reporter: Michael Shuler
>Assignee: Joel Knighton
>  Labels: test-failure
> Fix For: 3.x
>
>
> {noformat}
> java.lang.NullPointerException
>   at org.apache.cassandra.gms.Gossiper.getHostId(Gossiper.java:803)
>   at 
> org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:1865)
>   at 
> org.apache.cassandra.service.StorageService.onChange(StorageService.java:1621)
>   at org.apache.cassandra.Util.createInitialRing(Util.java:288)
>   at org.apache.cassandra.service.RemoveTest.setup(RemoveTest.java:79)
> {noformat}
> http://cassci.datastax.com/job/trunk_utest/236/testReport/org.apache.cassandra.service/RemoveTest/testRemoveHostId/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (CASSANDRA-12487) RemoveTest.testBadHostId is flaky

2016-08-17 Thread Joel Knighton (JIRA) 
Joel Knighton created CASSANDRA-12487:
-

 Summary: RemoveTest.testBadHostId is flaky
 Key: CASSANDRA-12487
 URL: https://issues.apache.org/jira/browse/CASSANDRA-12487
 Project: Cassandra
  Issue Type: Bug
  Components: Testing
Reporter: Joel Knighton


example failure: 
http://cassci.datastax.com/job/cassandra-3.9_testall/80/testReport/junit/org.apache.cassandra.service/RemoveTest/testBadHostId/

Stacktrace:
{code}

java.lang.NullPointerException
at 
org.apache.cassandra.service.StorageService.isStatus(StorageService.java:2001)
at 
org.apache.cassandra.service.StorageService.notifyJoined(StorageService.java:1980)
at 
org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:2192)
at 
org.apache.cassandra.service.StorageService.onChange(StorageService.java:1822)
at org.apache.cassandra.Util.createInitialRing(Util.java:211)
at org.apache.cassandra.service.RemoveTest.setup(RemoveTest.java:83)
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (CASSANDRA-11363) High Blocked NTR When Connecting

2016-08-17 Thread Nate McCall (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425867#comment-15425867
 ] 

Nate McCall edited comment on CASSANDRA-11363 at 8/18/16 3:50 AM:
--

[~tjake] 
The patch was deployed running with the following setting:
{noformat}
-Dcassandra.max_queued_native_transport_requests=1024
{noformat}
(EDIT: changed 4096 to 1024 as I pasted the wrong value initially).

After an hour of soaking in, it looks good so far:
{noformat}
Native-Transport-Requests 5 0   17738639 0  
   0
{noformat}

On this particular cluster, the NTR all-time would start ticking up immediately 
(but sporadically) after a restart so the above is an excellent sign. The 
workload contains a large number of very small rows mixed read and write. 

There is no discernable impact on client latencies, nor with GC churn. If 
anything, both are marginally smaller. 


was (Author: zznate):
[~tjake] 
The patch was deployed running with the following setting:
{noformat}
-Dcassandra.max_queued_native_transport_requests=4096
{noformat}

After an hour of soaking in, it looks good so far:
{noformat}
Native-Transport-Requests 5 0   17738639 0  
   0
{noformat}

On this particular cluster, the NTR all-time would start ticking up immediately 
(but sporadically) after a restart so the above is an excellent sign. The 
workload contains a large number of very small rows mixed read and write. 

There is no discernable impact on client latencies, nor with GC churn. If 
anything, both are marginally smaller. 

> High Blocked NTR When Connecting
> 
>
> Key: CASSANDRA-11363
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11363
> Project: Cassandra
>  Issue Type: Bug
>  Components: Coordination
>Reporter: Russell Bradberry
>Assignee: T Jake Luciani
> Attachments: cassandra-102-cms.stack, cassandra-102-g1gc.stack, 
> max_queued_ntr_property.txt, thread-queue-2.1.txt
>
>
> When upgrading from 2.1.9 to 2.1.13, we are witnessing an issue where the 
> machine load increases to very high levels (> 120 on an 8 core machine) and 
> native transport requests get blocked in tpstats.
> I was able to reproduce this in both CMS and G1GC as well as on JVM 7 and 8.
> The issue does not seem to affect the nodes running 2.1.9.
> The issue seems to coincide with the number of connections OR the number of 
> total requests being processed at a given time (as the latter increases with 
> the former in our system)
> Currently there is between 600 and 800 client connections on each machine and 
> each machine is handling roughly 2000-3000 client requests per second.
> Disabling the binary protocol fixes the issue for this node but isn't a 
> viable option cluster-wide.
> Here is the output from tpstats:
> {code}
> Pool NameActive   Pending  Completed   Blocked  All 
> time blocked
> MutationStage 0 88387821 0
>  0
> ReadStage 0 0 355860 0
>  0
> RequestResponseStage  0 72532457 0
>  0
> ReadRepairStage   0 0150 0
>  0
> CounterMutationStage 32   104 897560 0
>  0
> MiscStage 0 0  0 0
>  0
> HintedHandoff 0 0 65 0
>  0
> GossipStage   0 0   2338 0
>  0
> CacheCleanupExecutor  0 0  0 0
>  0
> InternalResponseStage 0 0  0 0
>  0
> CommitLogArchiver 0 0  0 0
>  0
> CompactionExecutor2   190474 0
>  0
> ValidationExecutor0 0  0 0
>  0
> MigrationStage0 0 10 0
>  0
> AntiEntropyStage  0 0  0 0
>  0
> PendingRangeCalculator0 0310 0
>  0
> Sampler   0 0  0 0
>  0
> MemtableFlushWriter   110 94 0
>  0
> MemtablePostFlush 134257 0
>  0
> MemtableReclaimMemory 0 0 94 0
>

[jira] [Commented] (CASSANDRA-11363) High Blocked NTR When Connecting

2016-08-17 Thread Nate McCall (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425867#comment-15425867
 ] 

Nate McCall commented on CASSANDRA-11363:
-

[~tjake] 
The patch was deployed running with the following setting:
{noformat}
-Dcassandra.max_queued_native_transport_requests=4096
{noformat}

After an hour of soaking in, it looks good so far:
{noformat}
Native-Transport-Requests 5 0   17738639 0  
   0
{noformat}

On this particular cluster, the NTR all-time would start ticking up immediately 
(but sporadically) after a restart so the above is an excellent sign. The 
workload contains a large number of very small rows mixed read and write. 

There is no discernable impact on client latencies, nor with GC churn. If 
anything, both are marginally smaller. 

> High Blocked NTR When Connecting
> 
>
> Key: CASSANDRA-11363
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11363
> Project: Cassandra
>  Issue Type: Bug
>  Components: Coordination
>Reporter: Russell Bradberry
>Assignee: T Jake Luciani
> Attachments: cassandra-102-cms.stack, cassandra-102-g1gc.stack, 
> max_queued_ntr_property.txt, thread-queue-2.1.txt
>
>
> When upgrading from 2.1.9 to 2.1.13, we are witnessing an issue where the 
> machine load increases to very high levels (> 120 on an 8 core machine) and 
> native transport requests get blocked in tpstats.
> I was able to reproduce this in both CMS and G1GC as well as on JVM 7 and 8.
> The issue does not seem to affect the nodes running 2.1.9.
> The issue seems to coincide with the number of connections OR the number of 
> total requests being processed at a given time (as the latter increases with 
> the former in our system)
> Currently there is between 600 and 800 client connections on each machine and 
> each machine is handling roughly 2000-3000 client requests per second.
> Disabling the binary protocol fixes the issue for this node but isn't a 
> viable option cluster-wide.
> Here is the output from tpstats:
> {code}
> Pool NameActive   Pending  Completed   Blocked  All 
> time blocked
> MutationStage 0 88387821 0
>  0
> ReadStage 0 0 355860 0
>  0
> RequestResponseStage  0 72532457 0
>  0
> ReadRepairStage   0 0150 0
>  0
> CounterMutationStage 32   104 897560 0
>  0
> MiscStage 0 0  0 0
>  0
> HintedHandoff 0 0 65 0
>  0
> GossipStage   0 0   2338 0
>  0
> CacheCleanupExecutor  0 0  0 0
>  0
> InternalResponseStage 0 0  0 0
>  0
> CommitLogArchiver 0 0  0 0
>  0
> CompactionExecutor2   190474 0
>  0
> ValidationExecutor0 0  0 0
>  0
> MigrationStage0 0 10 0
>  0
> AntiEntropyStage  0 0  0 0
>  0
> PendingRangeCalculator0 0310 0
>  0
> Sampler   0 0  0 0
>  0
> MemtableFlushWriter   110 94 0
>  0
> MemtablePostFlush 134257 0
>  0
> MemtableReclaimMemory 0 0 94 0
>  0
> Native-Transport-Requests   128   156 38795716
> 278451
> Message type   Dropped
> READ 0
> RANGE_SLICE  0
> _TRACE   0
> MUTATION 0
> COUNTER_MUTATION 0
> BINARY   0
> REQUEST_RESPONSE 0
> PAGED_RANGE  0
> READ_REPAIR  0
> {code}
> Attached is the jstack output for both CMS and G1GC.
> Flight recordings are here:
> https://s3.amazonaws.com/simple-logs/cassandra-102-cms.jfr
> https://s3.amazonaws.com/simple-logs/cassandra-102-g1gc.jfr
> It is interesting to note that while the flight recording was taking place, 
> the load on the machine went back to healthy, and when the

[jira] [Commented] (CASSANDRA-12457) dtest failure in upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_2_1_x_To_indev_2_2_x.bug_5732_test

2016-08-17 Thread Stefania (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425831#comment-15425831
 ] 

Stefania commented on CASSANDRA-12457:
--

I've started a multiplex run 
[here|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-dtest-multiplex/18/]
 that upgrades from 2.2 instead of 2.1 so that we can find out if 2.2 also has 
the same problem.

> dtest failure in 
> upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_2_1_x_To_indev_2_2_x.bug_5732_test
> 
>
> Key: CASSANDRA-12457
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12457
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Craig Kodman
>Assignee: Stefania
>  Labels: dtest
> Fix For: 2.2.x
>
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-2.2_dtest_upgrade/16/testReport/upgrade_tests.cql_tests/TestCQLNodes2RF1_Upgrade_current_2_1_x_To_indev_2_2_x/bug_5732_test
> {code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 358, in run
> self.tearDown()
>   File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_base.py", line 
> 216, in tearDown
> super(UpgradeTester, self).tearDown()
>   File "/home/automaton/cassandra-dtest/dtest.py", line 666, in tearDown
> raise AssertionError('Unexpected error in log, see stdout')
> "Unexpected error in log, see stdout\n >> begin captured 
> logging << \ndtest: DEBUG: Upgrade test beginning, 
> setting CASSANDRA_VERSION to 2.1.15, and jdk to 8. (Prior values will be 
> restored after test).\ndtest: DEBUG: cluster ccm directory: 
> /mnt/tmp/dtest-D8UF3i\ndtest: DEBUG: Done setting configuration options:\n{   
> 'initial_token': None,\n'num_tokens': '32',\n'phi_convict_threshold': 
> 5,\n'range_request_timeout_in_ms': 1,\n
> 'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n   
>  'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
> 1}\ndtest: DEBUG: [[Row(table_name=u'ks', index_name=u'test.testindex')], 
> [Row(table_name=u'ks', index_name=u'test.testindex')]]\ndtest: DEBUG: 
> upgrading node1 to git:91f7387e1f785b18321777311a5c3416af0663c2\nccm: INFO: 
> Fetching Cassandra updates...\ndtest: DEBUG: Querying upgraded node\ndtest: 
> DEBUG: Querying old node\ndtest: DEBUG: removing ccm cluster test at: 
> /mnt/tmp/dtest-D8UF3i\ndtest: DEBUG: clearing ssl stores from 
> [/mnt/tmp/dtest-D8UF3i] directory\n- >> end captured 
> logging << -"
> {code}
> {code}
> Standard Output
> http://git-wip-us.apache.org/repos/asf/cassandra.git 
> git:91f7387e1f785b18321777311a5c3416af0663c2
> Unexpected error in node1 log, error: 
> ERROR [Reference-Reaper:1] 2016-08-13 01:34:34,581 Ref.java:199 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@73deb57f) to class 
> org.apache.cassandra.io.sstable.SSTableReader$DescriptorTypeTidy@2098812276:/mnt/tmp/dtest-D8UF3i/test/node1/data1/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-4
>  was not released before the reference was garbage collected
> Unexpected error in node1 log, error: 
> ERROR [Reference-Reaper:1] 2016-08-13 01:34:34,581 Ref.java:199 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@7926de0f) to class 
> org.apache.cassandra.utils.concurrent.WrappedSharedCloseable$1@1009016655:[[OffHeapBitSet]]
>  was not released before the reference was garbage collected
> Unexpected error in node1 log, error: 
> ERROR [Reference-Reaper:1] 2016-08-13 01:34:34,581 Ref.java:199 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@3a5760f9) to class 
> org.apache.cassandra.io.util.MmappedSegmentedFile$Cleanup@223486002:/mnt/tmp/dtest-D8UF3i/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-3-Index.db
>  was not released before the reference was garbage collected
> Unexpected error in node1 log, error: 
> ERROR [Reference-Reaper:1] 2016-08-13 01:34:34,582 Ref.java:199 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@42cb4131) to class 
> org.apache.cassandra.utils.concurrent.WrappedSharedCloseable$1@1544265728:[Memory@[0..4),
>  Memory@[0..a)] was not released before the reference was garbage collected
> Unexpected error in node1 log, error: 
> ERROR [Reference-Reaper:1] 2016-08-13 01:34:34,582 Ref.java:199 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@5dda43d0) to class 
>

[jira] [Resolved] (CASSANDRA-11767) dtest failure in upgrade_tests.upgrade_through_versions_test.ProtoV3Upgrade_AllVersions_EndsAt_Trunk_HEAD.rolling_upgrade_test

2016-08-17 Thread Stefania (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-11767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefania resolved CASSANDRA-11767.
--
Resolution: Duplicate

> dtest failure in 
> upgrade_tests.upgrade_through_versions_test.ProtoV3Upgrade_AllVersions_EndsAt_Trunk_HEAD.rolling_upgrade_test
> --
>
> Key: CASSANDRA-11767
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11767
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Philip Thompson
>Assignee: Stefania
>Priority: Minor
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node2.log, node2_debug.log, 
> node3.log, node3_debug.log
>
>
> No cassci link, as jenkins is failing to show failures for this test, but I'm 
> seeing detected leaks.
> Relevant log section:
> {code}
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,616 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@41f74411) to class 
> org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Cleanup@1328587359:/mnt/tmp/dtest-X5kTWw/test/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/la-12-big-Data.db
>  was not released before the reference was garbage collected
> DEBUG [Reference-Reaper:1] 2016-05-11 16:17:47,617 FileCacheService.java:177 
> - Invalidating cache for 
> /mnt/tmp/dtest-X5kTWw/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/tmplink-la-13-big-Data.db
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@4b0f2f61) to class 
> org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Cleanup@235776100:/mnt/tmp/dtest-X5kTWw/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/tmplink-la-13-big-Data.db
>  was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@75a1b278) to class 
> org.apache.cassandra.utils.concurrent.WrappedSharedCloseable$1@1061799113:[Memory@[0..8),
>  Memory@[0..50)] was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@d0f8066) to class 
> org.apache.cassandra.io.util.MmappedSegmentedFile$Cleanup@1847744299:/mnt/tmp/dtest-X5kTWw/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/tmplink-la-13-big-Index.db
>  was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@16680ae5) to class 
> org.apache.cassandra.io.util.MmappedSegmentedFile$Cleanup@1744239469:/mnt/tmp/dtest-X5kTWw/test/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/la-12-big-Index.db
>  was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,618 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@160b4b45) to class 
> org.apache.cassandra.utils.concurrent.WrappedSharedCloseable$1@1785515424:[[OffHeapBitSet]]
>  was not released before the reference was garbage collected
> {code}
> Logs are attached. node1 is the one experiencing the issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-11767) dtest failure in upgrade_tests.upgrade_through_versions_test.ProtoV3Upgrade_AllVersions_EndsAt_Trunk_HEAD.rolling_upgrade_test

2016-08-17 Thread Stefania (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425822#comment-15425822
 ] 

Stefania commented on CASSANDRA-11767:
--

There were several failures but all related to CASSANDRA-11393, which is not in 
3.0.8 but the test is still using this version. I also downloaded the logs of 
all failed tests and searched for any leaks reported but did not find any. I 
think it's easier if we try to reproduce it with {{bug_5732_test}} by starting 
the upgrade from 2.2 rather than 2.1, so marking this as duplicate of 
CASSANDRA-12457.



> dtest failure in 
> upgrade_tests.upgrade_through_versions_test.ProtoV3Upgrade_AllVersions_EndsAt_Trunk_HEAD.rolling_upgrade_test
> --
>
> Key: CASSANDRA-11767
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11767
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Philip Thompson
>Assignee: Stefania
>Priority: Minor
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node2.log, node2_debug.log, 
> node3.log, node3_debug.log
>
>
> No cassci link, as jenkins is failing to show failures for this test, but I'm 
> seeing detected leaks.
> Relevant log section:
> {code}
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,616 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@41f74411) to class 
> org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Cleanup@1328587359:/mnt/tmp/dtest-X5kTWw/test/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/la-12-big-Data.db
>  was not released before the reference was garbage collected
> DEBUG [Reference-Reaper:1] 2016-05-11 16:17:47,617 FileCacheService.java:177 
> - Invalidating cache for 
> /mnt/tmp/dtest-X5kTWw/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/tmplink-la-13-big-Data.db
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@4b0f2f61) to class 
> org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Cleanup@235776100:/mnt/tmp/dtest-X5kTWw/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/tmplink-la-13-big-Data.db
>  was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@75a1b278) to class 
> org.apache.cassandra.utils.concurrent.WrappedSharedCloseable$1@1061799113:[Memory@[0..8),
>  Memory@[0..50)] was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@d0f8066) to class 
> org.apache.cassandra.io.util.MmappedSegmentedFile$Cleanup@1847744299:/mnt/tmp/dtest-X5kTWw/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/tmplink-la-13-big-Index.db
>  was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,617 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@16680ae5) to class 
> org.apache.cassandra.io.util.MmappedSegmentedFile$Cleanup@1744239469:/mnt/tmp/dtest-X5kTWw/test/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/la-12-big-Index.db
>  was not released before the reference was garbage collected
> ERROR [Reference-Reaper:1] 2016-05-11 16:17:47,618 Ref.java:187 - LEAK 
> DETECTED: a reference 
> (org.apache.cassandra.utils.concurrent.Ref$State@160b4b45) to class 
> org.apache.cassandra.utils.concurrent.WrappedSharedCloseable$1@1785515424:[[OffHeapBitSet]]
>  was not released before the reference was garbage collected
> {code}
> Logs are attached. node1 is the one experiencing the issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12486) Structure for compactionhistory output (JSON, YAML)

2016-08-17 Thread Masataka Yamaguchi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Masataka Yamaguchi updated CASSANDRA-12486:
---
Attachment: CASSANDRA-12486-trunk.patch

> Structure for compactionhistory output (JSON, YAML)
> ---
>
> Key: CASSANDRA-12486
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12486
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Tools
>Reporter: Masataka Yamaguchi
>Priority: Minor
> Attachments: CASSANDRA-12486-trunk.patch, 
> compactionhistory_result.json, compactionhistory_result.txt, 
> compactionhistory_result.yaml
>
>
> As with nodetool tpstats and tablestats (CASSANDRA-12035), nodetool 
> compactionhistory should also support useful output formats such as JSON or 
> YAML, so we implemented it. 
> Please review the attached patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12486) Structure for compactionhistory output (JSON, YAML)

2016-08-17 Thread Masataka Yamaguchi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Masataka Yamaguchi updated CASSANDRA-12486:
---
Attachment: (was: CASSANDRA-12486-trunk.patch)

> Structure for compactionhistory output (JSON, YAML)
> ---
>
> Key: CASSANDRA-12486
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12486
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Tools
>Reporter: Masataka Yamaguchi
>Priority: Minor
> Attachments: CASSANDRA-12486-trunk.patch, 
> compactionhistory_result.json, compactionhistory_result.txt, 
> compactionhistory_result.yaml
>
>
> As with nodetool tpstats and tablestats (CASSANDRA-12035), nodetool 
> compactionhistory should also support useful output formats such as JSON or 
> YAML, so we implemented it. 
> Please review the attached patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12423) Cells missing from compact storage table after upgrading from 2.1.9 to 3.7

2016-08-17 Thread Stefania (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefania updated CASSANDRA-12423:
-
Status: Patch Available  (was: In Progress)

> Cells missing from compact storage table after upgrading from 2.1.9 to 3.7
> --
>
> Key: CASSANDRA-12423
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12423
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Tomasz Grabiec
>Assignee: Stefania
> Attachments: 12423.tar.gz
>
>
> Schema:
> {code}
> create table ks1.test ( id int, c1 text, c2 text, v int, primary key (id, c1, 
> c2)) with compact storage and compression = {'sstable_compression': ''};
> {code}
> sstable2json before upgrading:
> {code}
> [
> {"key": "1",
>  "cells": [["","0",1470761440040513],
>["a","asd",2470761440040513,"t",1470764842],
>["asd:","0",1470761451368658],
>["asd:asd","0",1470761449416613]]}
> ]
> {code}
> Query result with 2.1.9:
> {code}
> cqlsh> select * from ks1.test;
>  id | c1  | c2   | v
> +-+--+---
>   1 | | null | 0
>   1 | asd |  | 0
>   1 | asd |  asd | 0
> (3 rows)
> {code}
> Query result with 3.7:
> {code}
> cqlsh> select * from ks1.test;
>  id | 6331 | 6332 | v
> +--+--+---
>   1 |  | null | 0
> (1 rows)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12423) Cells missing from compact storage table after upgrading from 2.1.9 to 3.7

2016-08-17 Thread Stefania (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425798#comment-15425798
 ] 

Stefania commented on CASSANDRA-12423:
--

The tests look better now, I've restarted the unit and dtests for trunk and the 
dtests for 3.0 to shake off some unrelated failures that have been fixed in the 
last couple of days.

I changed the initial approach and I've added a new legacy bound kind that 
behaves like {{Composites.EOC.NONE}} does in 2.1: an inclusive END but it 
compares before clustering values. This patch is ready for review, the issue 
with the clustering column names is probably better dealt with in a separate 
ticket if it needs fixing, ping [~iamaleksey].

> Cells missing from compact storage table after upgrading from 2.1.9 to 3.7
> --
>
> Key: CASSANDRA-12423
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12423
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Tomasz Grabiec
>Assignee: Stefania
> Attachments: 12423.tar.gz
>
>
> Schema:
> {code}
> create table ks1.test ( id int, c1 text, c2 text, v int, primary key (id, c1, 
> c2)) with compact storage and compression = {'sstable_compression': ''};
> {code}
> sstable2json before upgrading:
> {code}
> [
> {"key": "1",
>  "cells": [["","0",1470761440040513],
>["a","asd",2470761440040513,"t",1470764842],
>["asd:","0",1470761451368658],
>["asd:asd","0",1470761449416613]]}
> ]
> {code}
> Query result with 2.1.9:
> {code}
> cqlsh> select * from ks1.test;
>  id | c1  | c2   | v
> +-+--+---
>   1 | | null | 0
>   1 | asd |  | 0
>   1 | asd |  asd | 0
> (3 rows)
> {code}
> Query result with 3.7:
> {code}
> cqlsh> select * from ks1.test;
>  id | 6331 | 6332 | v
> +--+--+---
>   1 |  | null | 0
> (1 rows)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12474) Define executeLocally() at the ReadQuery Level

2016-08-17 Thread Stefania (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefania updated CASSANDRA-12474:
-
Reviewer: Tyler Hobbs
  Status: Patch Available  (was: In Progress)

> Define executeLocally() at the ReadQuery Level
> --
>
> Key: CASSANDRA-12474
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12474
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Local Write-Read Paths
>Reporter: Stefania
>Assignee: Stefania
> Fix For: 3.x
>
>
> We have {{execute}} and {{executeInternal}} at the {{ReadQuery}} level but 
> {{executeLocally}} is missing and this makes the abstraction incomplete.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12474) Define executeLocally() at the ReadQuery Level

2016-08-17 Thread Stefania (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stefania updated CASSANDRA-12474:
-
Component/s: Local Write-Read Paths

> Define executeLocally() at the ReadQuery Level
> --
>
> Key: CASSANDRA-12474
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12474
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Local Write-Read Paths
>Reporter: Stefania
>Assignee: Stefania
> Fix For: 3.x
>
>
> We have {{execute}} and {{executeInternal}} at the {{ReadQuery}} level but 
> {{executeLocally}} is missing and this makes the abstraction incomplete.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12474) Define executeLocally() at the ReadQuery Level

2016-08-17 Thread Stefania (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425791#comment-15425791
 ] 

Stefania commented on CASSANDRA-12474:
--

The patch for trunk is available, the dtest results are still pending however:

|[patch|https://github.com/stef1927/cassandra/commits/12474]|[testall|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-12474-testall/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-12474-dtest/]|

> Define executeLocally() at the ReadQuery Level
> --
>
> Key: CASSANDRA-12474
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12474
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Stefania
>Assignee: Stefania
> Fix For: 3.x
>
>
> We have {{execute}} and {{executeInternal}} at the {{ReadQuery}} level but 
> {{executeLocally}} is missing and this makes the abstraction incomplete.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-9054) Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread Robert Stupp (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Stupp updated CASSANDRA-9054:

   Resolution: Fixed
Fix Version/s: (was: 3.x)
   3.10
   Status: Resolved  (was: Ready to Commit)

Thanks!

Committed as 
[9797511c56df4e9c7db964a6b83e67642df96c2d|https://github.com/apache/cassandra/commit/9797511c56df4e9c7db964a6b83e67642df96c2d]
 to [trunk|https://github.com/apache/cassandra/tree/trunk]


> Let DatabaseDescriptor not implicitly startup services
> --
>
> Key: CASSANDRA-9054
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9054
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Jeremiah Jordan
>Assignee: Robert Stupp
> Fix For: 3.10
>
>
> Right now to get at Config stuff you go through DatabaseDescriptor.  But when 
> you instantiate DatabaseDescriptor it actually opens system tables and such, 
> which triggers commit log replays, and other things if the right flags aren't 
> set ahead of time.  This makes getting at config stuff from tools annoying, 
> as you have to be very careful about instantiation orders.
> It would be nice if we could break DatabaseDescriptor up into multiple 
> classes, so that getting at config stuff from tools wasn't such a pain.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[5/6] cassandra git commit: Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread snazy 
http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
--
diff --git a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java 
b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
index 6f71817..f9d0498 100644
--- a/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
+++ b/src/java/org/apache/cassandra/config/DatabaseDescriptor.java
@@ -35,30 +35,31 @@ import com.google.common.primitives.Longs;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
-import org.apache.cassandra.auth.*;
+import org.apache.cassandra.auth.AuthConfig;
+import org.apache.cassandra.auth.IAuthenticator;
+import org.apache.cassandra.auth.IAuthorizer;
+import org.apache.cassandra.auth.IInternodeAuthenticator;
+import org.apache.cassandra.auth.IRoleManager;
 import org.apache.cassandra.config.Config.CommitLogSync;
 import org.apache.cassandra.config.Config.RequestSchedulerId;
-import org.apache.cassandra.config.EncryptionOptions.ClientEncryptionOptions;
-import org.apache.cassandra.config.EncryptionOptions.ServerEncryptionOptions;
-import org.apache.cassandra.db.ColumnFamilyStore;
-import org.apache.cassandra.db.SystemKeyspace;
 import org.apache.cassandra.dht.IPartitioner;
 import org.apache.cassandra.exceptions.ConfigurationException;
 import org.apache.cassandra.io.FSWriteError;
-import org.apache.cassandra.io.sstable.format.SSTableFormat;
 import org.apache.cassandra.io.util.DiskOptimizationStrategy;
 import org.apache.cassandra.io.util.FileUtils;
 import org.apache.cassandra.io.util.SpinningDiskOptimizationStrategy;
 import org.apache.cassandra.io.util.SsdDiskOptimizationStrategy;
-import org.apache.cassandra.locator.*;
-import org.apache.cassandra.net.MessagingService;
+import org.apache.cassandra.locator.DynamicEndpointSnitch;
+import org.apache.cassandra.locator.EndpointSnitchInfo;
+import org.apache.cassandra.locator.IEndpointSnitch;
+import org.apache.cassandra.locator.SeedProvider;
 import org.apache.cassandra.scheduler.IRequestScheduler;
 import org.apache.cassandra.scheduler.NoScheduler;
 import org.apache.cassandra.security.EncryptionContext;
-import org.apache.cassandra.service.CacheService;
-import org.apache.cassandra.thrift.ThriftServer;
+import org.apache.cassandra.service.CacheService.CacheType;
+import org.apache.cassandra.thrift.ThriftServer.ThriftServerType;
 import org.apache.cassandra.utils.FBUtilities;
-import org.apache.cassandra.utils.memory.*;
+
 import org.apache.commons.lang3.StringUtils;
 
 public class DatabaseDescriptor
@@ -71,6 +72,8 @@ public class DatabaseDescriptor
  */
 private static final int MAX_NUM_TOKENS = 1536;
 
+private static Config conf;
+
 private static IEndpointSnitch snitch;
 private static InetAddress listenAddress; // leave null so we can fall 
through to getLocalHost
 private static InetAddress broadcastAddress;
@@ -85,12 +88,8 @@ public class DatabaseDescriptor
 
 private static Config.DiskAccessMode indexAccessMode;
 
-private static Config conf;
-
-private static SSTableFormat.Type sstable_format = SSTableFormat.Type.BIG;
-
-private static IAuthenticator authenticator = new AllowAllAuthenticator();
-private static IAuthorizer authorizer = new AllowAllAuthorizer();
+private static IAuthenticator authenticator;
+private static IAuthorizer authorizer;
 // Don't initialize the role manager until applying config. The options 
supported by CassandraRoleManager
 // depend on the configured IAuthenticator, so defer creating it until 
that's been set.
 private static IRoleManager roleManager;
@@ -113,36 +112,63 @@ public class DatabaseDescriptor
 
 private static DiskOptimizationStrategy diskOptimizationStrategy;
 
-public static void forceStaticInitialization() {}
-static
+private static boolean clientInitialized;
+private static boolean toolInitialized;
+private static boolean daemonInitialized;
+
+public static void daemonInitialization() throws ConfigurationException
 {
-// In client mode, we use a default configuration. Note that the 
fields of this class will be
-// left unconfigured however (the partitioner or localDC will be null 
for instance) so this
-// should be used with care.
-try
-{
-if (Config.isClientMode())
-{
-conf = new Config();
-}
-else
-{
-applyConfig(loadConfig());
-}
-switch (conf.disk_optimization_strategy)
-{
-case ssd:
-diskOptimizationStrategy = new 
SsdDiskOptimizationStrategy(conf.disk_optimization_page_cross_chance);
-break;
-case spinning:
-diskOptimizationStrategy = new 
SpinningDiskOptimizationStrategy();
-break;
-

[6/6] cassandra git commit: Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread snazy 
Let DatabaseDescriptor not implicitly startup services

patch by Robert Stupp; reviewed by Blake Eggleston for CASSANDRA-9054


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/9797511c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/9797511c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/9797511c

Branch: refs/heads/trunk
Commit: 9797511c56df4e9c7db964a6b83e67642df96c2d
Parents: 8580047
Author: Robert Stupp 
Authored: Thu Aug 18 11:44:03 2016 +1000
Committer: Robert Stupp 
Committed: Thu Aug 18 11:44:03 2016 +1000

--
 CHANGES.txt |   1 +
 NEWS.txt|   6 +
 .../org/apache/cassandra/auth/AuthConfig.java   | 113 +++
 .../org/apache/cassandra/auth/AuthKeyspace.java |   7 +-
 .../cassandra/auth/CassandraAuthorizer.java |  45 +-
 .../cassandra/auth/CassandraRoleManager.java|  41 +-
 .../cassandra/auth/PasswordAuthenticator.java   |  11 +-
 .../cassandra/batchlog/BatchlogManager.java |   7 +-
 .../batchlog/LegacyBatchlogMigrator.java|   9 +-
 .../apache/cassandra/cache/AutoSavingCache.java |   4 +-
 .../org/apache/cassandra/config/CFMetaData.java |   6 +-
 .../org/apache/cassandra/config/Config.java |  33 +-
 .../cassandra/config/DatabaseDescriptor.java| 834 ++-
 .../org/apache/cassandra/config/Schema.java |  50 +-
 .../cassandra/config/SchemaConstants.java   |  74 ++
 .../config/YamlConfigurationLoader.java |   4 +-
 .../apache/cassandra/cql3/QueryProcessor.java   |   4 +-
 .../cassandra/cql3/functions/FunctionName.java  |   8 +-
 .../cql3/statements/AlterKeyspaceStatement.java |   3 +-
 .../statements/CreateKeyspaceStatement.java |   6 +-
 .../cql3/statements/CreateTableStatement.java   |   4 +-
 .../statements/ListPermissionsStatement.java|   3 +-
 .../cql3/statements/ListRolesStatement.java |   3 +-
 .../cql3/statements/ListUsersStatement.java |   3 +-
 .../PermissionsManagementStatement.java |   4 +-
 .../apache/cassandra/db/ColumnFamilyStore.java  |   4 +-
 src/java/org/apache/cassandra/db/Keyspace.java  |   4 +-
 .../org/apache/cassandra/db/LegacyLayout.java   |   5 +-
 src/java/org/apache/cassandra/db/Memtable.java  |  33 +-
 .../org/apache/cassandra/db/ReadCommand.java|   2 +-
 .../org/apache/cassandra/db/SystemKeyspace.java |  43 +-
 .../db/commitlog/CommitLogReplayer.java |  10 +-
 .../cassandra/hadoop/cql3/CqlInputFormat.java   |   3 +-
 .../apache/cassandra/hints/HintsDispatcher.java |   3 +-
 .../cassandra/hints/LegacyHintsMigrator.java|  15 +-
 .../io/compress/DeflateCompressor.java  |  20 +-
 .../io/sstable/AbstractSSTableSimpleWriter.java |   6 +-
 .../apache/cassandra/io/sstable/Descriptor.java |   9 +
 .../io/sstable/format/SSTableFormat.java|   5 +
 .../io/sstable/format/SSTableReader.java|  15 +-
 .../locator/DynamicEndpointSnitch.java  |  25 +-
 .../apache/cassandra/metrics/TableMetrics.java  |   4 +-
 .../org/apache/cassandra/net/MessageIn.java |   2 +-
 .../org/apache/cassandra/net/MessageOut.java|   3 +-
 .../apache/cassandra/net/MessagingService.java  | 109 ++-
 .../apache/cassandra/repair/RepairRunnable.java |   3 +-
 .../repair/SystemDistributedKeyspace.java   |  37 +-
 .../cassandra/schema/KeyspaceMetadata.java  |   4 +-
 .../cassandra/schema/LegacySchemaMigrator.java  |  40 +-
 .../apache/cassandra/schema/SchemaKeyspace.java |  52 +-
 .../cassandra/service/CassandraDaemon.java  |  21 +-
 .../apache/cassandra/service/ClientState.java   |  23 +-
 .../service/EmbeddedCassandraService.java   |   5 +-
 .../cassandra/service/MigrationManager.java |   3 +-
 .../apache/cassandra/service/StartupChecks.java |   3 +-
 .../apache/cassandra/service/StorageProxy.java  |  13 +-
 .../cassandra/service/StorageService.java   |  21 +-
 .../streaming/messages/FileMessageHeader.java   |   3 +-
 .../cassandra/thrift/TServerCustomFactory.java  |   6 +-
 .../apache/cassandra/thrift/ThriftServer.java   |  12 +-
 .../cassandra/thrift/ThriftValidation.java  |   3 +-
 .../org/apache/cassandra/tools/BulkLoader.java  |   3 +-
 .../org/apache/cassandra/tools/NodeProbe.java   |   4 +-
 .../apache/cassandra/tools/SSTableExport.java   |   4 +-
 .../tools/SSTableRepairedAtSetter.java  |   4 +-
 .../cassandra/tools/StandaloneSSTableUtil.java  |   2 +
 .../cassandra/tools/StandaloneScrubber.java |   2 +-
 .../cassandra/tools/StandaloneSplitter.java |   2 +-
 .../cassandra/tools/StandaloneUpgrader.java |   3 +-
 .../cassandra/tools/StandaloneVerifier.java |   2 +-
 src/java/org/apache/cassandra/tools/Util.java   |  13 +-
 .../cassandra/tools/nodetool/Cleanup.java   |   6 +-
 .../apache/cassandra/tools/nodetool/Repair.java |   6 +-

[jira] [Commented] (CASSANDRA-8616) sstable tools may result in commit log segments be written

2016-08-17 Thread Robert Stupp (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425784#comment-15425784
 ] 

Robert Stupp commented on CASSANDRA-8616:
-

[~yukim] CASSANDRA-9054 is now committed. Can you check whether this is still 
an issue?

> sstable tools may result in commit log segments be written
> --
>
> Key: CASSANDRA-8616
> URL: https://issues.apache.org/jira/browse/CASSANDRA-8616
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tools
>Reporter: Tyler Hobbs
>Assignee: Yuki Morishita
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.x
>
> Attachments: 8161-2.0.txt
>
>
> There was a report of sstable2json causing commitlog segments to be written 
> out when run.  I haven't attempted to reproduce this yet, so that's all I 
> know for now.  Since sstable2json loads the conf and schema, I'm thinking 
> that it may inadvertently be triggering the commitlog code.
> sstablescrub, sstableverify, and other sstable tools have the same issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[2/6] cassandra git commit: Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread snazy 
http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/test/unit/org/apache/cassandra/db/LegacyCellNameTest.java
--
diff --git a/test/unit/org/apache/cassandra/db/LegacyCellNameTest.java 
b/test/unit/org/apache/cassandra/db/LegacyCellNameTest.java
index fa29b1e..8398ede 100644
--- a/test/unit/org/apache/cassandra/db/LegacyCellNameTest.java
+++ b/test/unit/org/apache/cassandra/db/LegacyCellNameTest.java
@@ -17,14 +17,22 @@
  */
 package org.apache.cassandra.db;
 
+import org.junit.BeforeClass;
 import org.junit.Test;
 
 import org.apache.cassandra.config.CFMetaData;
+import org.apache.cassandra.config.DatabaseDescriptor;
 
 import static junit.framework.Assert.assertTrue;
 
 public class LegacyCellNameTest
 {
+@BeforeClass
+public static void setupDD()
+{
+DatabaseDescriptor.daemonInitialization();
+}
+
 @Test
 public void testColumnSameNameAsPartitionKeyCompactStorage() throws 
Exception
 {

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/test/unit/org/apache/cassandra/db/ReadCommandTest.java
--
diff --git a/test/unit/org/apache/cassandra/db/ReadCommandTest.java 
b/test/unit/org/apache/cassandra/db/ReadCommandTest.java
index 663080b..fddd347 100644
--- a/test/unit/org/apache/cassandra/db/ReadCommandTest.java
+++ b/test/unit/org/apache/cassandra/db/ReadCommandTest.java
@@ -26,6 +26,7 @@ import org.junit.Test;
 import org.apache.cassandra.SchemaLoader;
 import org.apache.cassandra.Util;
 import org.apache.cassandra.config.CFMetaData;
+import org.apache.cassandra.config.DatabaseDescriptor;
 import org.apache.cassandra.db.marshal.AsciiType;
 import org.apache.cassandra.db.marshal.BytesType;
 import org.apache.cassandra.db.partitions.FilteredPartition;
@@ -44,6 +45,8 @@ public class ReadCommandTest
 @BeforeClass
 public static void defineSchema() throws ConfigurationException
 {
+DatabaseDescriptor.daemonInitialization();
+
 CFMetaData metadata1 = SchemaLoader.standardCFMD(KEYSPACE, CF1);
 
 CFMetaData metadata2 = CFMetaData.Builder.create(KEYSPACE, CF2)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/test/unit/org/apache/cassandra/db/ReadMessageTest.java
--
diff --git a/test/unit/org/apache/cassandra/db/ReadMessageTest.java 
b/test/unit/org/apache/cassandra/db/ReadMessageTest.java
index 4047cc9..f76bf93 100644
--- a/test/unit/org/apache/cassandra/db/ReadMessageTest.java
+++ b/test/unit/org/apache/cassandra/db/ReadMessageTest.java
@@ -30,6 +30,7 @@ import org.apache.cassandra.SchemaLoader;
 import org.apache.cassandra.Util;
 import org.apache.cassandra.config.CFMetaData;
 import org.apache.cassandra.config.ColumnDefinition;
+import org.apache.cassandra.config.DatabaseDescriptor;
 import org.apache.cassandra.db.commitlog.CommitLogTestReplayer;
 import org.apache.cassandra.db.partitions.PartitionUpdate;
 import org.apache.cassandra.db.rows.Row;
@@ -43,8 +44,6 @@ import org.apache.cassandra.io.util.DataInputPlus;
 import org.apache.cassandra.io.util.DataOutputBuffer;
 import org.apache.cassandra.net.MessagingService;
 import org.apache.cassandra.schema.KeyspaceParams;
-import org.apache.cassandra.service.CassandraDaemon;
-import org.apache.cassandra.service.StorageService;
 import org.apache.cassandra.utils.ByteBufferUtil;
 
 public class ReadMessageTest
@@ -58,9 +57,7 @@ public class ReadMessageTest
 @BeforeClass
 public static void defineSchema() throws ConfigurationException
 {
-CassandraDaemon daemon = new CassandraDaemon();
-daemon.completeSetup(); //startup must be completed, otherwise commit 
log failure must kill JVM regardless of failure policy
-StorageService.instance.registerDaemon(daemon);
+DatabaseDescriptor.daemonInitialization();
 
 CFMetaData cfForReadMetadata = CFMetaData.Builder.create(KEYSPACE1, 
CF_FOR_READ_TEST)
 
.addPartitionKey("key", BytesType.instance)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/test/unit/org/apache/cassandra/db/RecoveryManagerFlushedTest.java
--
diff --git a/test/unit/org/apache/cassandra/db/RecoveryManagerFlushedTest.java 
b/test/unit/org/apache/cassandra/db/RecoveryManagerFlushedTest.java
index 86fa5b4..0b20343 100644
--- a/test/unit/org/apache/cassandra/db/RecoveryManagerFlushedTest.java
+++ b/test/unit/org/apache/cassandra/db/RecoveryManagerFlushedTest.java
@@ -36,6 +36,7 @@ import org.slf4j.LoggerFactory;
 import org.apache.cassandra.SchemaLoader;
 import org.apache.cassandra.config.DatabaseDescriptor;
 import org.apache.cassandra.config.ParameterizedClass;
+import org.apache.cassandra.config.SchemaConstants;
 import

[1/6] cassandra git commit: Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread snazy 
Repository: cassandra
Updated Branches:
  refs/heads/trunk 858004791 -> 9797511c5


http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/test/unit/org/apache/cassandra/schema/SchemaKeyspaceTest.java
--
diff --git a/test/unit/org/apache/cassandra/schema/SchemaKeyspaceTest.java 
b/test/unit/org/apache/cassandra/schema/SchemaKeyspaceTest.java
index d686fdb..2f83498 100644
--- a/test/unit/org/apache/cassandra/schema/SchemaKeyspaceTest.java
+++ b/test/unit/org/apache/cassandra/schema/SchemaKeyspaceTest.java
@@ -35,6 +35,7 @@ import org.apache.cassandra.SchemaLoader;
 import org.apache.cassandra.config.CFMetaData;
 import org.apache.cassandra.config.ColumnDefinition;
 import org.apache.cassandra.config.Schema;
+import org.apache.cassandra.config.SchemaConstants;
 import org.apache.cassandra.cql3.QueryProcessor;
 import org.apache.cassandra.cql3.UntypedResultSet;
 import org.apache.cassandra.db.ColumnFamilyStore;
@@ -188,15 +189,15 @@ public class SchemaKeyspaceTest
 
 // Test schema conversion
 Mutation rm = SchemaKeyspace.makeCreateTableMutation(keyspace, cfm, 
FBUtilities.timestampMicros()).build();
-PartitionUpdate serializedCf = 
rm.getPartitionUpdate(Schema.instance.getId(SchemaKeyspace.NAME, 
SchemaKeyspace.TABLES));
-PartitionUpdate serializedCD = 
rm.getPartitionUpdate(Schema.instance.getId(SchemaKeyspace.NAME, 
SchemaKeyspace.COLUMNS));
+PartitionUpdate serializedCf = 
rm.getPartitionUpdate(Schema.instance.getId(SchemaConstants.SCHEMA_KEYSPACE_NAME,
 SchemaKeyspace.TABLES));
+PartitionUpdate serializedCD = 
rm.getPartitionUpdate(Schema.instance.getId(SchemaConstants.SCHEMA_KEYSPACE_NAME,
 SchemaKeyspace.COLUMNS));
 
-UntypedResultSet.Row tableRow = 
QueryProcessor.resultify(String.format("SELECT * FROM %s.%s", 
SchemaKeyspace.NAME, SchemaKeyspace.TABLES),
+UntypedResultSet.Row tableRow = 
QueryProcessor.resultify(String.format("SELECT * FROM %s.%s", 
SchemaConstants.SCHEMA_KEYSPACE_NAME, SchemaKeyspace.TABLES),
  
UnfilteredRowIterators.filter(serializedCf.unfilteredIterator(), 
FBUtilities.nowInSeconds()))
   .one();
 TableParams params = SchemaKeyspace.createTableParamsFromRow(tableRow);
 
-UntypedResultSet columnsRows = 
QueryProcessor.resultify(String.format("SELECT * FROM %s.%s", 
SchemaKeyspace.NAME, SchemaKeyspace.COLUMNS),
+UntypedResultSet columnsRows = 
QueryProcessor.resultify(String.format("SELECT * FROM %s.%s", 
SchemaConstants.SCHEMA_KEYSPACE_NAME, SchemaKeyspace.COLUMNS),
 
UnfilteredRowIterators.filter(serializedCD.unfilteredIterator(), 
FBUtilities.nowInSeconds()));
 Set columns = new HashSet<>();
 for (UntypedResultSet.Row row : columnsRows)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/test/unit/org/apache/cassandra/security/EncryptionUtilsTest.java
--
diff --git a/test/unit/org/apache/cassandra/security/EncryptionUtilsTest.java 
b/test/unit/org/apache/cassandra/security/EncryptionUtilsTest.java
index be37f45..70b327e 100644
--- a/test/unit/org/apache/cassandra/security/EncryptionUtilsTest.java
+++ b/test/unit/org/apache/cassandra/security/EncryptionUtilsTest.java
@@ -31,8 +31,10 @@ import javax.crypto.ShortBufferException;
 
 import org.junit.Assert;
 import org.junit.Before;
+import org.junit.BeforeClass;
 import org.junit.Test;
 
+import org.apache.cassandra.config.DatabaseDescriptor;
 import org.apache.cassandra.config.TransparentDataEncryptionOptions;
 import org.apache.cassandra.io.compress.ICompressor;
 import org.apache.cassandra.io.compress.LZ4Compressor;
@@ -40,6 +42,12 @@ import org.apache.cassandra.io.util.RandomAccessReader;
 
 public class EncryptionUtilsTest
 {
+@BeforeClass
+public static void initDD()
+{
+DatabaseDescriptor.daemonInitialization();
+}
+
 final Random random = new Random();
 ICompressor compressor;
 TransparentDataEncryptionOptions tdeOptions;

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/test/unit/org/apache/cassandra/service/DataResolverTest.java
--
diff --git a/test/unit/org/apache/cassandra/service/DataResolverTest.java 
b/test/unit/org/apache/cassandra/service/DataResolverTest.java
index 156bd66..93415ba 100644
--- a/test/unit/org/apache/cassandra/service/DataResolverTest.java
+++ b/test/unit/org/apache/cassandra/service/DataResolverTest.java
@@ -31,6 +31,7 @@ import org.apache.cassandra.SchemaLoader;
 import org.apache.cassandra.Util;
 import org.apache.cassandra.config.CFMetaData;
 import org.apache.cassandra.config.ColumnDefinition;
+import

[4/6] cassandra git commit: Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread snazy 
http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/src/java/org/apache/cassandra/db/SystemKeyspace.java
--
diff --git a/src/java/org/apache/cassandra/db/SystemKeyspace.java 
b/src/java/org/apache/cassandra/db/SystemKeyspace.java
index def21bf..c204e0a 100644
--- a/src/java/org/apache/cassandra/db/SystemKeyspace.java
+++ b/src/java/org/apache/cassandra/db/SystemKeyspace.java
@@ -39,6 +39,7 @@ import org.slf4j.LoggerFactory;
 
 import org.apache.cassandra.config.CFMetaData;
 import org.apache.cassandra.config.DatabaseDescriptor;
+import org.apache.cassandra.config.SchemaConstants;
 import org.apache.cassandra.cql3.QueryProcessor;
 import org.apache.cassandra.cql3.UntypedResultSet;
 import org.apache.cassandra.cql3.functions.*;
@@ -84,8 +85,6 @@ public final class SystemKeyspace
 // Cassandra was not previously installed and we're in the process of 
starting a fresh node.
 public static final CassandraVersion NULL_VERSION = new 
CassandraVersion("0.0.0-absent");
 
-public static final String NAME = "system";
-
 public static final String BATCHES = "batches";
 public static final String PAXOS = "paxos";
 public static final String BUILT_INDEXES = "IndexInfo";
@@ -432,13 +431,13 @@ public final class SystemKeyspace
 
 private static CFMetaData compile(String name, String description, String 
schema)
 {
-return CFMetaData.compile(String.format(schema, name), NAME)
+return CFMetaData.compile(String.format(schema, name), 
SchemaConstants.SYSTEM_KEYSPACE_NAME)
  .comment(description);
 }
 
 public static KeyspaceMetadata metadata()
 {
-return KeyspaceMetadata.create(NAME, KeyspaceParams.local(), tables(), 
Views.none(), Types.none(), functions());
+return KeyspaceMetadata.create(SchemaConstants.SYSTEM_KEYSPACE_NAME, 
KeyspaceParams.local(), tables(), Views.none(), Types.none(), functions());
 }
 
 private static Tables tables()
@@ -557,14 +556,14 @@ public final class SystemKeyspace
 public static boolean isViewBuilt(String keyspaceName, String viewName)
 {
 String req = "SELECT view_name FROM %s.\"%s\" WHERE keyspace_name=? 
AND view_name=?";
-UntypedResultSet result = executeInternal(String.format(req, NAME, 
BUILT_VIEWS), keyspaceName, viewName);
+UntypedResultSet result = executeInternal(String.format(req, 
SchemaConstants.SYSTEM_KEYSPACE_NAME, BUILT_VIEWS), keyspaceName, viewName);
 return !result.isEmpty();
 }
 
 public static boolean isViewStatusReplicated(String keyspaceName, String 
viewName)
 {
 String req = "SELECT status_replicated FROM %s.\"%s\" WHERE 
keyspace_name=? AND view_name=?";
-UntypedResultSet result = executeInternal(String.format(req, NAME, 
BUILT_VIEWS), keyspaceName, viewName);
+UntypedResultSet result = executeInternal(String.format(req, 
SchemaConstants.SYSTEM_KEYSPACE_NAME, BUILT_VIEWS), keyspaceName, viewName);
 
 if (result.isEmpty())
 return false;
@@ -575,18 +574,18 @@ public final class SystemKeyspace
 public static void setViewBuilt(String keyspaceName, String viewName, 
boolean replicated)
 {
 String req = "INSERT INTO %s.\"%s\" (keyspace_name, view_name, 
status_replicated) VALUES (?, ?, ?)";
-executeInternal(String.format(req, NAME, BUILT_VIEWS), keyspaceName, 
viewName, replicated);
+executeInternal(String.format(req, 
SchemaConstants.SYSTEM_KEYSPACE_NAME, BUILT_VIEWS), keyspaceName, viewName, 
replicated);
 forceBlockingFlush(BUILT_VIEWS);
 }
 
 public static void setViewRemoved(String keyspaceName, String viewName)
 {
 String buildReq = "DELETE FROM %S.%s WHERE keyspace_name = ? AND 
view_name = ?";
-executeInternal(String.format(buildReq, NAME, 
VIEWS_BUILDS_IN_PROGRESS), keyspaceName, viewName);
+executeInternal(String.format(buildReq, 
SchemaConstants.SYSTEM_KEYSPACE_NAME, VIEWS_BUILDS_IN_PROGRESS), keyspaceName, 
viewName);
 forceBlockingFlush(VIEWS_BUILDS_IN_PROGRESS);
 
 String builtReq = "DELETE FROM %s.\"%s\" WHERE keyspace_name = ? AND 
view_name = ?";
-executeInternal(String.format(builtReq, NAME, BUILT_VIEWS), 
keyspaceName, viewName);
+executeInternal(String.format(builtReq, 
SchemaConstants.SYSTEM_KEYSPACE_NAME, BUILT_VIEWS), keyspaceName, viewName);
 forceBlockingFlush(BUILT_VIEWS);
 }
 
@@ -814,7 +813,7 @@ public final class SystemKeyspace
 public static void forceBlockingFlush(String cfname)
 {
 if (!Boolean.getBoolean("cassandra.unsafesystem"))
-
FBUtilities.waitOnFuture(Keyspace.open(NAME).getColumnFamilyStore(cfname).forceFlush());
+
FBUtilities.waitOnFuture(Keyspace.open(SchemaConstants.SYSTEM_KEYSPACE_NAME).getColumnFamilyStore(cfname).forceFlush());
 }
 
 /**
@@ -930,7 +929,7 @@ public final class

[3/6] cassandra git commit: Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread snazy 
http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/src/java/org/apache/cassandra/service/StorageProxy.java
--
diff --git a/src/java/org/apache/cassandra/service/StorageProxy.java 
b/src/java/org/apache/cassandra/service/StorageProxy.java
index 9cfbd68..a0f39af 100644
--- a/src/java/org/apache/cassandra/service/StorageProxy.java
+++ b/src/java/org/apache/cassandra/service/StorageProxy.java
@@ -45,6 +45,7 @@ import org.apache.cassandra.concurrent.StageManager;
 import org.apache.cassandra.config.CFMetaData;
 import org.apache.cassandra.config.DatabaseDescriptor;
 import org.apache.cassandra.config.Schema;
+import org.apache.cassandra.config.SchemaConstants;
 import org.apache.cassandra.db.*;
 import org.apache.cassandra.db.filter.DataLimits;
 import org.apache.cassandra.db.filter.TombstoneOverwhelmingException;
@@ -964,7 +965,7 @@ public class StorageProxy implements StorageProxyMBean
 WriteResponseHandler handler = new 
WriteResponseHandler<>(endpoints.all,
  
Collections.emptyList(),
  
endpoints.all.size() == 1 ? ConsistencyLevel.ONE : ConsistencyLevel.TWO,
- 
Keyspace.open(SystemKeyspace.NAME),
+ 
Keyspace.open(SchemaConstants.SYSTEM_KEYSPACE_NAME),
  null,
  
WriteType.BATCH_LOG,
  
queryStartNanoTime);
@@ -1519,7 +1520,7 @@ public class StorageProxy implements StorageProxyMBean
 private static boolean systemKeyspaceQuery(List 
cmds)
 {
 for (ReadCommand cmd : cmds)
-if (!Schema.isSystemKeyspace(cmd.metadata().ksName))
+if (!SchemaConstants.isSystemKeyspace(cmd.metadata().ksName))
 return false;
 return true;
 }
@@ -1841,7 +1842,7 @@ public class StorageProxy implements StorageProxyMBean
 {
 try
 {
-command.setMonitoringTime(new 
ConstructionTime(constructionTime), timeout, 
DatabaseDescriptor.getSlowQueryTimeout());
+command.setMonitoringTime(new 
ConstructionTime(constructionTime), verb.getTimeout(), 
DatabaseDescriptor.getSlowQueryTimeout());
 
 ReadResponse response;
 try (ReadExecutionController executionController = 
command.executionController();
@@ -2522,19 +2523,17 @@ public class StorageProxy implements StorageProxyMBean
 {
 final long constructionTime;
 final MessagingService.Verb verb;
-final long timeout;
 
 public DroppableRunnable(MessagingService.Verb verb)
 {
 this.constructionTime = System.currentTimeMillis();
 this.verb = verb;
-this.timeout = DatabaseDescriptor.getTimeout(verb);
 }
 
 public final void run()
 {
 long timeTaken = System.currentTimeMillis() - constructionTime;
-if (timeTaken > timeout)
+if (timeTaken > verb.getTimeout())
 {
 MessagingService.instance().incrementDroppedMessages(verb, 
timeTaken);
 return;
@@ -2575,7 +2574,7 @@ public class StorageProxy implements StorageProxyMBean
 public final void run()
 {
 final MessagingService.Verb verb = verb();
-long mutationTimeout = DatabaseDescriptor.getTimeout(verb);
+long mutationTimeout = verb.getTimeout();
 long timeTaken = System.currentTimeMillis() - constructionTime;
 if (timeTaken > mutationTimeout)
 {

http://git-wip-us.apache.org/repos/asf/cassandra/blob/9797511c/src/java/org/apache/cassandra/service/StorageService.java
--
diff --git a/src/java/org/apache/cassandra/service/StorageService.java 
b/src/java/org/apache/cassandra/service/StorageService.java
index 116989c..cbf8b05 100644
--- a/src/java/org/apache/cassandra/service/StorageService.java
+++ b/src/java/org/apache/cassandra/service/StorageService.java
@@ -57,6 +57,7 @@ import org.apache.cassandra.concurrent.StageManager;
 import org.apache.cassandra.config.CFMetaData;
 import org.apache.cassandra.config.DatabaseDescriptor;
 import org.apache.cassandra.config.Schema;
+import org.apache.cassandra.config.SchemaConstants;
 import org.apache.cassandra.db.*;
 import org.apache.cassandra.db.commitlog.CommitLog;
 import org.apache.cassandra.db.compaction.CompactionManager;
@@ -634,7 +635,7 @@ public class StorageService extends 
NotificationBroadcasterSupport implements IE
 }, "StorageServiceShutdownHook");

[jira] [Updated] (CASSANDRA-9054) Let DatabaseDescriptor not implicitly startup services

2016-08-17 Thread Robert Stupp (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-9054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Stupp updated CASSANDRA-9054:

Summary: Let DatabaseDescriptor not implicitly startup services  (was: 
Break DatabaseDescriptor up into multiple classes.)

> Let DatabaseDescriptor not implicitly startup services
> --
>
> Key: CASSANDRA-9054
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9054
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Jeremiah Jordan
>Assignee: Robert Stupp
> Fix For: 3.x
>
>
> Right now to get at Config stuff you go through DatabaseDescriptor.  But when 
> you instantiate DatabaseDescriptor it actually opens system tables and such, 
> which triggers commit log replays, and other things if the right flags aren't 
> set ahead of time.  This makes getting at config stuff from tools annoying, 
> as you have to be very careful about instantiation orders.
> It would be nice if we could break DatabaseDescriptor up into multiple 
> classes, so that getting at config stuff from tools wasn't such a pain.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12486) Structure for compactionhistory output (JSON, YAML)

2016-08-17 Thread Masataka Yamaguchi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Masataka Yamaguchi updated CASSANDRA-12486:
---
Status: Patch Available  (was: Open)

> Structure for compactionhistory output (JSON, YAML)
> ---
>
> Key: CASSANDRA-12486
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12486
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Tools
>Reporter: Masataka Yamaguchi
>Priority: Minor
> Attachments: CASSANDRA-12486-trunk.patch, 
> compactionhistory_result.json, compactionhistory_result.txt, 
> compactionhistory_result.yaml
>
>
> As with nodetool tpstats and tablestats (CASSANDRA-12035), nodetool 
> compactionhistory should also support useful output formats such as JSON or 
> YAML, so we implemented it. 
> Please review the attached patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12486) Structure for compactionhistory output (JSON, YAML)

2016-08-17 Thread Masataka Yamaguchi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Masataka Yamaguchi updated CASSANDRA-12486:
---
Fix Version/s: (was: 3.10)

> Structure for compactionhistory output (JSON, YAML)
> ---
>
> Key: CASSANDRA-12486
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12486
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Tools
>Reporter: Masataka Yamaguchi
>Priority: Minor
> Attachments: CASSANDRA-12486-trunk.patch, 
> compactionhistory_result.json, compactionhistory_result.txt, 
> compactionhistory_result.yaml
>
>
> As with nodetool tpstats and tablestats (CASSANDRA-12035), nodetool 
> compactionhistory should also support useful output formats such as JSON or 
> YAML, so we implemented it. 
> Please review the attached patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12486) Structure for compactionhistory output (JSON, YAML)

2016-08-17 Thread Masataka Yamaguchi (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Masataka Yamaguchi updated CASSANDRA-12486:
---
Attachment: CASSANDRA-12486-trunk.patch

> Structure for compactionhistory output (JSON, YAML)
> ---
>
> Key: CASSANDRA-12486
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12486
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Tools
>Reporter: Masataka Yamaguchi
>Priority: Minor
> Fix For: 3.10
>
> Attachments: CASSANDRA-12486-trunk.patch, 
> compactionhistory_result.json, compactionhistory_result.txt, 
> compactionhistory_result.yaml
>
>
> As with nodetool tpstats and tablestats (CASSANDRA-12035), nodetool 
> compactionhistory should also support useful output formats such as JSON or 
> YAML, so we implemented it. 
> Please review the attached patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (CASSANDRA-12486) Structure for compactionhistory output (JSON, YAML)

2016-08-17 Thread Masataka Yamaguchi (JIRA) 
Masataka Yamaguchi created CASSANDRA-12486:
--

 Summary: Structure for compactionhistory output (JSON, YAML)
 Key: CASSANDRA-12486
 URL: https://issues.apache.org/jira/browse/CASSANDRA-12486
 Project: Cassandra
  Issue Type: Improvement
  Components: Tools
Reporter: Masataka Yamaguchi
Priority: Minor
 Fix For: 3.10
 Attachments: CASSANDRA-12486-trunk.patch, 
compactionhistory_result.json, compactionhistory_result.txt, 
compactionhistory_result.yaml

As with nodetool tpstats and tablestats (CASSANDRA-12035), nodetool 
compactionhistory should also support useful output formats such as JSON or 
YAML, so we implemented it. 
Please review the attached patch.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12485) Always require replace_address to replace existing token

2016-08-17 Thread Paulo Motta (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paulo Motta updated CASSANDRA-12485:

Priority: Minor  (was: Major)

> Always require replace_address to replace existing token
> 
>
> Key: CASSANDRA-12485
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12485
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Distributed Metadata
>Reporter: Paulo Motta
>Priority: Minor
>  Labels: lhf
>
> CASSANDRA-10134 prevented replace an existing node unless 
> {{\-Dcassandra.replace_address}} or 
> {{\-Dcassandra.allow_unsafe_replace=true}} is specified.
> We should extend this behavior to tokens, preventing a node from joining the 
> ring if another node with the same token already existing in the ring, unless 
> {{\-Dcassandra.replace_address}} or 
> {{\-Dcassandra.allow_unsafe_replace=true}} is specified in order to avoid 
> catastrophic scenarios.
> One scenario where this can easily happen is if you replace a node with 
> another node with a different IP, and after some time you restart the 
> original node by mistake. The original node will then take over the tokens of 
> the replaced node (since it has a newer gossip generation).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (CASSANDRA-12485) Always require replace_address to replace existing token

2016-08-17 Thread Paulo Motta (JIRA) 
Paulo Motta created CASSANDRA-12485:
---

 Summary: Always require replace_address to replace existing token
 Key: CASSANDRA-12485
 URL: https://issues.apache.org/jira/browse/CASSANDRA-12485
 Project: Cassandra
  Issue Type: Improvement
  Components: Distributed Metadata
Reporter: Paulo Motta


CASSANDRA-10134 prevented replace an existing node unless 
{{\-Dcassandra.replace_address}} or {{\-Dcassandra.allow_unsafe_replace=true}} 
is specified.

We should extend this behavior to tokens, preventing a node from joining the 
ring if another node with the same token already existing in the ring, unless 
{{\-Dcassandra.replace_address}} or {{\-Dcassandra.allow_unsafe_replace=true}} 
is specified in order to avoid catastrophic scenarios.

One scenario where this can easily happen is if you replace a node with another 
node with a different IP, and after some time you restart the original node by 
mistake. The original node will then take over the tokens of the replaced node 
(since it has a newer gossip generation).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-11067) Improve SASI syntax

2016-08-17 Thread Dave Brosius (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425619#comment-15425619
 ] 

Dave Brosius commented on CASSANDRA-11067:
--

nitpick

PrefixTermTree.search(Expression e)

sanity checks for e == null, but then dereferences it anyway, here  
super.search(e)

maybe just return emptySet() on e == null

> Improve SASI syntax
> ---
>
> Key: CASSANDRA-11067
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11067
> Project: Cassandra
>  Issue Type: Task
>  Components: CQL
>Reporter: Jonathan Ellis
>Assignee: Pavel Yaskevich
>  Labels: client-impacting, sasi
> Fix For: 3.4
>
>
> I think everyone agrees that a LIKE operator would be ideal, but that's 
> probably not in scope for an initial 3.4 release.
> Still, I'm uncomfortable with the initial approach of overloading = to mean 
> "satisfies index expression."  The problem is that it will be very difficult 
> to back out of this behavior once people are using it.
> I propose adding a new operator in the interim instead.  Call it MATCHES, 
> maybe.  With the exact same behavior that SASI currently exposes, just with a 
> separate operator rather than being rolled into =.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

cassandra git commit: no need to hold onto the current ss table reader as a field

2016-08-17 Thread dbrosius 
Repository: cassandra
Updated Branches:
  refs/heads/trunk f808b5c7b -> 858004791


no need to hold onto the current ss table reader as a field


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/85800479
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/85800479
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/85800479

Branch: refs/heads/trunk
Commit: 858004791977f0db56da201f1ab84c4efe75d974
Parents: f808b5c
Author: Dave Brosius 
Authored: Wed Aug 17 19:37:47 2016 -0400
Committer: Dave Brosius 
Committed: Wed Aug 17 19:38:06 2016 -0400

--
 .../cassandra/db/compaction/LeveledCompactionStrategy.java  | 5 ++---
 1 file changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/85800479/src/java/org/apache/cassandra/db/compaction/LeveledCompactionStrategy.java
--
diff --git 
a/src/java/org/apache/cassandra/db/compaction/LeveledCompactionStrategy.java 
b/src/java/org/apache/cassandra/db/compaction/LeveledCompactionStrategy.java
index c224f91..13f454e 100644
--- a/src/java/org/apache/cassandra/db/compaction/LeveledCompactionStrategy.java
+++ b/src/java/org/apache/cassandra/db/compaction/LeveledCompactionStrategy.java
@@ -326,7 +326,6 @@ public class LeveledCompactionStrategy extends 
AbstractCompactionStrategy
 
 private ISSTableScanner currentScanner;
 private long positionOffset;
-private SSTableReader currentSSTable;
 private long totalBytesScanned = 0;
 
 public LeveledScanner(Collection sstables, 
Collection ranges)
@@ -355,7 +354,7 @@ public class LeveledCompactionStrategy extends 
AbstractCompactionStrategy
 Collections.sort(this.sstables, SSTableReader.sstableComparator);
 sstableIterator = this.sstables.iterator();
 assert sstableIterator.hasNext(); // caller should check 
intersecting first
-currentSSTable = sstableIterator.next();
+SSTableReader currentSSTable = sstableIterator.next();
 currentScanner = currentSSTable.getScanner(ranges, null);
 
 }
@@ -409,7 +408,7 @@ public class LeveledCompactionStrategy extends 
AbstractCompactionStrategy
 currentScanner = null;
 return endOfData();
 }
-currentSSTable = sstableIterator.next();
+SSTableReader currentSSTable = sstableIterator.next();
 currentScanner = currentSSTable.getScanner(ranges, null);
 }
 }

[jira] [Commented] (CASSANDRA-12311) Propagate TombstoneOverwhelmingException to the client

2016-08-17 Thread Tyler Hobbs (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425590#comment-15425590
 ] 

Tyler Hobbs commented on CASSANDRA-12311:
-

Still having problems with the test runner, looking into it.

> Propagate TombstoneOverwhelmingException to the client
> --
>
> Key: CASSANDRA-12311
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12311
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Geoffrey Yu
>Assignee: Geoffrey Yu
>Priority: Minor
>  Labels: client-impacting, doc-impacting
> Fix For: 4.x
>
> Attachments: 12311-dtest.txt, 12311-trunk-v2.txt, 12311-trunk-v3.txt, 
> 12311-trunk-v4.txt, 12311-trunk-v5.txt, 12311-trunk.txt
>
>
> Right now if a data node fails to perform a read because it ran into a 
> {{TombstoneOverwhelmingException}}, it only responds back to the coordinator 
> node with a generic failure. Under this scheme, the coordinator won't be able 
> to know exactly why the request failed and subsequently the client only gets 
> a generic {{ReadFailureException}}. It would be useful to inform the client 
> that their read failed because we read too many tombstones. We should have 
> the data nodes reply with a failure type so the coordinator can pass this 
> information to the client.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[06/15] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7e19dc1c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7e19dc1c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7e19dc1c

Branch: refs/heads/trunk
Commit: 7e19dc1c1b78c4aa5ac91450d539aa4ab6d34c7d
Parents: 01ae279 f03b10c
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:07:36 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:36 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7e19dc1c/doc/native_protocol_v4.spec
--

[12/15] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.8

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.0' into cassandra-3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/62300215
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/62300215
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/62300215

Branch: refs/heads/cassandra-3.8
Commit: 6230021509f1cd98bc76f748d3d42b8fa90e1cca
Parents: 062bd07 7e19dc1
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:07:51 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:51 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--

[09/15] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7e19dc1c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7e19dc1c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7e19dc1c

Branch: refs/heads/cassandra-3.9
Commit: 7e19dc1c1b78c4aa5ac91450d539aa4ab6d34c7d
Parents: 01ae279 f03b10c
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:07:36 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:36 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7e19dc1c/doc/native_protocol_v4.spec
--

[15/15] cassandra git commit: Merge branch 'cassandra-3.9' into trunk

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.9' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f808b5c7
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f808b5c7
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f808b5c7

Branch: refs/heads/trunk
Commit: f808b5c7b764bf1bbc8d8a6d22ed15a7e2494920
Parents: 7bdb2dd c3a5fc0
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:08:12 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:08:12 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--

[04/15] cassandra git commit: Ninja: add CASSANDRA-7660 to v4 spec changes section

2016-08-17 Thread tylerhobbs 
Ninja: add CASSANDRA-7660 to v4 spec changes section


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f03b10cb
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f03b10cb
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f03b10cb

Branch: refs/heads/cassandra-3.8
Commit: f03b10cb4bfcdfcc34dfc1b002e61c3bf08d3993
Parents: 9583b6b
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:06:56 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:26 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f03b10cb/doc/native_protocol_v4.spec
--
diff --git a/doc/native_protocol_v4.spec b/doc/native_protocol_v4.spec
index 51cb875..187ff80 100644
--- a/doc/native_protocol_v4.spec
+++ b/doc/native_protocol_v4.spec
@@ -1154,6 +1154,7 @@ Table of Contents
 
 10. Changes from v3
 
+  * Prepared responses (Section 4.2.5.4) now include partition-key bind indexes
   * The format of "SCHEMA_CHANGE" events (Section 4.2.6) (and implicitly
 "Schema_change" results (Section 4.2.5.5)) has been modified, and now 
includes
 changes related to user defined functions and user defined aggregates.

[11/15] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.8

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.0' into cassandra-3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/62300215
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/62300215
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/62300215

Branch: refs/heads/cassandra-3.9
Commit: 6230021509f1cd98bc76f748d3d42b8fa90e1cca
Parents: 062bd07 7e19dc1
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:07:51 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:51 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--

[01/15] cassandra git commit: Ninja: add CASSANDRA-7660 to v4 spec changes section

2016-08-17 Thread tylerhobbs 
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-2.2 9583b6b31 -> f03b10cb4
  refs/heads/cassandra-3.0 01ae2794e -> 7e19dc1c1
  refs/heads/cassandra-3.8 062bd0730 -> 623002150
  refs/heads/cassandra-3.9 b2a630973 -> c3a5fc08d
  refs/heads/trunk 7bdb2dddc -> f808b5c7b


Ninja: add CASSANDRA-7660 to v4 spec changes section


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f03b10cb
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f03b10cb
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f03b10cb

Branch: refs/heads/cassandra-2.2
Commit: f03b10cb4bfcdfcc34dfc1b002e61c3bf08d3993
Parents: 9583b6b
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:06:56 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:26 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f03b10cb/doc/native_protocol_v4.spec
--
diff --git a/doc/native_protocol_v4.spec b/doc/native_protocol_v4.spec
index 51cb875..187ff80 100644
--- a/doc/native_protocol_v4.spec
+++ b/doc/native_protocol_v4.spec
@@ -1154,6 +1154,7 @@ Table of Contents
 
 10. Changes from v3
 
+  * Prepared responses (Section 4.2.5.4) now include partition-key bind indexes
   * The format of "SCHEMA_CHANGE" events (Section 4.2.6) (and implicitly
 "Schema_change" results (Section 4.2.5.5)) has been modified, and now 
includes
 changes related to user defined functions and user defined aggregates.

[08/15] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7e19dc1c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7e19dc1c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7e19dc1c

Branch: refs/heads/cassandra-3.8
Commit: 7e19dc1c1b78c4aa5ac91450d539aa4ab6d34c7d
Parents: 01ae279 f03b10c
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:07:36 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:36 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7e19dc1c/doc/native_protocol_v4.spec
--

[07/15] cassandra git commit: Merge branch 'cassandra-2.2' into cassandra-3.0

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-2.2' into cassandra-3.0


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7e19dc1c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7e19dc1c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7e19dc1c

Branch: refs/heads/cassandra-3.0
Commit: 7e19dc1c1b78c4aa5ac91450d539aa4ab6d34c7d
Parents: 01ae279 f03b10c
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:07:36 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:36 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7e19dc1c/doc/native_protocol_v4.spec
--

[05/15] cassandra git commit: Ninja: add CASSANDRA-7660 to v4 spec changes section

2016-08-17 Thread tylerhobbs 
Ninja: add CASSANDRA-7660 to v4 spec changes section


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f03b10cb
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f03b10cb
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f03b10cb

Branch: refs/heads/cassandra-3.9
Commit: f03b10cb4bfcdfcc34dfc1b002e61c3bf08d3993
Parents: 9583b6b
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:06:56 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:26 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f03b10cb/doc/native_protocol_v4.spec
--
diff --git a/doc/native_protocol_v4.spec b/doc/native_protocol_v4.spec
index 51cb875..187ff80 100644
--- a/doc/native_protocol_v4.spec
+++ b/doc/native_protocol_v4.spec
@@ -1154,6 +1154,7 @@ Table of Contents
 
 10. Changes from v3
 
+  * Prepared responses (Section 4.2.5.4) now include partition-key bind indexes
   * The format of "SCHEMA_CHANGE" events (Section 4.2.6) (and implicitly
 "Schema_change" results (Section 4.2.5.5)) has been modified, and now 
includes
 changes related to user defined functions and user defined aggregates.

[02/15] cassandra git commit: Ninja: add CASSANDRA-7660 to v4 spec changes section

2016-08-17 Thread tylerhobbs 
Ninja: add CASSANDRA-7660 to v4 spec changes section


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f03b10cb
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f03b10cb
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f03b10cb

Branch: refs/heads/cassandra-3.0
Commit: f03b10cb4bfcdfcc34dfc1b002e61c3bf08d3993
Parents: 9583b6b
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:06:56 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:26 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f03b10cb/doc/native_protocol_v4.spec
--
diff --git a/doc/native_protocol_v4.spec b/doc/native_protocol_v4.spec
index 51cb875..187ff80 100644
--- a/doc/native_protocol_v4.spec
+++ b/doc/native_protocol_v4.spec
@@ -1154,6 +1154,7 @@ Table of Contents
 
 10. Changes from v3
 
+  * Prepared responses (Section 4.2.5.4) now include partition-key bind indexes
   * The format of "SCHEMA_CHANGE" events (Section 4.2.6) (and implicitly
 "Schema_change" results (Section 4.2.5.5)) has been modified, and now 
includes
 changes related to user defined functions and user defined aggregates.

[14/15] cassandra git commit: Merge branch 'cassandra-3.8' into cassandra-3.9

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.8' into cassandra-3.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c3a5fc08
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c3a5fc08
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c3a5fc08

Branch: refs/heads/trunk
Commit: c3a5fc08df8a9cb0818cf498584c47be4b1175da
Parents: b2a6309 6230021
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:08:05 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:08:05 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--

[10/15] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.8

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.0' into cassandra-3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/62300215
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/62300215
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/62300215

Branch: refs/heads/trunk
Commit: 6230021509f1cd98bc76f748d3d42b8fa90e1cca
Parents: 062bd07 7e19dc1
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:07:51 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:51 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--

[13/15] cassandra git commit: Merge branch 'cassandra-3.8' into cassandra-3.9

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.8' into cassandra-3.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c3a5fc08
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c3a5fc08
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c3a5fc08

Branch: refs/heads/cassandra-3.9
Commit: c3a5fc08df8a9cb0818cf498584c47be4b1175da
Parents: b2a6309 6230021
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:08:05 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:08:05 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--

[03/15] cassandra git commit: Ninja: add CASSANDRA-7660 to v4 spec changes section

2016-08-17 Thread tylerhobbs 
Ninja: add CASSANDRA-7660 to v4 spec changes section


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/f03b10cb
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/f03b10cb
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/f03b10cb

Branch: refs/heads/trunk
Commit: f03b10cb4bfcdfcc34dfc1b002e61c3bf08d3993
Parents: 9583b6b
Author: Tyler Hobbs 
Authored: Wed Aug 17 18:06:56 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 18:07:26 2016 -0500

--
 doc/native_protocol_v4.spec | 1 +
 1 file changed, 1 insertion(+)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/f03b10cb/doc/native_protocol_v4.spec
--
diff --git a/doc/native_protocol_v4.spec b/doc/native_protocol_v4.spec
index 51cb875..187ff80 100644
--- a/doc/native_protocol_v4.spec
+++ b/doc/native_protocol_v4.spec
@@ -1154,6 +1154,7 @@ Table of Contents
 
 10. Changes from v3
 
+  * Prepared responses (Section 4.2.5.4) now include partition-key bind indexes
   * The format of "SCHEMA_CHANGE" events (Section 4.2.6) (and implicitly
 "Schema_change" results (Section 4.2.5.5)) has been modified, and now 
includes
 changes related to user defined functions and user defined aggregates.

cassandra git commit: Fix leftover merge conflicts in build.xml

2016-08-17 Thread tylerhobbs 
Repository: cassandra
Updated Branches:
  refs/heads/trunk 1e8533a31 -> 7bdb2dddc


Fix leftover merge conflicts in build.xml


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/7bdb2ddd
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/7bdb2ddd
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/7bdb2ddd

Branch: refs/heads/trunk
Commit: 7bdb2dddcbc608543604eebedf6fe4a9f6d9858a
Parents: 1e8533a
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:33:28 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:33:28 2016 -0500

--
 build.xml | 4 
 1 file changed, 4 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/7bdb2ddd/build.xml
--
diff --git a/build.xml b/build.xml
index 8ae42b8..df6d469 100644
--- a/build.xml
+++ b/build.xml
@@ -1492,11 +1492,7 @@
   
 
   >> cassandra-3.9
   description="Run all tests except for those under test-burn" />

[jira] [Updated] (CASSANDRA-12089) Update metrics-reporter dependencies

2016-08-17 Thread JIRA 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michał Matłoka updated CASSANDRA-12089:
---
Status: Patch Available  (was: Open)

Patch with metrics-reporter-upgrade to 3.0.2 (includes zabbix and influxdb 
support).

> Update metrics-reporter dependencies
> 
>
> Key: CASSANDRA-12089
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12089
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Robert Stupp
>Assignee: Robert Stupp
>Priority: Minor
> Fix For: 2.1.x
>
> Attachments: 12089-3.8.txt
>
>
> Proposal to update the metrics-reporter jars.
> Upcoming versions (>=3.0.2) of 
> [metrics-reporter-config|https://github.com/addthis/metrics-reporter-config] 
> should support prometheus and maybe also riemann (in v3).
> Relevant PRs:
> https://github.com/addthis/metrics-reporter-config/pull/26
> https://github.com/addthis/metrics-reporter-config/pull/27
> reporter-config 3.0.2+ can also be used in 2.1. Therefore it would be nice to 
> have also update the jars in 2.1.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12089) Update metrics-reporter dependencies

2016-08-17 Thread JIRA 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michał Matłoka updated CASSANDRA-12089:
---
Attachment: 12089-3.8.txt

Patch with metrics-reporter-upgrade to 3.0.2 (includes zabbix and influxdb 
support). Patch is based on 3.8 since I am not sure if it is "allowed" to 
upgrade dependencies in minor versions for 2.1 and 2.2 ?

> Update metrics-reporter dependencies
> 
>
> Key: CASSANDRA-12089
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12089
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Robert Stupp
>Assignee: Robert Stupp
>Priority: Minor
> Fix For: 2.1.x
>
> Attachments: 12089-3.8.txt
>
>
> Proposal to update the metrics-reporter jars.
> Upcoming versions (>=3.0.2) of 
> [metrics-reporter-config|https://github.com/addthis/metrics-reporter-config] 
> should support prometheus and maybe also riemann (in v3).
> Relevant PRs:
> https://github.com/addthis/metrics-reporter-config/pull/26
> https://github.com/addthis/metrics-reporter-config/pull/27
> reporter-config 3.0.2+ can also be used in 2.1. Therefore it would be nice to 
> have also update the jars in 2.1.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12271) NonSystemKeyspaces jmx attribute needs to return jre list

2016-08-17 Thread Joshua McKenzie (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425485#comment-15425485
 ] 

Joshua McKenzie commented on CASSANDRA-12271:
-

In the future, flip the ticket "Ready to Commit" and a committer will pick it 
up.

Swapped status for you - thanks for reviewing!

> NonSystemKeyspaces jmx attribute needs to return jre list
> -
>
> Key: CASSANDRA-12271
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12271
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Chris Lohfink
>Assignee: Edward Ribeiro
>  Labels: lhf
> Attachments: CASSANDRA-12271.patch, screenshot-1.png, screenshot-2.png
>
>
> If you dont have right guava in classpath you cant query the 
> NonSystemKeyspaces attribute. i.e. jconsole. can reproduce using Swiss java 
> knife:
> {code}
> # java -jar sjk.jar mx -s localhost:7199 -mg -b 
> "org.apache.cassandra.db:type=StorageService" -f NonSystemKeyspaces
> org.apache.cassandra.db:type=StorageService
> java.rmi.UnmarshalException: error unmarshalling return; nested exception is: 
>   java.lang.ClassNotFoundException: 
> com.google.common.collect.ImmutableList$SerializedForm (no security manager: 
> RMI class loader disabled)
> {code}
> If return a ArrayList or LinkedList or anything in JRE this will be fixed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12271) NonSystemKeyspaces jmx attribute needs to return jre list

2016-08-17 Thread Joshua McKenzie (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joshua McKenzie updated CASSANDRA-12271:

Status: Ready to Commit  (was: Patch Available)

> NonSystemKeyspaces jmx attribute needs to return jre list
> -
>
> Key: CASSANDRA-12271
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12271
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Chris Lohfink
>Assignee: Edward Ribeiro
>  Labels: lhf
> Attachments: CASSANDRA-12271.patch, screenshot-1.png, screenshot-2.png
>
>
> If you dont have right guava in classpath you cant query the 
> NonSystemKeyspaces attribute. i.e. jconsole. can reproduce using Swiss java 
> knife:
> {code}
> # java -jar sjk.jar mx -s localhost:7199 -mg -b 
> "org.apache.cassandra.db:type=StorageService" -f NonSystemKeyspaces
> org.apache.cassandra.db:type=StorageService
> java.rmi.UnmarshalException: error unmarshalling return; nested exception is: 
>   java.lang.ClassNotFoundException: 
> com.google.common.collect.ImmutableList$SerializedForm (no security manager: 
> RMI class loader disabled)
> {code}
> If return a ArrayList or LinkedList or anything in JRE this will be fixed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-11635) test-clientutil-jar unit test fails

2016-08-17 Thread Tyler Hobbs (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425481#comment-15425481
 ] 

Tyler Hobbs commented on CASSANDRA-11635:
-

I looked into quickly fixing the remaining issues, but the required fix is 
somewhat complex in 3.8 (due to FBUtilities pulling in more classes), so we 
should take our time with proper branches and CI runs.

In the meantime, I comitted {{01ae2794e5f3f33d8755cb913f11d917cf7e6bd7}} to 3.0 
to temporarily remove {{test-clientutil-jar}} from {{test-all}} so that 
{{test-all}} won't be hosed.

> test-clientutil-jar unit test fails
> ---
>
> Key: CASSANDRA-11635
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11635
> Project: Cassandra
>  Issue Type: Test
>  Components: Testing
>Reporter: Michael Shuler
>Assignee: Sylvain Lebresne
>  Labels: unittest
> Fix For: 2.2.8, 3.0.9, 3.8
>
>
> {noformat}
> test-clientutil-jar:
> [junit] Testsuite: org.apache.cassandra.serializers.ClientUtilsTest
> [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 
> 0.314 sec
> [junit] 
> [junit] Testcase: test(org.apache.cassandra.serializers.ClientUtilsTest): 
>   Caused an ERROR
> [junit] org/apache/cassandra/utils/SigarLibrary
> [junit] java.lang.NoClassDefFoundError: 
> org/apache/cassandra/utils/SigarLibrary
> [junit] at org.apache.cassandra.utils.UUIDGen.hash(UUIDGen.java:328)
> [junit] at 
> org.apache.cassandra.utils.UUIDGen.makeNode(UUIDGen.java:307)
> [junit] at 
> org.apache.cassandra.utils.UUIDGen.makeClockSeqAndNode(UUIDGen.java:256)
> [junit] at 
> org.apache.cassandra.utils.UUIDGen.(UUIDGen.java:39)
> [junit] at 
> org.apache.cassandra.serializers.ClientUtilsTest.test(ClientUtilsTest.java:56)
> [junit] Caused by: java.lang.ClassNotFoundException: 
> org.apache.cassandra.utils.SigarLibrary
> [junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> [junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> [junit] at 
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> [junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> [junit] 
> [junit] 
> [junit] Test org.apache.cassandra.serializers.ClientUtilsTest FAILED
> BUILD FAILED
> {noformat}
> I'll see if I can find a spot where this passes, but it appears to have been 
> failing for a long time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[6/9] cassandra git commit: Ninja: temporarily remove test-clientutil-jar from test-all

2016-08-17 Thread tylerhobbs 
Ninja: temporarily remove test-clientutil-jar from test-all

This is a temporary measure to fix test-all until CASSANDRA-11635 can be
properly fixed and allow test-clientutil-jar to work again.


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/01ae2794
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/01ae2794
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/01ae2794

Branch: refs/heads/trunk
Commit: 01ae2794e5f3f33d8755cb913f11d917cf7e6bd7
Parents: 5694a2a
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:03:30 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:03:30 2016 -0500

--
 build.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/01ae2794/build.xml
--
diff --git a/build.xml b/build.xml
index acc7c9e..532c944 100644
--- a/build.xml
+++ b/build.xml
@@ -1442,7 +1442,7 @@

[1/9] cassandra git commit: Update CHANGES.txt for 3.8

2016-08-17 Thread tylerhobbs 
Repository: cassandra
Updated Branches:
  refs/heads/trunk 5c6cdc60a -> 1e8533a31


Update CHANGES.txt for 3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c1e9ad8c
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c1e9ad8c
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c1e9ad8c

Branch: refs/heads/trunk
Commit: c1e9ad8cde9f0eec6c87fc19db45460eb8e8f500
Parents: cb97649
Author: Michael Shuler 
Authored: Tue Aug 16 17:37:37 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 17:37:37 2016 -0500

--
 CHANGES.txt | 54 --
 1 file changed, 20 insertions(+), 34 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/c1e9ad8c/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 2c83c42..b27d974 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,43 +1,10 @@
-3.9
+3.8
  * Fix value skipping with counter columns (CASSANDRA-11726)
  * Fix nodetool tablestats miss SSTable count (CASSANDRA-12205)
  * Fixed flacky SSTablesIteratedTest (CASSANDRA-12282)
  * Fixed flacky SSTableRewriterTest: check file counts before calling 
validateCFS (CASSANDRA-12348)
  * cqlsh: Fix handling of $$-escaped strings (CASSANDRA-12189)
  * Fix SSL JMX requiring truststore containing server cert (CASSANDRA-12109)
-Merged from 3.0:
- * Fix clean interval not sent to commit log for empty memtable flush 
(CASSANDRA-12436)
- * Fix potential resource leak in RMIServerSocketFactoryImpl (CASSANDRA-12331)
- * Make sure compaction stats are updated when compaction is interrupted 
(CASSANDRA-12100)
- * Change commitlog and sstables to track dirty and clean intervals 
(CASSANDRA-11828)
- * NullPointerException during compaction on table with static columns 
(CASSANDRA-12336)
- * Fixed ConcurrentModificationException when reading metrics in 
GraphiteReporter (CASSANDRA-11823)
- * Fix upgrade of super columns on thrift (CASSANDRA-12335)
- * Fixed flacky BlacklistingCompactionsTest, switched to fixed size types and 
increased corruption size (CASSANDRA-12359)
- * Rerun ReplicationAwareTokenAllocatorTest on failure to avoid flakiness 
(CASSANDRA-12277)
- * Exception when computing read-repair for range tombstones (CASSANDRA-12263)
- * Lost counter writes in compact table and static columns (CASSANDRA-12219)
- * AssertionError with MVs on updating a row that isn't indexed due to a null 
value (CASSANDRA-12247)
- * Disable RR and speculative retry with EACH_QUORUM reads (CASSANDRA-11980)
- * Add option to override compaction space check (CASSANDRA-12180)
- * Faster startup by only scanning each directory for temporary files once 
(CASSANDRA-12114)
- * Respond with v1/v2 protocol header when responding to driver that attempts
-   to connect with too low of a protocol version (CASSANDRA-11464)
- * NullPointerExpception when reading/compacting table (CASSANDRA-11988)
- * Fix problem with undeleteable rows on upgrade to new sstable format 
(CASSANDRA-12144)
-Merged from 2.2:
- * Fix hanging stream session (CASSANDRA-10992)
- * Fix INSERT JSON, fromJson() support of smallint, tinyint types 
(CASSANDRA-12371)
- * Release sstables of failed stream sessions only when outgoing transfers are 
finished (CASSANDRA-11345)
- * Wait for tracing events before returning response and query at same 
consistency level client side (CASSANDRA-11465)
- * cqlsh copyutil should get host metadata by connected address 
(CASSANDRA-11979)
- * Fixed cqlshlib.test.remove_test_db (CASSANDRA-12214)
-Merged from 2.1:
- * cannot use cql since upgrading python to 2.7.11+ (CASSANDRA-11850)
- * Allow STCS-in-L0 compactions to reduce scope with LCS (CASSANDRA-12040)
-
-
-3.8
  * RTE from new CDC column breaks in flight queries (CASSANDRA-12236)
  * Fix hdr logging for single operation workloads (CASSANDRA-12145)
  * Fix SASI PREFIX search in CONTAINS mode with partial terms (CASSANDRA-12073)
@@ -67,6 +34,25 @@ Merged from 2.1:
  * Add repaired percentage metric (CASSANDRA-11503)
  * Add Change-Data-Capture (CASSANDRA-8844)
 Merged from 3.0:
+ * Fix clean interval not sent to commit log for empty memtable flush 
(CASSANDRA-12436)
+ * Fix potential resource leak in RMIServerSocketFactoryImpl (CASSANDRA-12331)
+ * Make sure compaction stats are updated when compaction is interrupted 
(CASSANDRA-12100)
+ * Change commitlog and sstables to track dirty and clean intervals 
(CASSANDRA-11828)
+ * NullPointerException during compaction on table with static columns 
(CASSANDRA-12336)
+ * Fixed ConcurrentModificationException when reading metrics in 
GraphiteReporter (CASSANDRA-11823)
+ * Fix upgrade of super columns on thrift (CASSANDRA-12335)
+ * Fixed flacky

[3/9] cassandra git commit: Update build.xml and debian/changelog for 3.9

2016-08-17 Thread tylerhobbs 
Update build.xml and debian/changelog for 3.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/5d23afc1
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/5d23afc1
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/5d23afc1

Branch: refs/heads/trunk
Commit: 5d23afc15f13ef1815b42c11082444286426dae3
Parents: 24e1fd6
Author: Michael Shuler 
Authored: Tue Aug 16 17:52:19 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 17:52:19 2016 -0500

--
 build.xml| 2 +-
 debian/changelog | 6 ++
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/5d23afc1/build.xml
--
diff --git a/build.xml b/build.xml
index b312376..dd104b6 100644
--- a/build.xml
+++ b/build.xml
@@ -25,7 +25,7 @@
 
 
 
-
+
 
 
 http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=tree"/>

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5d23afc1/debian/changelog
--
diff --git a/debian/changelog b/debian/changelog
index e071140..b5e1f8b 100644
--- a/debian/changelog
+++ b/debian/changelog
@@ -1,3 +1,9 @@
+cassandra (3.9) unstable; urgency=medium
+
+  * New release
+
+ -- Michael Shuler   Tue, 16 Aug 2016 17:50:13 -0500
+
 cassandra (3.8) unstable; urgency=medium
 
   * New release

[9/9] cassandra git commit: Merge branch 'cassandra-3.9' into trunk

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.9' into trunk


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/1e8533a3
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/1e8533a3
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/1e8533a3

Branch: refs/heads/trunk
Commit: 1e8533a316562e4aaed27a069e28f88d5d480ef2
Parents: 5c6cdc6 b2a6309
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:06:57 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:06:57 2016 -0500

--
 NEWS.txt  | 2 +-
 build.xml | 4 
 2 files changed, 5 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/1e8533a3/NEWS.txt
--
diff --cc NEWS.txt
index a8ba483,8725931..53cb389
--- a/NEWS.txt
+++ b/NEWS.txt
@@@ -13,77 -13,7 +13,77 @@@ restore snapshots created with the prev
  'sstableloader' tool. You can upgrade the file format of your snapshots
  using the provided 'sstableupgrade' tool.
  
 +3.10
 +
 +
 +New features
 +
 +   - A slow query log has been added: slow queries will be logged at DEBUG 
level.
 + For more details refer to CASSANDRA-12403 and 
slow_query_log_timeout_in_ms
 + in cassandra.yaml.
 +   - Support for GROUP BY queries has been added.
 +   - A new compaction-stress tool has been added to test the throughput of 
compaction
 + for any cassandra-stress user schema.  see compaction-stress help for 
how to use.
 +   - Compaction can now take into account overlapping tables that don't take 
part
 + in the compaction to look for deleted or overwritten data in the 
compacted tables.
 + Then such data is found, it can be safely discarded, which in turn 
should enable
 + the removal of tombstones over that data.
 +
 + The behavior can be engaged in two ways:
 +   - as a "nodetool garbagecollect -g CELL/ROW" operation, which applies
 + single-table compaction on all sstables to discard deleted data in 
one step.
 +   - as a "provide_overlapping_tombstones:CELL/ROW/NONE" compaction 
strategy flag,
 + which uses overlapping tables as a source of deletions/overwrites 
during all
 + compactions.
 + The argument specifies the granularity at which deleted data is to be 
found:
 +   - If ROW is specified, only whole deleted rows (or sets of rows) will 
be
 + discarded.
 +   - If CELL is specified, any columns whose value is overwritten or 
deleted
 + will also be discarded.
 +   - NONE (default) specifies the old behavior, overlapping tables are 
not used to
 + decide when to discard data.
 + Which option to use depends on your workload, both ROW and CELL increase 
the
 + disk load on compaction (especially with the size-tiered compaction 
strategy),
 + with CELL being more resource-intensive. Both should lead to better read
 + performance if deleting rows (resp. overwriting or deleting cells) is 
common.
 +   - Prepared statements are now persisted in the table prepared_statements in
 + the system keyspace. Upon startup, this table is used to preload all
 + previously prepared statements - i.e. in many cases clients do not need 
to
 + re-prepare statements against restarted nodes.
 +   - cqlsh can now connect to older Cassandra versions by downgrading the 
native
 + protocol version. Please note that this is currently not part of our 
release
 + testing and, as a consequence, it is not guaranteed to work in all cases.
 + See CASSANDRA-12150 for more details.
 +   - Snapshots that are automatically taken before a table is dropped or 
truncated
 + will have a "dropped" or "truncated" prefix on their snapshot tag name.
 +   - Metrics are exposed for successful and failed authentication attempts.
 + These can be located using the object names 
org.apache.cassandra.metrics:type=Client,name=AuthSuccess
 + and org.apache.cassandra.metrics:type=Client,name=AuthFailure 
respectively.
 +   - Add support to "unset" JSON fields in prepared statements by specifying 
DEFAULT UNSET.
 + See CASSANDRA-11424 for details
 +   - Allow TTL with null value on insert and update. It will be treated as 
equivalent to inserting a 0.
 +
 +Upgrading
 +-
 +- Request timeouts in cassandra.yaml (read_request_timeout_in_ms, etc) 
now apply to the
 +  "full" request time on the coordinator.  Previously, they only covered 
the time from
 +  when the coordinator sent a message to a replica until the time that 
the replica
 +  responded.  Additionally, the previous behavior was to reset the 
timeout when performing
 +  a read repair, making a second read to fix a short read, and when 
subranges were read
 +  as

[5/9] cassandra git commit: Update NEWS.txt for 3.9

2016-08-17 Thread tylerhobbs 
Update NEWS.txt for 3.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/c72a7bbe
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/c72a7bbe
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/c72a7bbe

Branch: refs/heads/trunk
Commit: c72a7bbe85ae0a693d44772cb0967c7c9971a893
Parents: 5d23afc
Author: Michael Shuler 
Authored: Tue Aug 16 17:57:21 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 17:57:21 2016 -0500

--
 NEWS.txt | 30 --
 1 file changed, 12 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/c72a7bbe/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 2edff8e..202d53b 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -16,16 +16,6 @@ using the provided 'sstableupgrade' tool.
 3.9
 ===
 
-Upgrading
--
-   - The ReversedType behaviour has been corrected for clustering columns of
- BYTES type containing empty value. Scrub should be run on the existing
- SSTables containing a descending clustering column of BYTES type to 
correct
- their ordering. See CASSANDRA-12127 for more details.
-
-3.8
-===
-
 New features
 
- Shared pool threads are now named according to the stage they are 
executing
@@ -54,14 +44,18 @@ New features
 
 Upgrading
 -
-- Ec2MultiRegionSnitch will no longer automatically set 
broadcast_rpc_address
-  to the public instance IP if this property is defined on cassandra.yaml.
-- The name "json" and "distinct" are not valid anymore a user-defined 
function
-  names (they are still valid as column name however). In the unlikely 
case where
-  you had defined functions with such names, you will need to recreate
-  those under a different name, change your code to use the new names and
-  drop the old versions, and this _before_ upgrade (see CASSANDRA-10783 
for more
-  details).
+   - The ReversedType behaviour has been corrected for clustering columns of
+ BYTES type containing empty value. Scrub should be run on the existing
+ SSTables containing a descending clustering column of BYTES type to 
correct
+ their ordering. See CASSANDRA-12127 for more details.
+   - Ec2MultiRegionSnitch will no longer automatically set 
broadcast_rpc_address
+ to the public instance IP if this property is defined on cassandra.yaml.
+   - The name "json" and "distinct" are not valid anymore a user-defined 
function
+ names (they are still valid as column name however). In the unlikely case 
where
+ you had defined functions with such names, you will need to recreate
+ those under a different name, change your code to use the new names and
+ drop the old versions, and this _before_ upgrade (see CASSANDRA-10783 for 
more
+ details).
 
 Deprecation
 ---

[7/9] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.8

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.0' into cassandra-3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/062bd073
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/062bd073
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/062bd073

Branch: refs/heads/trunk
Commit: 062bd0730af1f5e9665e8873f7b336b221ec3226
Parents: 4e46ec9 01ae279
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:05:15 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:05:15 2016 -0500

--
 build.xml  |  2 +-
 test/conf/logback-test.xml |  2 +-
 test/unit/org/apache/cassandra/cql3/CQLTester.java | 12 ++--
 3 files changed, 8 insertions(+), 8 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/build.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/test/conf/logback-test.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/test/unit/org/apache/cassandra/cql3/CQLTester.java
--

[8/9] cassandra git commit: Merge branch 'cassandra-3.8' into cassandra-3.9

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.8' into cassandra-3.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b2a63097
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b2a63097
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b2a63097

Branch: refs/heads/trunk
Commit: b2a6309737d041b7af22085ba5719de00894d74c
Parents: c72a7bb 062bd07
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:05:47 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:05:47 2016 -0500

--
 NEWS.txt   |  2 +-
 build.xml  |  2 +-
 test/conf/logback-test.xml |  2 +-
 test/unit/org/apache/cassandra/cql3/CQLTester.java | 12 ++--
 4 files changed, 9 insertions(+), 9 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b2a63097/build.xml
--

[4/4] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.8

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.0' into cassandra-3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/062bd073
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/062bd073
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/062bd073

Branch: refs/heads/cassandra-3.8
Commit: 062bd0730af1f5e9665e8873f7b336b221ec3226
Parents: 4e46ec9 01ae279
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:05:15 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:05:15 2016 -0500

--
 build.xml  |  2 +-
 test/conf/logback-test.xml |  2 +-
 test/unit/org/apache/cassandra/cql3/CQLTester.java | 12 ++--
 3 files changed, 8 insertions(+), 8 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/build.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/test/conf/logback-test.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/test/unit/org/apache/cassandra/cql3/CQLTester.java
--

[1/6] cassandra git commit: Update NEWS.txt for 3.8

2016-08-17 Thread tylerhobbs 
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.9 c72a7bbe8 -> b2a630973


Update NEWS.txt for 3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/4e46ec92
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/4e46ec92
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/4e46ec92

Branch: refs/heads/cassandra-3.9
Commit: 4e46ec926167e43dacd2afd2ccdc7cf84525e644
Parents: c1e9ad8
Author: Michael Shuler 
Authored: Tue Aug 16 17:55:15 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 17:55:15 2016 -0500

--
 NEWS.txt | 30 --
 1 file changed, 12 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/4e46ec92/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 2edff8e..8725931 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -13,16 +13,6 @@ restore snapshots created with the previous major version 
using the
 'sstableloader' tool. You can upgrade the file format of your snapshots
 using the provided 'sstableupgrade' tool.
 
-3.9
-===
-
-Upgrading
--
-   - The ReversedType behaviour has been corrected for clustering columns of
- BYTES type containing empty value. Scrub should be run on the existing
- SSTables containing a descending clustering column of BYTES type to 
correct
- their ordering. See CASSANDRA-12127 for more details.
-
 3.8
 ===
 
@@ -54,14 +44,18 @@ New features
 
 Upgrading
 -
-- Ec2MultiRegionSnitch will no longer automatically set 
broadcast_rpc_address
-  to the public instance IP if this property is defined on cassandra.yaml.
-- The name "json" and "distinct" are not valid anymore a user-defined 
function
-  names (they are still valid as column name however). In the unlikely 
case where
-  you had defined functions with such names, you will need to recreate
-  those under a different name, change your code to use the new names and
-  drop the old versions, and this _before_ upgrade (see CASSANDRA-10783 
for more
-  details).
+   - The ReversedType behaviour has been corrected for clustering columns of
+ BYTES type containing empty value. Scrub should be run on the existing
+ SSTables containing a descending clustering column of BYTES type to 
correct
+ their ordering. See CASSANDRA-12127 for more details.
+   - Ec2MultiRegionSnitch will no longer automatically set 
broadcast_rpc_address
+ to the public instance IP if this property is defined on cassandra.yaml.
+   - The name "json" and "distinct" are not valid anymore a user-defined 
function
+ names (they are still valid as column name however). In the unlikely case 
where
+ you had defined functions with such names, you will need to recreate
+ those under a different name, change your code to use the new names and
+ drop the old versions, and this _before_ upgrade (see CASSANDRA-10783 for 
more
+ details).
 
 Deprecation
 ---

[2/4] cassandra git commit: Debug logging for unit tests

2016-08-17 Thread tylerhobbs 
Debug logging for unit tests

Patch by marcuse; reviewed by Michael Shuler for CASSANDRA-12425


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/5694a2ac
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/5694a2ac
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/5694a2ac

Branch: refs/heads/cassandra-3.8
Commit: 5694a2ac3f227bdd22f1532059b566820deaf23e
Parents: 8b5b185
Author: Marcus Eriksson 
Authored: Wed Aug 10 08:34:28 2016 +0200
Committer: Marcus Eriksson 
Committed: Wed Aug 17 15:08:08 2016 +0200

--
 test/conf/logback-test.xml |  2 +-
 test/unit/org/apache/cassandra/cql3/CQLTester.java | 12 ++--
 2 files changed, 7 insertions(+), 7 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/5694a2ac/test/conf/logback-test.xml
--
diff --git a/test/conf/logback-test.xml b/test/conf/logback-test.xml
index abedc32..21c7142 100644
--- a/test/conf/logback-test.xml
+++ b/test/conf/logback-test.xml
@@ -68,7 +68,7 @@
   
   
 
-  
+  
 
   
 

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5694a2ac/test/unit/org/apache/cassandra/cql3/CQLTester.java
--
diff --git a/test/unit/org/apache/cassandra/cql3/CQLTester.java 
b/test/unit/org/apache/cassandra/cql3/CQLTester.java
index c9c4631..7f5eb02 100644
--- a/test/unit/org/apache/cassandra/cql3/CQLTester.java
+++ b/test/unit/org/apache/cassandra/cql3/CQLTester.java
@@ -707,8 +707,8 @@ public abstract class CQLTester
 UntypedResultSet rs;
 if (usePrepared)
 {
-if (logger.isDebugEnabled())
-logger.debug("Executing: {} with values {}", query, 
formatAllValues(values));
+if (logger.isTraceEnabled())
+logger.trace("Executing: {} with values {}", query, 
formatAllValues(values));
 if (reusePrepared)
 {
 rs = QueryProcessor.executeInternal(query, 
transformValues(values));
@@ -728,14 +728,14 @@ public abstract class CQLTester
 else
 {
 query = replaceValues(query, values);
-if (logger.isDebugEnabled())
-logger.debug("Executing: {}", query);
+if (logger.isTraceEnabled())
+logger.trace("Executing: {}", query);
 rs = QueryProcessor.executeOnceInternal(query);
 }
 if (rs != null)
 {
-if (logger.isDebugEnabled())
-logger.debug("Got {} rows", rs.size());
+if (logger.isTraceEnabled())
+logger.trace("Got {} rows", rs.size());
 }
 return rs;
 }

[2/9] cassandra git commit: Update CHANGES.txt for 3.9

2016-08-17 Thread tylerhobbs 
Update CHANGES.txt for 3.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/24e1fd66
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/24e1fd66
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/24e1fd66

Branch: refs/heads/trunk
Commit: 24e1fd666b9912bb8e97c94441c22f7c67961bf0
Parents: c1e9ad8
Author: Michael Shuler 
Authored: Tue Aug 16 17:48:35 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 17:48:35 2016 -0500

--
 CHANGES.txt | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/24e1fd66/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index b27d974..7bfe659 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,4 @@
-3.8
+3.9
  * Fix value skipping with counter columns (CASSANDRA-11726)
  * Fix nodetool tablestats miss SSTable count (CASSANDRA-12205)
  * Fixed flacky SSTablesIteratedTest (CASSANDRA-12282)

[4/9] cassandra git commit: Update NEWS.txt for 3.8

2016-08-17 Thread tylerhobbs 
Update NEWS.txt for 3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/4e46ec92
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/4e46ec92
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/4e46ec92

Branch: refs/heads/trunk
Commit: 4e46ec926167e43dacd2afd2ccdc7cf84525e644
Parents: c1e9ad8
Author: Michael Shuler 
Authored: Tue Aug 16 17:55:15 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 17:55:15 2016 -0500

--
 NEWS.txt | 30 --
 1 file changed, 12 insertions(+), 18 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/4e46ec92/NEWS.txt
--
diff --git a/NEWS.txt b/NEWS.txt
index 2edff8e..8725931 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -13,16 +13,6 @@ restore snapshots created with the previous major version 
using the
 'sstableloader' tool. You can upgrade the file format of your snapshots
 using the provided 'sstableupgrade' tool.
 
-3.9
-===
-
-Upgrading
--
-   - The ReversedType behaviour has been corrected for clustering columns of
- BYTES type containing empty value. Scrub should be run on the existing
- SSTables containing a descending clustering column of BYTES type to 
correct
- their ordering. See CASSANDRA-12127 for more details.
-
 3.8
 ===
 
@@ -54,14 +44,18 @@ New features
 
 Upgrading
 -
-- Ec2MultiRegionSnitch will no longer automatically set 
broadcast_rpc_address
-  to the public instance IP if this property is defined on cassandra.yaml.
-- The name "json" and "distinct" are not valid anymore a user-defined 
function
-  names (they are still valid as column name however). In the unlikely 
case where
-  you had defined functions with such names, you will need to recreate
-  those under a different name, change your code to use the new names and
-  drop the old versions, and this _before_ upgrade (see CASSANDRA-10783 
for more
-  details).
+   - The ReversedType behaviour has been corrected for clustering columns of
+ BYTES type containing empty value. Scrub should be run on the existing
+ SSTables containing a descending clustering column of BYTES type to 
correct
+ their ordering. See CASSANDRA-12127 for more details.
+   - Ec2MultiRegionSnitch will no longer automatically set 
broadcast_rpc_address
+ to the public instance IP if this property is defined on cassandra.yaml.
+   - The name "json" and "distinct" are not valid anymore a user-defined 
function
+ names (they are still valid as column name however). In the unlikely case 
where
+ you had defined functions with such names, you will need to recreate
+ those under a different name, change your code to use the new names and
+ drop the old versions, and this _before_ upgrade (see CASSANDRA-10783 for 
more
+ details).
 
 Deprecation
 ---

[5/6] cassandra git commit: Merge branch 'cassandra-3.0' into cassandra-3.8

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.0' into cassandra-3.8


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/062bd073
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/062bd073
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/062bd073

Branch: refs/heads/cassandra-3.9
Commit: 062bd0730af1f5e9665e8873f7b336b221ec3226
Parents: 4e46ec9 01ae279
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:05:15 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:05:15 2016 -0500

--
 build.xml  |  2 +-
 test/conf/logback-test.xml |  2 +-
 test/unit/org/apache/cassandra/cql3/CQLTester.java | 12 ++--
 3 files changed, 8 insertions(+), 8 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/build.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/test/conf/logback-test.xml
--

http://git-wip-us.apache.org/repos/asf/cassandra/blob/062bd073/test/unit/org/apache/cassandra/cql3/CQLTester.java
--

[6/6] cassandra git commit: Merge branch 'cassandra-3.8' into cassandra-3.9

2016-08-17 Thread tylerhobbs 
Merge branch 'cassandra-3.8' into cassandra-3.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/b2a63097
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/b2a63097
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/b2a63097

Branch: refs/heads/cassandra-3.9
Commit: b2a6309737d041b7af22085ba5719de00894d74c
Parents: c72a7bb 062bd07
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:05:47 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:05:47 2016 -0500

--
 NEWS.txt   |  2 +-
 build.xml  |  2 +-
 test/conf/logback-test.xml |  2 +-
 test/unit/org/apache/cassandra/cql3/CQLTester.java | 12 ++--
 4 files changed, 9 insertions(+), 9 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/b2a63097/build.xml
--

[2/6] cassandra git commit: Update build.xml and debian/changelog for 3.0.9

2016-08-17 Thread tylerhobbs 
Update build.xml and debian/changelog for 3.0.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/8b5b1854
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/8b5b1854
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/8b5b1854

Branch: refs/heads/cassandra-3.9
Commit: 8b5b1854c3a496dd13372aac896fb914f199ed88
Parents: bb56193
Author: Michael Shuler 
Authored: Tue Aug 16 18:04:08 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 18:04:08 2016 -0500

--
 build.xml| 2 +-
 debian/changelog | 6 ++
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/8b5b1854/build.xml
--
diff --git a/build.xml b/build.xml
index 02e8687..acc7c9e 100644
--- a/build.xml
+++ b/build.xml
@@ -25,7 +25,7 @@
 
 
 
-
+
 
 
 http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=tree"/>

http://git-wip-us.apache.org/repos/asf/cassandra/blob/8b5b1854/debian/changelog
--
diff --git a/debian/changelog b/debian/changelog
index 69b7cf9..d54d59a 100644
--- a/debian/changelog
+++ b/debian/changelog
@@ -1,3 +1,9 @@
+cassandra (3.0.9) unstable; urgency=medium
+
+  * New release
+
+ -- Michael Shuler   Tue, 16 Aug 2016 18:02:20 -0500
+
 cassandra (3.0.8) unstable; urgency=medium
 
   * New release

cassandra git commit: Ninja: temporarily remove test-clientutil-jar from test-all

2016-08-17 Thread tylerhobbs 
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.0 5694a2ac3 -> 01ae2794e


Ninja: temporarily remove test-clientutil-jar from test-all

This is a temporary measure to fix test-all until CASSANDRA-11635 can be
properly fixed and allow test-clientutil-jar to work again.


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/01ae2794
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/01ae2794
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/01ae2794

Branch: refs/heads/cassandra-3.0
Commit: 01ae2794e5f3f33d8755cb913f11d917cf7e6bd7
Parents: 5694a2a
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:03:30 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:03:30 2016 -0500

--
 build.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/01ae2794/build.xml
--
diff --git a/build.xml b/build.xml
index acc7c9e..532c944 100644
--- a/build.xml
+++ b/build.xml
@@ -1442,7 +1442,7 @@

[3/6] cassandra git commit: Debug logging for unit tests

2016-08-17 Thread tylerhobbs 
Debug logging for unit tests

Patch by marcuse; reviewed by Michael Shuler for CASSANDRA-12425


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/5694a2ac
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/5694a2ac
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/5694a2ac

Branch: refs/heads/cassandra-3.9
Commit: 5694a2ac3f227bdd22f1532059b566820deaf23e
Parents: 8b5b185
Author: Marcus Eriksson 
Authored: Wed Aug 10 08:34:28 2016 +0200
Committer: Marcus Eriksson 
Committed: Wed Aug 17 15:08:08 2016 +0200

--
 test/conf/logback-test.xml |  2 +-
 test/unit/org/apache/cassandra/cql3/CQLTester.java | 12 ++--
 2 files changed, 7 insertions(+), 7 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/5694a2ac/test/conf/logback-test.xml
--
diff --git a/test/conf/logback-test.xml b/test/conf/logback-test.xml
index abedc32..21c7142 100644
--- a/test/conf/logback-test.xml
+++ b/test/conf/logback-test.xml
@@ -68,7 +68,7 @@
   
   
 
-  
+  
 
   
 

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5694a2ac/test/unit/org/apache/cassandra/cql3/CQLTester.java
--
diff --git a/test/unit/org/apache/cassandra/cql3/CQLTester.java 
b/test/unit/org/apache/cassandra/cql3/CQLTester.java
index c9c4631..7f5eb02 100644
--- a/test/unit/org/apache/cassandra/cql3/CQLTester.java
+++ b/test/unit/org/apache/cassandra/cql3/CQLTester.java
@@ -707,8 +707,8 @@ public abstract class CQLTester
 UntypedResultSet rs;
 if (usePrepared)
 {
-if (logger.isDebugEnabled())
-logger.debug("Executing: {} with values {}", query, 
formatAllValues(values));
+if (logger.isTraceEnabled())
+logger.trace("Executing: {} with values {}", query, 
formatAllValues(values));
 if (reusePrepared)
 {
 rs = QueryProcessor.executeInternal(query, 
transformValues(values));
@@ -728,14 +728,14 @@ public abstract class CQLTester
 else
 {
 query = replaceValues(query, values);
-if (logger.isDebugEnabled())
-logger.debug("Executing: {}", query);
+if (logger.isTraceEnabled())
+logger.trace("Executing: {}", query);
 rs = QueryProcessor.executeOnceInternal(query);
 }
 if (rs != null)
 {
-if (logger.isDebugEnabled())
-logger.debug("Got {} rows", rs.size());
+if (logger.isTraceEnabled())
+logger.trace("Got {} rows", rs.size());
 }
 return rs;
 }

[3/4] cassandra git commit: Ninja: temporarily remove test-clientutil-jar from test-all

2016-08-17 Thread tylerhobbs 
Ninja: temporarily remove test-clientutil-jar from test-all

This is a temporary measure to fix test-all until CASSANDRA-11635 can be
properly fixed and allow test-clientutil-jar to work again.


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/01ae2794
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/01ae2794
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/01ae2794

Branch: refs/heads/cassandra-3.8
Commit: 01ae2794e5f3f33d8755cb913f11d917cf7e6bd7
Parents: 5694a2a
Author: Tyler Hobbs 
Authored: Wed Aug 17 17:03:30 2016 -0500
Committer: Tyler Hobbs 
Committed: Wed Aug 17 17:03:30 2016 -0500

--
 build.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/01ae2794/build.xml
--
diff --git a/build.xml b/build.xml
index acc7c9e..532c944 100644
--- a/build.xml
+++ b/build.xml
@@ -1442,7 +1442,7 @@

[1/4] cassandra git commit: Update build.xml and debian/changelog for 3.0.9

2016-08-17 Thread tylerhobbs 
Repository: cassandra
Updated Branches:
  refs/heads/cassandra-3.8 4e46ec926 -> 062bd0730


Update build.xml and debian/changelog for 3.0.9


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/8b5b1854
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/8b5b1854
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/8b5b1854

Branch: refs/heads/cassandra-3.8
Commit: 8b5b1854c3a496dd13372aac896fb914f199ed88
Parents: bb56193
Author: Michael Shuler 
Authored: Tue Aug 16 18:04:08 2016 -0500
Committer: Michael Shuler 
Committed: Tue Aug 16 18:04:08 2016 -0500

--
 build.xml| 2 +-
 debian/changelog | 6 ++
 2 files changed, 7 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/8b5b1854/build.xml
--
diff --git a/build.xml b/build.xml
index 02e8687..acc7c9e 100644
--- a/build.xml
+++ b/build.xml
@@ -25,7 +25,7 @@
 
 
 
-
+
 
 
 http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=tree"/>

http://git-wip-us.apache.org/repos/asf/cassandra/blob/8b5b1854/debian/changelog
--
diff --git a/debian/changelog b/debian/changelog
index 69b7cf9..d54d59a 100644
--- a/debian/changelog
+++ b/debian/changelog
@@ -1,3 +1,9 @@
+cassandra (3.0.9) unstable; urgency=medium
+
+  * New release
+
+ -- Michael Shuler   Tue, 16 Aug 2016 18:02:20 -0500
+
 cassandra (3.0.8) unstable; urgency=medium
 
   * New release

[jira] [Updated] (CASSANDRA-12378) Creating SASI index on clustering column in presence of static column breaks writes

2016-08-17 Thread Pavel Yaskevich (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Yaskevich updated CASSANDRA-12378:

   Resolution: Fixed
Fix Version/s: 3.10
   Status: Resolved  (was: Patch Available)

Committed.

> Creating SASI index on clustering column in presence of static column breaks 
> writes
> ---
>
> Key: CASSANDRA-12378
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12378
> Project: Cassandra
>  Issue Type: Bug
>  Components: sasi
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>Priority: Critical
> Fix For: 3.10
>
>
> Steps to reproduce:
> {code}
> String simpleTable = "simple_table";
> QueryProcessor.executeOnceInternal(String.format("CREATE TABLE IF NOT EXISTS 
> %s.%s (pk int, ck1 int, ck2 int, s1 int static, reg1 int, PRIMARY KEY (pk, 
> ck1));", KS_NAME, simpleTable));
> QueryProcessor.executeOnceInternal(String.format("CREATE CUSTOM INDEX ON 
> %s.%s (ck1) USING 'org.apache.cassandra.index.sasi.SASIIndex';", KS_NAME, 
> simpleTable));
> QueryProcessor.executeOnceInternal(String.format("INSERT INTO %s.%s (pk, ck1, 
> ck2, s1, reg1) VALUES (1,1,1,1,1);", KS_NAME, simpleTable));
> {code}
> {code}
> ERROR [MutationStage-2] 2016-08-04 09:59:08,054 StorageProxy.java:1351 - 
> Failed to apply mutation locally : {}
> java.lang.RuntimeException: 0 for ks: test, table: sasi
> at 
> org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:1371) 
> ~[main/:na]
> at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:555) 
> ~[main/:na]
> at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:425) 
> ~[main/:na]
> at org.apache.cassandra.db.Mutation.applyFuture(Mutation.java:215) 
> ~[main/:na]
> at org.apache.cassandra.db.Mutation.apply(Mutation.java:227) 
> ~[main/:na]
> at org.apache.cassandra.db.Mutation.apply(Mutation.java:241) 
> ~[main/:na]
> at 
> org.apache.cassandra.service.StorageProxy$8.runMayThrow(StorageProxy.java:1345)
>  ~[main/:na]
> at 
> org.apache.cassandra.service.StorageProxy$LocalMutationRunnable.run(StorageProxy.java:2520)
>  [main/:na]
> at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> [na:1.8.0_91]
> at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
>  [main/:na]
> at 
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134)
>  [main/:na]
> at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:109) 
> [main/:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 0
> at 
> org.apache.cassandra.db.AbstractBufferClusteringPrefix.get(AbstractBufferClusteringPrefix.java:55)
>  ~[main/:na]
> at 
> org.apache.cassandra.index.sasi.conf.ColumnIndex.getValueOf(ColumnIndex.java:235)
>  ~[main/:na]
> at 
> org.apache.cassandra.index.sasi.conf.ColumnIndex.index(ColumnIndex.java:104) 
> ~[main/:na]
> at 
> org.apache.cassandra.index.sasi.SASIIndex$1.insertRow(SASIIndex.java:254) 
> ~[main/:na]
> at 
> org.apache.cassandra.index.SecondaryIndexManager$WriteTimeTransaction.onInserted(SecondaryIndexManager.java:808)
>  ~[main/:na]
> at 
> org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:335)
>  ~[main/:na]
> at 
> org.apache.cassandra.db.partitions.AtomicBTreePartition.addAllWithSizeDelta(AtomicBTreePartition.java:155)
>  ~[main/:na]
> at org.apache.cassandra.db.Memtable.put(Memtable.java:251) ~[main/:na]
> at 
> org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:1358) 
> ~[main/:na]
> ... 12 common frames omitted
> {code}
> I would say this issue is critical, as if it occurs, the node will crash on 
> commitlog replay, too (if it was restarted for unrelated reason). 
> However, the fix is relatively simple: check for static clustering in 
> {{ColumnIndex}}. 
> cc [~xedin]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

cassandra git commit: Fix clustering indexes in presence of static columns in SASI

2016-08-17 Thread xedin 
Repository: cassandra
Updated Branches:
  refs/heads/trunk 55a45b58d -> 5c6cdc60a


Fix clustering indexes in presence of static columns in SASI

Patch by Alex Petrov; reviewed by Pavel Yaskevich for CASSANDRA-12378


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/5c6cdc60
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/5c6cdc60
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/5c6cdc60

Branch: refs/heads/trunk
Commit: 5c6cdc60a7c05bc82f5eae848eeb9ab99ff6a53f
Parents: 55a45b5
Author: Alex Petrov 
Authored: Fri Aug 5 16:12:34 2016 +0200
Committer: Pavel Yaskevich 
Committed: Wed Aug 17 14:45:02 2016 -0700

--
 CHANGES.txt   |  1 +
 .../org/apache/cassandra/index/sasi/conf/ColumnIndex.java |  4 
 test/unit/org/apache/cassandra/SchemaLoader.java  |  1 +
 .../org/apache/cassandra/index/sasi/SASIIndexTest.java| 10 +-
 4 files changed, 11 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/5c6cdc60/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index d5e220c..fa7ec69 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.10
+ * Fix clustering indexes in presence of static columns in SASI 
(CASSANDRA-12378)
  * Fix queries on columns with reversed type on SASI indexes (CASSANDRA-12223)
  * Added slow query log (CASSANDRA-12403)
  * Count full coordinated request against timeout (CASSANDRA-12256)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5c6cdc60/src/java/org/apache/cassandra/index/sasi/conf/ColumnIndex.java
--
diff --git a/src/java/org/apache/cassandra/index/sasi/conf/ColumnIndex.java 
b/src/java/org/apache/cassandra/index/sasi/conf/ColumnIndex.java
index 3f268e3..440d475 100644
--- a/src/java/org/apache/cassandra/index/sasi/conf/ColumnIndex.java
+++ b/src/java/org/apache/cassandra/index/sasi/conf/ColumnIndex.java
@@ -232,6 +232,10 @@ public class ColumnIndex
 switch (column.kind)
 {
 case CLUSTERING:
+// skip indexing of static clustering when regular column is 
indexed
+if (row.isStatic())
+return null;
+
 return row.clustering().get(column.position());
 
 // treat static cell retrieval the same was as regular

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5c6cdc60/test/unit/org/apache/cassandra/SchemaLoader.java
--
diff --git a/test/unit/org/apache/cassandra/SchemaLoader.java 
b/test/unit/org/apache/cassandra/SchemaLoader.java
index 81d25b9..c178ee0 100644
--- a/test/unit/org/apache/cassandra/SchemaLoader.java
+++ b/test/unit/org/apache/cassandra/SchemaLoader.java
@@ -596,6 +596,7 @@ public class SchemaLoader
.addClusteringColumn("age", 
Int32Type.instance)
.addRegularColumn("height", 
Int32Type.instance)
.addRegularColumn("score", 
DoubleType.instance)
+   .addStaticColumn("nickname", 
UTF8Type.instance)
.build();
 
 Indexes indexes = cfm.getIndexes();

http://git-wip-us.apache.org/repos/asf/cassandra/blob/5c6cdc60/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
--
diff --git a/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java 
b/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
index da1d0e3..e2797e2 100644
--- a/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
+++ b/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
@@ -1661,9 +1661,9 @@ public class SASIIndexTest
 {
 ColumnFamilyStore store = 
Keyspace.open(KS_NAME).getColumnFamilyStore(CLUSTERING_CF_NAME_1);
 
-executeCQL(CLUSTERING_CF_NAME_1, "INSERT INTO %s.%s (name, location, 
age, height, score) VALUES (?, ?, ?, ?, ?)", "Pavel", "US", 27, 183, 1.0);
-executeCQL(CLUSTERING_CF_NAME_1, "INSERT INTO %s.%s (name, location, 
age, height, score) VALUES (?, ?, ?, ?, ?)", "Pavel", "BY", 28, 182, 2.0);
-executeCQL(CLUSTERING_CF_NAME_1 ,"INSERT INTO %s.%s (name, location, 
age, height, score) VALUES (?, ?, ?, ?, ?)", "Jordan", "US", 27, 182, 1.0);
+executeCQL(CLUSTERING_CF_NAME_1, "INSERT INTO %s.%s (name, nickname, 
location, age, height, score) VALUES (?, ?, ?, ?, ?, ?)", "Pavel", "xedin", 
"US", 27, 183, 1.0);
+

[jira] [Updated] (CASSANDRA-11866) nodetool repair does not obey the column family parameter when -st and -et are provided (subrange repair)

2016-08-17 Thread Jeremiah Jordan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeremiah Jordan updated CASSANDRA-11866:

Status: Patch Available  (was: Open)

> nodetool repair does not obey the column family parameter when -st and -et 
> are provided (subrange repair)
> -
>
> Key: CASSANDRA-11866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tools
> Environment: Red Hat Enterprise Linux Server release 6.7 (Santiago) 
> x86_64
>Reporter: Shiva Venkateswaran
>  Labels: newbie
> Fix For: 2.1.x
>
> Attachments: 0001-CASSANDRA-11866-dtest.patch, 11866-2.1.txt
>
>
> Command 1: Repairs all the CFs in ADL_GLOBAL keyspace and ignores the 
> parameter AssetModifyTimes_data used to restrict the CFs
> Executing: /aladdin/local/apps/apache-cassandra-2.1.8a/bin/nodetool -h 
> localhost -p 7199 -u user-pw ** repair ADL_GLOBAL AssetModifyTimes_data 
> -st 205279477618143669 -et 230991685737746901 -par
> [2016-05-20 17:31:39,116] Starting repair command #9, repairing 1 ranges for 
> keyspace ADL_GLOBAL (parallelism=PARALLEL, full=true)
> [2016-05-20 17:32:21,568] Repair session 3cae2530-1ed2-11e6-b490-d9df6932c7cf 
> for range (205279477618143669,230991685737746901] finished
> Command 2: Repairs all the CFs in ADL_GLOBAL keyspace and ignores the 
> parameter AssetModifyTimes_data used to restrict the CFs
> Executing: /aladdin/local/apps/apache-cassandra-2.1.8a/bin/nodetool -h 
> localhost -p 7199 -u controlRole -pw ** repair -st 205279477618143669 -et 
> 230991685737746901 -par -- ADL_GLOBAL AssetModifyTimes_data
> [2016-05-20 17:36:34,473] Starting repair command #10, repairing 1 ranges for 
> keyspace ADL_GLOBAL (parallelism=PARALLEL, full=true)
> [2016-05-20 17:37:15,365] Repair session ecb996d0-1ed2-11e6-b490-d9df6932c7cf 
> for range (205279477618143669,230991685737746901] finished
> [2016-05-20 17:37:15,365] Repair command #10 finished
> Command 3: Repairs only the CF ADL3Test1_data in keyspace ADL_GLOBAL
> Executing: /aladdin/local/apps/apache-cassandra-2.1.8a/bin/nodetool -h 
> localhost -p 7199 -u controlRole -pw ** repair -- ADL_GLOBAL 
> ADL3Test1_data
> [2016-05-20 17:38:35,781] Starting repair command #11, repairing 1043 ranges 
> for keyspace ADL_GLOBAL (parallelism=SEQUENTIAL, full=true)
> [2016-05-20 17:42:32,682] Repair session 3c8af050-1ed3-11e6-b490-d9df6932c7cf 
> for range (6241639152751626129,6241693909092643958] finished
> [2016-05-20 17:42:32,683] Repair session 3caf1a20-1ed3-11e6-b490-d9df6932c7cf 
> for range (-7096993048358106082,-7095000706885780850] finished
> [2016-05-20 17:42:32,683] Repair session 3ccfc180-1ed3-11e6-b490-d9df6932c7cf 
> for range (-7218939248114487080,-7218289345961492809] finished
> [2016-05-20 17:42:32,683] Repair session 3cf21690-1ed3-11e6-b490-d9df6932c7cf 
> for range (-5244794756638190874,-5190307341355030282] finished
> [2016-05-20 17:42:32,683] Repair session 3d126fd0-1ed3-11e6-b490-d9df6932c7cf 
> for range (3551629701277971766,321736534916502] finished
> [2016-05-20 17:42:32,683] Repair session 3d32f020-1ed3-11e6-b490-d9df6932c7cf 
> for range (-8139355591560661944,-8127928369093576603] finished
> [2016-05-20 17:42:32,683] Repair session 3d537070-1ed3-11e6-b490-d9df6932c7cf 
> for range (7098010153980465751,7100863011896759020] finished
> [2016-05-20 17:42:32,683] Repair session 3d73f0c0-1ed3-11e6-b490-d9df6932c7cf 
> for range (1004538726866173536,1008586133746764703] finished
> [2016-05-20 17:42:32,683] Repair session 3d947110-1ed3-11e6-b490-d9df6932c7cf 
> for range (5770817093573726645,5771418910784831587] finished
> .
> .
> .
> [2016-05-20 17:42:32,732] Repair command #11 finished



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-11866) nodetool repair does not obey the column family parameter when -st and -et are provided (subrange repair)

2016-08-17 Thread Brian Wawok (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Brian Wawok updated CASSANDRA-11866:

Attachment: 0001-CASSANDRA-11866-dtest.patch

Add a dtest to show this flaw.  Not 100% confident that this is the ideal 
d-test, would like a code review to make sure it isn't too simple

> nodetool repair does not obey the column family parameter when -st and -et 
> are provided (subrange repair)
> -
>
> Key: CASSANDRA-11866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tools
> Environment: Red Hat Enterprise Linux Server release 6.7 (Santiago) 
> x86_64
>Reporter: Shiva Venkateswaran
>  Labels: newbie
> Fix For: 2.1.x
>
> Attachments: 0001-CASSANDRA-11866-dtest.patch, 11866-2.1.txt
>
>
> Command 1: Repairs all the CFs in ADL_GLOBAL keyspace and ignores the 
> parameter AssetModifyTimes_data used to restrict the CFs
> Executing: /aladdin/local/apps/apache-cassandra-2.1.8a/bin/nodetool -h 
> localhost -p 7199 -u user-pw ** repair ADL_GLOBAL AssetModifyTimes_data 
> -st 205279477618143669 -et 230991685737746901 -par
> [2016-05-20 17:31:39,116] Starting repair command #9, repairing 1 ranges for 
> keyspace ADL_GLOBAL (parallelism=PARALLEL, full=true)
> [2016-05-20 17:32:21,568] Repair session 3cae2530-1ed2-11e6-b490-d9df6932c7cf 
> for range (205279477618143669,230991685737746901] finished
> Command 2: Repairs all the CFs in ADL_GLOBAL keyspace and ignores the 
> parameter AssetModifyTimes_data used to restrict the CFs
> Executing: /aladdin/local/apps/apache-cassandra-2.1.8a/bin/nodetool -h 
> localhost -p 7199 -u controlRole -pw ** repair -st 205279477618143669 -et 
> 230991685737746901 -par -- ADL_GLOBAL AssetModifyTimes_data
> [2016-05-20 17:36:34,473] Starting repair command #10, repairing 1 ranges for 
> keyspace ADL_GLOBAL (parallelism=PARALLEL, full=true)
> [2016-05-20 17:37:15,365] Repair session ecb996d0-1ed2-11e6-b490-d9df6932c7cf 
> for range (205279477618143669,230991685737746901] finished
> [2016-05-20 17:37:15,365] Repair command #10 finished
> Command 3: Repairs only the CF ADL3Test1_data in keyspace ADL_GLOBAL
> Executing: /aladdin/local/apps/apache-cassandra-2.1.8a/bin/nodetool -h 
> localhost -p 7199 -u controlRole -pw ** repair -- ADL_GLOBAL 
> ADL3Test1_data
> [2016-05-20 17:38:35,781] Starting repair command #11, repairing 1043 ranges 
> for keyspace ADL_GLOBAL (parallelism=SEQUENTIAL, full=true)
> [2016-05-20 17:42:32,682] Repair session 3c8af050-1ed3-11e6-b490-d9df6932c7cf 
> for range (6241639152751626129,6241693909092643958] finished
> [2016-05-20 17:42:32,683] Repair session 3caf1a20-1ed3-11e6-b490-d9df6932c7cf 
> for range (-7096993048358106082,-7095000706885780850] finished
> [2016-05-20 17:42:32,683] Repair session 3ccfc180-1ed3-11e6-b490-d9df6932c7cf 
> for range (-7218939248114487080,-7218289345961492809] finished
> [2016-05-20 17:42:32,683] Repair session 3cf21690-1ed3-11e6-b490-d9df6932c7cf 
> for range (-5244794756638190874,-5190307341355030282] finished
> [2016-05-20 17:42:32,683] Repair session 3d126fd0-1ed3-11e6-b490-d9df6932c7cf 
> for range (3551629701277971766,321736534916502] finished
> [2016-05-20 17:42:32,683] Repair session 3d32f020-1ed3-11e6-b490-d9df6932c7cf 
> for range (-8139355591560661944,-8127928369093576603] finished
> [2016-05-20 17:42:32,683] Repair session 3d537070-1ed3-11e6-b490-d9df6932c7cf 
> for range (7098010153980465751,7100863011896759020] finished
> [2016-05-20 17:42:32,683] Repair session 3d73f0c0-1ed3-11e6-b490-d9df6932c7cf 
> for range (1004538726866173536,1008586133746764703] finished
> [2016-05-20 17:42:32,683] Repair session 3d947110-1ed3-11e6-b490-d9df6932c7cf 
> for range (5770817093573726645,5771418910784831587] finished
> .
> .
> .
> [2016-05-20 17:42:32,732] Repair command #11 finished



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12223) SASI Indexes querying incorrectly return 0 rows

2016-08-17 Thread Pavel Yaskevich (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pavel Yaskevich updated CASSANDRA-12223:

   Resolution: Fixed
Fix Version/s: (was: 3.7)
   3.10
   Status: Resolved  (was: Patch Available)

Committed. Thanks, [~ifesdjeen]!

> SASI Indexes querying incorrectly return 0 rows
> ---
>
> Key: CASSANDRA-12223
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12223
> Project: Cassandra
>  Issue Type: Bug
>  Components: sasi
> Environment: Windows, DataStax Distribution
>Reporter: Qiu Zhida
>Assignee: Alex Petrov
> Fix For: 3.10
>
>
> I just started working with the SASI index on Cassandra 3.7.0 and I 
> encountered a problem which as I suspected was a bug. I had hardly tracked 
> down the situation in which the bug showed up, here is what I found:
> When querying with a SASI index, *it may incorrectly return 0 rows*, and 
> changing a little conditions, it works again, like the following CQL code:
> {code:title=CQL|borderStyle=solid}
> CREATE TABLE IF NOT EXISTS roles (
> name text,
> a int,
> b int,
> PRIMARY KEY ((name, a), b)
> ) WITH CLUSTERING ORDER BY (b DESC);
> 
> insert into roles (name,a,b) values ('Joe',1,1);
> insert into roles (name,a,b) values ('Joe',2,2);
> insert into roles (name,a,b) values ('Joe',3,3);
> insert into roles (name,a,b) values ('Joe',4,4);
> CREATE TABLE IF NOT EXISTS roles2 (
> name text,
> a int,
> b int,
> PRIMARY KEY ((name, a), b)
> ) WITH CLUSTERING ORDER BY (b ASC);
> 
> insert into roles2 (name,a,b) values ('Joe',1,1);
> insert into roles2 (name,a,b) values ('Joe',2,2);
> insert into roles2 (name,a,b) values ('Joe',3,3);
> insert into roles2 (name,a,b) values ('Joe',4,4);
> CREATE CUSTOM INDEX ON roles (b) USING 
> 'org.apache.cassandra.index.sasi.SASIIndex' 
> WITH OPTIONS = { 'mode': 'SPARSE' };
> CREATE CUSTOM INDEX ON roles2 (b) USING 
> 'org.apache.cassandra.index.sasi.SASIIndex' 
> WITH OPTIONS = { 'mode': 'SPARSE' };
> {code}
> Noticing that I only change table *roles2* from table *roles*'s '*CLUSTERING 
> ORDER BY (b DESC)*' into '*CLUSTERING ORDER BY (b ASC)*'.
> When querying with statement +select * from roles2 where b<3+, the rusult is 
> two rows:
> {code:title=CQL|borderStyle=solid}
>  name | a | b
> --+---+---
>   Joe | 1 | 1
>   Joe | 2 | 2
> (2 rows)
> {code}
> However, if querying with +select * from roles where b<3+, it returned no 
> rows at all:
> {code:title=CQL|borderStyle=solid}
>  name | a | b
> --+---+---
> (0 rows)
> {code}
> This is not the only situation where the bug would show up, one time I 
> created a SASI index with specific name like 'end_idx' on column 'end', the 
> bug showed up, when I didn't specify the index name, it gone.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

cassandra git commit: Fix queries on columns with reversed type on SASI indexes

2016-08-17 Thread xedin 
Repository: cassandra
Updated Branches:
  refs/heads/trunk d4d71cd33 -> 55a45b58d


Fix queries on columns with reversed type on SASI indexes

Patch by Alex Petrov; reviewed by xedin for CASSANDRA-12223


Project: http://git-wip-us.apache.org/repos/asf/cassandra/repo
Commit: http://git-wip-us.apache.org/repos/asf/cassandra/commit/55a45b58
Tree: http://git-wip-us.apache.org/repos/asf/cassandra/tree/55a45b58
Diff: http://git-wip-us.apache.org/repos/asf/cassandra/diff/55a45b58

Branch: refs/heads/trunk
Commit: 55a45b58d678eb919fa6b5a4c224fb43791e0234
Parents: d4d71cd
Author: Alex Petrov 
Authored: Fri Aug 5 16:01:50 2016 +0200
Committer: Pavel Yaskevich 
Committed: Wed Aug 17 14:40:17 2016 -0700

--
 CHANGES.txt |  1 +
 .../cassandra/index/sasi/plan/Expression.java   | 21 ++--
 .../cassandra/index/sasi/SASIIndexTest.java | 54 
 3 files changed, 72 insertions(+), 4 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/cassandra/blob/55a45b58/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
index 51b87db..d5e220c 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
 3.10
+ * Fix queries on columns with reversed type on SASI indexes (CASSANDRA-12223)
  * Added slow query log (CASSANDRA-12403)
  * Count full coordinated request against timeout (CASSANDRA-12256)
  * Allow TTL with null value on insert and update (CASSANDRA-12216)

http://git-wip-us.apache.org/repos/asf/cassandra/blob/55a45b58/src/java/org/apache/cassandra/index/sasi/plan/Expression.java
--
diff --git a/src/java/org/apache/cassandra/index/sasi/plan/Expression.java 
b/src/java/org/apache/cassandra/index/sasi/plan/Expression.java
index cc156ee..93f1938 100644
--- a/src/java/org/apache/cassandra/index/sasi/plan/Expression.java
+++ b/src/java/org/apache/cassandra/index/sasi/plan/Expression.java
@@ -166,17 +166,30 @@ public class Expression
 break;
 
 case LTE:
-upperInclusive = true;
+if (index.getDefinition().isReversedType())
+lowerInclusive = true;
+else
+upperInclusive = true;
 case LT:
 operation = Op.RANGE;
-upper = new Bound(value, upperInclusive);
+if (index.getDefinition().isReversedType())
+lower = new Bound(value, lowerInclusive);
+else
+upper = new Bound(value, upperInclusive);
 break;
 
 case GTE:
-lowerInclusive = true;
+if (index.getDefinition().isReversedType())
+upperInclusive = true;
+else
+lowerInclusive = true;
 case GT:
 operation = Op.RANGE;
-lower = new Bound(value, lowerInclusive);
+if (index.getDefinition().isReversedType())
+upper = new Bound(value, upperInclusive);
+else
+lower = new Bound(value, lowerInclusive);
+
 break;
 }
 

http://git-wip-us.apache.org/repos/asf/cassandra/blob/55a45b58/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
--
diff --git a/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java 
b/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
index 47e3895..da1d0e3 100644
--- a/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
+++ b/test/unit/org/apache/cassandra/index/sasi/SASIIndexTest.java
@@ -2119,6 +2119,60 @@ public class SASIIndexTest
 }
 
 @Test
+public void testConditionalsWithReversedType()
+{
+final String TABLE_NAME = "reversed_clustering";
+
+QueryProcessor.executeOnceInternal(String.format("CREATE TABLE IF NOT 
EXISTS %s.%s (pk text, ck int, v int, PRIMARY KEY (pk, ck)) " +
+ "WITH CLUSTERING 
ORDER BY (ck DESC);", KS_NAME, TABLE_NAME));
+QueryProcessor.executeOnceInternal(String.format("CREATE CUSTOM INDEX 
ON %s.%s (ck) USING 'org.apache.cassandra.index.sasi.SASIIndex'", KS_NAME, 
TABLE_NAME));
+QueryProcessor.executeOnceInternal(String.format("CREATE CUSTOM INDEX 
ON %s.%s (v) USING 'org.apache.cassandra.index.sasi.SASIIndex'", KS_NAME, 
TABLE_NAME));
+
+QueryProcessor.executeOnceInternal(String.format("INSERT INTO %s.%s 
(pk, ck, v) VALUES ('Alex', 1, 1);", KS_NAME, TABLE_NAME));
+QueryProcessor.executeOnceInternal(String.format("INSERT INTO %s.%s 
(pk, ck, v) VALUES ('Alex', 2, 2);", KS_NAME,

[jira] [Created] (CASSANDRA-12484) Unknown exception caught while attempting to update MaterializedView! findkita.kitas java.lang.AssertionErro

2016-08-17 Thread cordlessWool (JIRA) 
cordlessWool created CASSANDRA-12484:


 Summary: Unknown exception caught while attempting to update 
MaterializedView! findkita.kitas java.lang.AssertionErro
 Key: CASSANDRA-12484
 URL: https://issues.apache.org/jira/browse/CASSANDRA-12484
 Project: Cassandra
  Issue Type: Bug
 Environment: Docker Container with Cassandra version 3.7 running on 
local pc
Reporter: cordlessWool
Priority: Critical


After restart my cassandra node does not start anymore. Ends with following 
error message.

ERROR 18:39:37 Unknown exception caught while attempting to update 
MaterializedView! findkita.kitas
java.lang.AssertionError: We shouldn't have got there is the base row had no 
associated entry


Cassandra has heavy cpu usage and use 2,1 gb of memory there is be 1gb more 
available. I run nodetool cleanup and repair, but did not help.

I have 5 materialzied views on this table, but the amount of rows in table is 
under 2000, that is not much.

The cassandra runs in a docker container. The container is access able, but can 
not call cqlsh and my website cound not connect too



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12257) data consistency of multi datacenter

2016-08-17 Thread Chris Lohfink (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425401#comment-15425401
 ] 

Chris Lohfink commented on CASSANDRA-12257:
---

I think CASSANDRA-11752 fixes this, then you get recency from CASSANDRA-11569

> data consistency of multi datacenter 
> -
>
> Key: CASSANDRA-12257
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12257
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Coordination
>Reporter: stone
>
> Environment:
> serveral active-active cassandra datacenter.
> set write consistency level=local_quorum to get a high resquest response.
> Concern:
> we dont know the time of the data arrive other datacenter.
> we dont know the size of data that need to be transferred  to other 
> datacenter.
> Thought:
> 1.we can get the latency with ping or other monitor tool,but it can not 
> represent the latency of cassandra data to be transferred from one dc to 
> another dc.
> 2.we can measure the latency between dc.but there is a accumulated value from 
> node started,it cannot represent the latency now.
> https://issues.apache.org/jira/browse/CASSANDRA-11569
> Scenanio:
> one project need to collect information from sensors,which in different 
> region.2 datacenter,DC1,DC2.sensor1,sensor2 in DC1 region.sensor3,sensor4 in 
> DC2.
> one client in DC1,pull data every 10 minutes.
> 1.sensor3 in DC2 write a record to DC2 at 8:59:55 ,and arrived DC1 at 9:00:05
> 2.client in DC1 pull data at 9:00,it should get the record,but it cannot as 
> the 
> record have not arrive DC1.
> 3.then client in DC1 will pull data at 9:10.it also can not get the record as 
> it will pull data from 9:00---9:10,but the record created on 8:59:55
> so we will miss the record.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12271) NonSystemKeyspaces jmx attribute needs to return jre list

2016-08-17 Thread Chris Lohfink (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425398#comment-15425398
 ] 

Chris Lohfink commented on CASSANDRA-12271:
---

Looks good to me, but I cant commit. [~JoshuaMcKenzie] ?

> NonSystemKeyspaces jmx attribute needs to return jre list
> -
>
> Key: CASSANDRA-12271
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12271
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Chris Lohfink
>Assignee: Edward Ribeiro
>  Labels: lhf
> Attachments: CASSANDRA-12271.patch, screenshot-1.png, screenshot-2.png
>
>
> If you dont have right guava in classpath you cant query the 
> NonSystemKeyspaces attribute. i.e. jconsole. can reproduce using Swiss java 
> knife:
> {code}
> # java -jar sjk.jar mx -s localhost:7199 -mg -b 
> "org.apache.cassandra.db:type=StorageService" -f NonSystemKeyspaces
> org.apache.cassandra.db:type=StorageService
> java.rmi.UnmarshalException: error unmarshalling return; nested exception is: 
>   java.lang.ClassNotFoundException: 
> com.google.common.collect.ImmutableList$SerializedForm (no security manager: 
> RMI class loader disabled)
> {code}
> If return a ArrayList or LinkedList or anything in JRE this will be fixed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Reopened] (CASSANDRA-11635) test-clientutil-jar unit test fails

2016-08-17 Thread Michael Shuler (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-11635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler reopened CASSANDRA-11635:


> test-clientutil-jar unit test fails
> ---
>
> Key: CASSANDRA-11635
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11635
> Project: Cassandra
>  Issue Type: Test
>  Components: Testing
>Reporter: Michael Shuler
>Assignee: Sylvain Lebresne
>  Labels: unittest
> Fix For: 2.2.8, 3.0.9, 3.8
>
>
> {noformat}
> test-clientutil-jar:
> [junit] Testsuite: org.apache.cassandra.serializers.ClientUtilsTest
> [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 
> 0.314 sec
> [junit] 
> [junit] Testcase: test(org.apache.cassandra.serializers.ClientUtilsTest): 
>   Caused an ERROR
> [junit] org/apache/cassandra/utils/SigarLibrary
> [junit] java.lang.NoClassDefFoundError: 
> org/apache/cassandra/utils/SigarLibrary
> [junit] at org.apache.cassandra.utils.UUIDGen.hash(UUIDGen.java:328)
> [junit] at 
> org.apache.cassandra.utils.UUIDGen.makeNode(UUIDGen.java:307)
> [junit] at 
> org.apache.cassandra.utils.UUIDGen.makeClockSeqAndNode(UUIDGen.java:256)
> [junit] at 
> org.apache.cassandra.utils.UUIDGen.(UUIDGen.java:39)
> [junit] at 
> org.apache.cassandra.serializers.ClientUtilsTest.test(ClientUtilsTest.java:56)
> [junit] Caused by: java.lang.ClassNotFoundException: 
> org.apache.cassandra.utils.SigarLibrary
> [junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> [junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> [junit] at 
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> [junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> [junit] 
> [junit] 
> [junit] Test org.apache.cassandra.serializers.ClientUtilsTest FAILED
> BUILD FAILED
> {noformat}
> I'll see if I can find a spot where this passes, but it appears to have been 
> failing for a long time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-11635) test-clientutil-jar unit test fails

2016-08-17 Thread Michael Shuler (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425333#comment-15425333
 ] 

Michael Shuler commented on CASSANDRA-11635:


This appears to have been fixed in 2.2 (and removed from trunk), but continues 
to fail in 3.0, 3.8, 3.9.

Since {{test-clientutil-jar}} is a dependency of the ant {{test-all}} target, a 
behavior change in test failure reporting should begin to fail CI {{test-all}} 
jobs, if all of the {{test-all}} targets do not pass successfully. The first 
examples of this test result behavior came up today, which is where I spotted 
this test had not been fully fixed. 
http://cassci.datastax.com/job/cassandra-3.0_testall/643/

{noformat}
(cassandra-2.2)mshuler@hana:~/git/cassandra$ git log -n1
commit 9583b6b312866a4861df1a795329695b3fc09328 (HEAD, origin/cassandra-2.2, 
github/cassandra-2.2, cassandra-2.2)
Merge: 88b3cfc 527d189
Author: Benjamin Lerer 
Date:   Tue Aug 16 15:25:42 2016 +0200

Merge branch cassandra-2.1 into cassandra-2.2

(cassandra-2.2)mshuler@hana:~/git/cassandra$ ant test-clientutil-jar
<...>
test-clientutil-jar:
[junit] Testsuite: org.apache.cassandra.serializers.ClientUtilsTest
[junit] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 
0.27 sec
[junit] 
[junit] - Standard Output ---
[junit] 13:23:19.255 [main] INFO  o.a.cassandra.utils.SigarLibrary - 
Initializing SIGAR library
[junit] -  ---

BUILD SUCCESSFUL
Total time: 1 minute 15 seconds
{noformat}

{noformat}
(cassandra-3.0)mshuler@hana:~/git/cassandra$ git log -n1
commit 5694a2ac3f227bdd22f1532059b566820deaf23e (HEAD, origin/cassandra-3.0, 
cassandra-3.0)
Author: Marcus Eriksson 
Date:   Wed Aug 10 08:34:28 2016 +0200

Debug logging for unit tests

Patch by marcuse; reviewed by Michael Shuler for CASSANDRA-12425

(cassandra-3.0)mshuler@hana:~/git/cassandra$ ant test-clientutil-jar
<...>
test-clientutil-jar:
[junit] Testsuite: org.apache.cassandra.serializers.ClientUtilsTest
[junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 
0.047 sec
[junit] 
[junit] Testcase: test(org.apache.cassandra.serializers.ClientUtilsTest):   
Caused an ERROR
[junit] org/apache/cassandra/io/sstable/metadata/MetadataType
[junit] java.lang.NoClassDefFoundError: 
org/apache/cassandra/io/sstable/metadata/MetadataType
[junit] at org.apache.cassandra.utils.UUIDGen.makeNode(UUIDGen.java:337)
[junit] at 
org.apache.cassandra.utils.UUIDGen.makeClockSeqAndNode(UUIDGen.java:291)
[junit] at org.apache.cassandra.utils.UUIDGen.(UUIDGen.java:42)
[junit] at 
org.apache.cassandra.serializers.ClientUtilsTest.test(ClientUtilsTest.java:56)
[junit] Caused by: java.lang.ClassNotFoundException: 
org.apache.cassandra.io.sstable.metadata.MetadataType
[junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
[junit] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
[junit] 
[junit] 
[junit] Test org.apache.cassandra.serializers.ClientUtilsTest FAILED

BUILD FAILED
/home/mshuler/git/cassandra/build.xml:1229: Clientutil test(s) failed.

Total time: 54 seconds
{noformat}

{noformat}
(cassandra-3.8)mshuler@hana:~/git/cassandra$ git log -n1
commit 4e46ec926167e43dacd2afd2ccdc7cf84525e644 (HEAD, origin/cassandra-3.8, 
github/cassandra-3.8, cassandra-3.8)
Author: Michael Shuler 
Date:   Tue Aug 16 17:55:15 2016 -0500

Update NEWS.txt for 3.8

(cassandra-3.8)mshuler@hana:~/git/cassandra$ ant test-clientutil-jar
<...>
test-clientutil-jar:
[junit] Testsuite: org.apache.cassandra.serializers.ClientUtilsTest
[junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 
0.041 sec
[junit] 
[junit] Testcase: test(org.apache.cassandra.serializers.ClientUtilsTest):   
Caused an ERROR
[junit] org/apache/cassandra/io/sstable/metadata/MetadataType
[junit] java.lang.NoClassDefFoundError: 
org/apache/cassandra/io/sstable/metadata/MetadataType
[junit] at org.apache.cassandra.utils.UUIDGen.makeNode(UUIDGen.java:362)
[junit] at 
org.apache.cassandra.utils.UUIDGen.makeClockSeqAndNode(UUIDGen.java:300)
[junit] at org.apache.cassandra.utils.UUIDGen.(UUIDGen.java:42)
[junit] at 
org.apache.cassandra.serializers.ClientUtilsTest.test(ClientUtilsTest.java:56)
[junit] Caused by: java.lang.ClassNotFoundException: 
org.apache.cassandra.io.sstable.metadata.MetadataType
[junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
[junit] at

[jira] [Created] (CASSANDRA-12483) CASSANDRA_CQL_HTML_FALLBACK URL's are all broken

2016-08-17 Thread Jeremiah Jordan (JIRA) 
Jeremiah Jordan created CASSANDRA-12483:
---

 Summary: CASSANDRA_CQL_HTML_FALLBACK URL's are all broken
 Key: CASSANDRA-12483
 URL: https://issues.apache.org/jira/browse/CASSANDRA-12483
 Project: Cassandra
  Issue Type: Bug
  Components: Documentation and Website
Reporter: Jeremiah Jordan


With the deployment of the new website all of the CASSANDRA_CQL_HTML_FALLBACK 
URL's from cqlsh are now 404.

https://github.com/apache/cassandra/blob/cassandra-2.2/bin/cqlsh.py#L73

https://cassandra.apache.org/doc/cql3/CQL-2.2.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12374) Can't rebuild SASI index

2016-08-17 Thread Pavel Yaskevich (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425255#comment-15425255
 ] 

Pavel Yaskevich commented on CASSANDRA-12374:
-

Looks like the tests for rebuild are still broken with the latest changes, but 
the changes look good, let me know when you fix the test, so I can commit this.

> Can't rebuild SASI index
> 
>
> Key: CASSANDRA-12374
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12374
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Alex Petrov
>Assignee: Alex Petrov
>
> There's been no real requirement for that so far. 
> As [~beobal] has pointed out, it's not a big issue, since that only could be 
> needed when index files are lost, data corruption on disk (hardware issue) 
> has occurred or there was a bug that'd require an index rebuild.
> During {{rebuild_index}} task, indexes are only "marked" as removed with 
> {{SecondaryIndexManager::markIndexRemoved}} and then {{buildIndexesBlocking}} 
> is called. However, since SASI keeps track of SSTables for the index, it's 
> going to filter them out with {{.filter((sstable) -> 
> !sasi.index.hasSSTable(sstable))}} in {{SASIIndexBuildingSupport}}.
> If I understand the logic correctly, we have to "invalidate" (drop data) 
> right before we re-index them. This is also a blocker for [CASSANDRA-11990] 
> since without it we can't have an upgrade path.
> I have a patch ready in branch, but since it's a bug, it's better to have it 
> released earlier and for all branches affected.
> cc [~xedin]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (CASSANDRA-12469) dtest failure in upgrade_tests.repair_test.TestUpgradeRepair.repair_after_upgrade_test

2016-08-17 Thread Philip Thompson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425036#comment-15425036
 ] 

Philip Thompson edited comment on CASSANDRA-12469 at 8/17/16 8:07 PM:
--

Trying again here: 
http://cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/265/


was (Author: philipthompson):
Trying again here: 
http://cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/256

> dtest failure in 
> upgrade_tests.repair_test.TestUpgradeRepair.repair_after_upgrade_test
> --
>
> Key: CASSANDRA-12469
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12469
> Project: Cassandra
>  Issue Type: Test
>Reporter: Craig Kodman
>Assignee: Philip Thompson
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, 
> node2_debug.log, node2_gc.log, node3.log, node3_debug.log, node3_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.9_dtest_upgrade/24/testReport/upgrade_tests.repair_test/TestUpgradeRepair/repair_after_upgrade_test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (CASSANDRA-12469) dtest failure in upgrade_tests.repair_test.TestUpgradeRepair.repair_after_upgrade_test

2016-08-17 Thread Philip Thompson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425036#comment-15425036
 ] 

Philip Thompson edited comment on CASSANDRA-12469 at 8/17/16 8:05 PM:
--

Trying again here: 
http://cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/256


was (Author: philipthompson):
Trying again here: 
cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/256

> dtest failure in 
> upgrade_tests.repair_test.TestUpgradeRepair.repair_after_upgrade_test
> --
>
> Key: CASSANDRA-12469
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12469
> Project: Cassandra
>  Issue Type: Test
>Reporter: Craig Kodman
>Assignee: Philip Thompson
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, 
> node2_debug.log, node2_gc.log, node3.log, node3_debug.log, node3_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.9_dtest_upgrade/24/testReport/upgrade_tests.repair_test/TestUpgradeRepair/repair_after_upgrade_test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12482) dtest failure in upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x.select_with_alias_test

2016-08-17 Thread Philip Thompson (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Philip Thompson updated CASSANDRA-12482:

Reviewer: Jim Witschey
  Status: Patch Available  (was: In Progress)

https://github.com/riptano/cassandra-dtest/pull/1255

> dtest failure in 
> upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x.select_with_alias_test
> -
>
> Key: CASSANDRA-12482
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12482
> Project: Cassandra
>  Issue Type: Test
>Reporter: Sean McCarthy
>Assignee: Philip Thompson
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, 
> node2_debug.log, node2_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/trunk_dtest_upgrade/29/testReport/upgrade_tests.cql_tests/TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x/select_with_alias_test
> {code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line 
> 3184, in select_with_alias_test
> assert_invalid(cursor, 'SELECT id AS user_id, name AS user_name FROM 
> users WHERE user_id = 0', matching=error_msg)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 92, in 
> assert_invalid
> assert_exception(session, query, matching=matching, expected=expected)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 65, in 
> assert_exception
> _assert_exception(session.execute, query, matching=matching, 
> expected=expected)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 54, in 
> _assert_exception
> assert_regexp_matches(str(e), matching)
>   File "/usr/lib/python2.7/unittest/case.py", line 1002, in 
> assertRegexpMatches
> raise self.failureException(msg)
> 'Regexp didn\'t match: "Aliases aren\'t allowed in the where clause" not 
> found in \'Error from server: code=2200 [Invalid query] message="Undefined 
> column name user_id"
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12482) dtest failure in upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x.select_with_alias_test

2016-08-17 Thread Philip Thompson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425238#comment-15425238
 ] 

Philip Thompson commented on CASSANDRA-12482:
-

It was a test bug comparing strings, of course. Fixing.

> dtest failure in 
> upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x.select_with_alias_test
> -
>
> Key: CASSANDRA-12482
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12482
> Project: Cassandra
>  Issue Type: Test
>Reporter: Sean McCarthy
>Assignee: Philip Thompson
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, 
> node2_debug.log, node2_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/trunk_dtest_upgrade/29/testReport/upgrade_tests.cql_tests/TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x/select_with_alias_test
> {code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line 
> 3184, in select_with_alias_test
> assert_invalid(cursor, 'SELECT id AS user_id, name AS user_name FROM 
> users WHERE user_id = 0', matching=error_msg)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 92, in 
> assert_invalid
> assert_exception(session, query, matching=matching, expected=expected)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 65, in 
> assert_exception
> _assert_exception(session.execute, query, matching=matching, 
> expected=expected)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 54, in 
> _assert_exception
> assert_regexp_matches(str(e), matching)
>   File "/usr/lib/python2.7/unittest/case.py", line 1002, in 
> assertRegexpMatches
> raise self.failureException(msg)
> 'Regexp didn\'t match: "Aliases aren\'t allowed in the where clause" not 
> found in \'Error from server: code=2200 [Invalid query] message="Undefined 
> column name user_id"
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12482) dtest failure in upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x.select_with_alias_test

2016-08-17 Thread Philip Thompson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425220#comment-15425220
 ] 

Philip Thompson commented on CASSANDRA-12482:
-

So the problem here is that we have a 3.7 node and a 3.10 node. When we query 
the 3.7 node, sometimes we get the 3.10 error? This is confusing, as Tyler says 
we should always get the error from the coordinator.

> dtest failure in 
> upgrade_tests.cql_tests.TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x.select_with_alias_test
> -
>
> Key: CASSANDRA-12482
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12482
> Project: Cassandra
>  Issue Type: Test
>Reporter: Sean McCarthy
>Assignee: Philip Thompson
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, 
> node2_debug.log, node2_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/trunk_dtest_upgrade/29/testReport/upgrade_tests.cql_tests/TestCQLNodes2RF1_Upgrade_current_3_x_To_indev_3_x/select_with_alias_test
> {code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line 
> 3184, in select_with_alias_test
> assert_invalid(cursor, 'SELECT id AS user_id, name AS user_name FROM 
> users WHERE user_id = 0', matching=error_msg)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 92, in 
> assert_invalid
> assert_exception(session, query, matching=matching, expected=expected)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 65, in 
> assert_exception
> _assert_exception(session.execute, query, matching=matching, 
> expected=expected)
>   File "/home/automaton/cassandra-dtest/assertions.py", line 54, in 
> _assert_exception
> assert_regexp_matches(str(e), matching)
>   File "/usr/lib/python2.7/unittest/case.py", line 1002, in 
> assertRegexpMatches
> raise self.failureException(msg)
> 'Regexp didn\'t match: "Aliases aren\'t allowed in the where clause" not 
> found in \'Error from server: code=2200 [Invalid query] message="Undefined 
> column name user_id"
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12385) Disk failure policy should not be invoked on out of space

2016-08-17 Thread sankalp kohli (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425179#comment-15425179
 ] 

sankalp kohli commented on CASSANDRA-12385:
---

We still want to throw an FSWriteError in case this is not in the compaction 
path so that disk failure policies are enforced. I also dont like message 
matching but I am not sure how else to fix it without significant refactor. 

> Disk failure policy should not be invoked on out of space
> -
>
> Key: CASSANDRA-12385
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12385
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: sankalp kohli
>Assignee: sankalp kohli
>Priority: Minor
> Attachments: CASSANDRA-12385_3.0.txt
>
>
> If a node fills up temporarily due to compaction the disk failure policy may 
> be invoked. We
> use stop, so the node will be disabled. This leaves the node down even though 
> it recovers from this
> failure by aborting the compaction.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (CASSANDRA-12314) dtest failure in nose.failure.Failure.runTest

2016-08-17 Thread Philip Thompson (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Philip Thompson resolved CASSANDRA-12314.
-
Resolution: Fixed

Stopped running those on 2.1, as discussed with Stefania

> dtest failure in nose.failure.Failure.runTest
> -
>
> Key: CASSANDRA-12314
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12314
> Project: Cassandra
>  Issue Type: Test
>Reporter: Sean McCarthy
>Assignee: Philip Thompson
>  Labels: dtest
>
> example failure:
> http://cassci.datastax.com/job/cassandra-2.1_cqlsh_tests/17/testReport/nose.failure/Failure/runTest
> {code}
> Stack Trace
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/usr/local/lib/python2.7/dist-packages/nose/loader.py", line 418, in 
> loadTestsFromName
> addr.filename, addr.module)
>   File "/usr/local/lib/python2.7/dist-packages/nose/importer.py", line 47, in 
> importFromPath
> return self.importFromDir(dir_path, fqname)
>   File "/usr/local/lib/python2.7/dist-packages/nose/importer.py", line 94, in 
> importFromDir
> mod = load_module(part_fqname, fh, filename, desc)
>   File "/home/automaton/cassandra/pylib/cqlshlib/test/__init__.py", line 17, 
> in 
> from .cassconnect import create_test_db, remove_test_db
>   File "/home/automaton/cassandra/pylib/cqlshlib/test/cassconnect.py", line 
> 22, in 
> from .basecase import cql, cqlsh, cqlshlog, TEST_HOST, TEST_PORT, rundir
>   File "/home/automaton/cassandra/pylib/cqlshlib/test/basecase.py", line 46, 
> in 
> import cqlsh
>   File "/home/automaton/cassandra/pylib/cqlshlib/test/cqlsh.py", line 109, in 
> 
> from cassandra.cluster import Cluster, PagedResult
> ImportError: cannot import name PagedResult
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-10993) Make read and write requests paths fully non-blocking, eliminate related stages

2016-08-17 Thread Jonathan Ellis (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425038#comment-15425038
 ] 

Jonathan Ellis commented on CASSANDRA-10993:


Isn't this a good example of a case where we can start with an off the shelf 
API (Rx, or Reactor) and optimize later?  Given that the approach won't change 
qualitatively, we can always refactor method names to a differently library 
easily enough.

If we have strong evidence that off the shelf is crap (and I think Tyler's 
tests show it's decent enough to be competitive with state machine, at least), 
AND that we know enough to build it "right," we could start doing that in 
parallel with the refactoring work to off-the-shelf.  But if we don't know 
enough yet, then imo that's again an indication that we should start with 
off-the-shelf.

Am I missing something?

> Make read and write requests paths fully non-blocking, eliminate related 
> stages
> ---
>
> Key: CASSANDRA-10993
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10993
> Project: Cassandra
>  Issue Type: Sub-task
>  Components: Coordination, Local Write-Read Paths
>Reporter: Aleksey Yeschenko
>Assignee: Tyler Hobbs
> Fix For: 3.x
>
> Attachments: 10993-reads-no-evloop-integration-six-node-stress.svg, 
> tpc-benchmarks-2.txt, tpc-benchmarks.txt
>
>
> Building on work done by [~tjake] (CASSANDRA-10528), [~slebresne] 
> (CASSANDRA-5239), and others, convert read and write request paths to be 
> fully non-blocking, to enable the eventual transition from SEDA to TPC 
> (CASSANDRA-10989)
> Eliminate {{MUTATION}}, {{COUNTER_MUTATION}}, {{VIEW_MUTATION}}, {{READ}}, 
> and {{READ_REPAIR}} stages, move read and write execution directly to Netty 
> context.
> For lack of decent async I/O options on Linux, we’ll still have to retain an 
> extra thread pool for serving read requests for data not residing in our page 
> cache (CASSANDRA-5863), however.
> Implementation-wise, we only have two options available to us: explicit FSMs 
> and chained futures. Fibers would be the third, and easiest option, but 
> aren’t feasible in Java without resorting to direct bytecode manipulation 
> (ourselves or using [quasar|https://github.com/puniverse/quasar]).
> I have seen 4 implementations bases on chained futures/promises now - three 
> in Java and one in C++ - and I’m not convinced that it’s the optimal (or 
> sane) choice for representing our complex logic - think 2i quorum read 
> requests with timeouts at all levels, read repair (blocking and 
> non-blocking), and speculative retries in the mix, {{SERIAL}} reads and 
> writes.
> I’m currently leaning towards an implementation based on explicit FSMs, and 
> intend to provide a prototype - soonish - for comparison with 
> {{CompletableFuture}}-like variants.
> Either way the transition is a relatively boring straightforward refactoring.
> There are, however, some extension points on both write and read paths that 
> we do not control:
> - authorisation implementations will have to be non-blocking. We have control 
> over built-in ones, but for any custom implementation we will have to execute 
> them in a separate thread pool
> - 2i hooks on the write path will need to be non-blocking
> - any trigger implementations will not be allowed to block
> - UDFs and UDAs
> We are further limited by API compatibility restrictions in the 3.x line, 
> forbidding us to alter, or add any non-{{default}} interface methods to those 
> extension points, so these pose a problem.
> Depending on logistics, expecting to get this done in time for 3.4 or 3.6 
> feature release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-12469) dtest failure in upgrade_tests.repair_test.TestUpgradeRepair.repair_after_upgrade_test

2016-08-17 Thread Philip Thompson (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425036#comment-15425036
 ] 

Philip Thompson commented on CASSANDRA-12469:
-

Trying again here: 
cassci.datastax.com/view/Parameterized/job/parameterized_dtest_multiplexer/256

> dtest failure in 
> upgrade_tests.repair_test.TestUpgradeRepair.repair_after_upgrade_test
> --
>
> Key: CASSANDRA-12469
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12469
> Project: Cassandra
>  Issue Type: Test
>Reporter: Craig Kodman
>Assignee: Philip Thompson
>  Labels: dtest
> Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, 
> node2_debug.log, node2_gc.log, node3.log, node3_debug.log, node3_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.9_dtest_upgrade/24/testReport/upgrade_tests.repair_test/TestUpgradeRepair/repair_after_upgrade_test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (CASSANDRA-12476) SyntaxException when COPY FROM Counter Table with Null value

2016-08-17 Thread Tyler Hobbs (JIRA) 

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tyler Hobbs updated CASSANDRA-12476:

 Labels: cqlsh  (was: )
Description: 
I have a simple counter table 

{noformat}
CREATE TABLE test (
a int PRIMARY KEY,
b counter,
c counter
) ;
{noformat}

I have updated b column value with 

{noformat}
UPDATE test SET b = b + 1 WHERE a = 1;
{noformat}

Now I have export the data with 

{noformat}
COPY test TO 'test.csv';
{noformat}

And Import it with 

{noformat}
COPY test FROM 'test.csv';
{noformat}

I get this Error

{noformat}
Failed to import 1 rows: SyntaxException - line 1:34 no viable alternative at 
input 'WHERE' (...=b+1,c=c+ [WHERE]...) -  will retry later, attempt 1 of 5
{noformat}

  was:
I have a simple counter table 

CREATE TABLE test (
a int PRIMARY KEY,
b counter,
c counter
) ;

I have updated b column value with 

UPDATE test SET b = b + 1 WHERE a = 1;

Now I have export the data with 

COPY test TO 'test.csv';

And Import it with 

COPY test FROM 'test.csv';

I get this Error

Failed to import 1 rows: SyntaxException - line 1:34 no viable alternative at 
input 'WHERE' (...=b+1,c=c+ [WHERE]...) -  will retry later, attempt 1 of 5


> SyntaxException when COPY FROM Counter Table with Null value
> 
>
> Key: CASSANDRA-12476
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12476
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tools
>Reporter: Ashraful Islam
>Priority: Minor
>  Labels: cqlsh
>
> I have a simple counter table 
> {noformat}
> CREATE TABLE test (
> a int PRIMARY KEY,
> b counter,
> c counter
> ) ;
> {noformat}
> I have updated b column value with 
> {noformat}
> UPDATE test SET b = b + 1 WHERE a = 1;
> {noformat}
> Now I have export the data with 
> {noformat}
> COPY test TO 'test.csv';
> {noformat}
> And Import it with 
> {noformat}
> COPY test FROM 'test.csv';
> {noformat}
> I get this Error
> {noformat}
> Failed to import 1 rows: SyntaxException - line 1:34 no viable alternative at 
> input 'WHERE' (...=b+1,c=c+ [WHERE]...) -  will retry later, attempt 1 of 5
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (CASSANDRA-10993) Make read and write requests paths fully non-blocking, eliminate related stages

2016-08-17 Thread Aleksey Yeschenko (JIRA) 

[ 
https://issues.apache.org/jira/browse/CASSANDRA-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425025#comment-15425025
 ] 

Aleksey Yeschenko commented on CASSANDRA-10993:
---

bq. Are you saying that you're okay with the Rx-style API, but would prefer to 
have our own version of it for more control?

Yes.

> Make read and write requests paths fully non-blocking, eliminate related 
> stages
> ---
>
> Key: CASSANDRA-10993
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10993
> Project: Cassandra
>  Issue Type: Sub-task
>  Components: Coordination, Local Write-Read Paths
>Reporter: Aleksey Yeschenko
>Assignee: Tyler Hobbs
> Fix For: 3.x
>
> Attachments: 10993-reads-no-evloop-integration-six-node-stress.svg, 
> tpc-benchmarks-2.txt, tpc-benchmarks.txt
>
>
> Building on work done by [~tjake] (CASSANDRA-10528), [~slebresne] 
> (CASSANDRA-5239), and others, convert read and write request paths to be 
> fully non-blocking, to enable the eventual transition from SEDA to TPC 
> (CASSANDRA-10989)
> Eliminate {{MUTATION}}, {{COUNTER_MUTATION}}, {{VIEW_MUTATION}}, {{READ}}, 
> and {{READ_REPAIR}} stages, move read and write execution directly to Netty 
> context.
> For lack of decent async I/O options on Linux, we’ll still have to retain an 
> extra thread pool for serving read requests for data not residing in our page 
> cache (CASSANDRA-5863), however.
> Implementation-wise, we only have two options available to us: explicit FSMs 
> and chained futures. Fibers would be the third, and easiest option, but 
> aren’t feasible in Java without resorting to direct bytecode manipulation 
> (ourselves or using [quasar|https://github.com/puniverse/quasar]).
> I have seen 4 implementations bases on chained futures/promises now - three 
> in Java and one in C++ - and I’m not convinced that it’s the optimal (or 
> sane) choice for representing our complex logic - think 2i quorum read 
> requests with timeouts at all levels, read repair (blocking and 
> non-blocking), and speculative retries in the mix, {{SERIAL}} reads and 
> writes.
> I’m currently leaning towards an implementation based on explicit FSMs, and 
> intend to provide a prototype - soonish - for comparison with 
> {{CompletableFuture}}-like variants.
> Either way the transition is a relatively boring straightforward refactoring.
> There are, however, some extension points on both write and read paths that 
> we do not control:
> - authorisation implementations will have to be non-blocking. We have control 
> over built-in ones, but for any custom implementation we will have to execute 
> them in a separate thread pool
> - 2i hooks on the write path will need to be non-blocking
> - any trigger implementations will not be allowed to block
> - UDFs and UDAs
> We are further limited by API compatibility restrictions in the 3.x line, 
> forbidding us to alter, or add any non-{{default}} interface methods to those 
> extension points, so these pose a problem.
> Depending on logistics, expecting to get this done in time for 3.4 or 3.6 
> feature release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

  1   2   >