[jira] [Commented] (CASSANDRA-13413) Run more test targets on CircleCI

2017-04-05 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957245#comment-15957245
 ] 

Michael Shuler commented on CASSANDRA-13413:


I was working on multiple runners and fixing a broken test in CASSANDRA-13414. 
It looks like we OOM the container with more than one runner, so since y'all 
are here, can you include this one-liner to fix 
o.a.c.utils.BitSetTest.compareBitSets?
{code}
diff --git a/circle.yml b/circle.yml
index f0df31265a..66e752f367 100644
--- a/circle.yml
+++ b/circle.yml
@@ -8,6 +8,7 @@ test:
 - sudo ifconfig lo:2 127.0.0.3 up
 - sudo ifconfig lo:3 127.0.0.4 up
 - sudo ifconfig lo:4 127.0.0.5 up
+- sudo apt-get update; sudo apt-get install wamerican
 - ant build
 
   override:
{code}

Since you're removing the pre: section, I'm not sure how to include that in the 
parallel bits, yet. Thanks!

> Run more test targets on CircleCI
> -
>
> Key: CASSANDRA-13413
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13413
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Marcus Eriksson
>Assignee: Marcus Eriksson
>
> Currently we only run {{ant test}} on circleci, we should use all the (free) 
> containers we have and run more targets in parallel.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list

2017-04-05 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13414:
---
Fix Version/s: (was: 4.0)
   4.x

> circle.yml: parallelize tests and install word list
> ---
>
> Key: CASSANDRA-13414
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13414
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Testing
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>Priority: Minor
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x
>
> Attachments: 
> 0001-Parallelize-tests-and-install-word-list-in-circleci.patch
>
>
> - Run 2 test runners, since circleci container has 2 vCPUs.
> - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later 
> branches when test word list is unavailable.
> I verified that compareBitSets passes again in a 2.1 run, and I have a trunk 
> test with 2 runners in progress. Will check run time, when that has completed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13414) circle.yml: parallelize tests and install word list

2017-04-05 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957110#comment-15957110
 ] 

Michael Shuler commented on CASSANDRA-13414:


My trunk test failed with 2 runners:
{noformat}
Failing command: ant test -Dtest.runners=2
Exit code: -1
Output:

   [junit] 
[junit] Testsuite: org.apache.cassandra.dht.RangeTest
[junit] Testsuite: org.apache.cassandra.dht.SplitterTest
[junit] Testsuite: org.apache.cassandra.dht.RangeTest Tests run: 28, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.559 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.dht.StreamStateStoreTest
[junit] Testsuite: org.apache.cassandra.dht.StreamStateStoreTest Tests run: 
1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.841 sec
[junit] 
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/commitlog:210
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/data:210
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/saved_caches:210
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/hints:210
[junit] Testsuite: org.apache.cassandra.gms.ArrayBackedBoundedStatsTest
[junit] Testsuite: org.apache.cassandra.gms.ArrayBackedBoundedStatsTest 
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.351 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.dht.SplitterTest Tests run: 4, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.766 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.ArrivalWindowTest
[junit] Testsuite: org.apache.cassandra.gms.ArrivalWindowTest Tests run: 1, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.939 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.EndpointStateTest
[junit] Testsuite: org.apache.cassandra.gms.FailureDetectorTest
[junit] Testsuite: org.apache.cassandra.gms.FailureDetectorTest Tests run: 
1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.804 sec
[junit] 
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/commitlog:214
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/data:214
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/saved_caches:214
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/hints:214
[junit] Testsuite: org.apache.cassandra.gms.EndpointStateTest Tests run: 2, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.87 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.GossipDigestTest
[junit] Testsuite: org.apache.cassandra.gms.GossipDigestTest Tests run: 1, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.378 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.gms.PendingRangeCalculatorServiceTest
[junit] Testsuite: org.apache.cassandra.gms.GossiperTest
[junit] Testsuite: org.apache.cassandra.gms.GossiperTest Tests run: 1, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.59 sec
[junit] 
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/commitlog:216
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/data:216
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/saved_caches:216
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/hints:216
[junit] Testsuite: org.apache.cassandra.gms.SerializationsTest
[junit] Testsuite: org.apache.cassandra.gms.SerializationsTest Tests run: 
2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.865 sec
[junit] 
[junit] Testsuite: 
org.apache.cassandra.gms.PendingRangeCalculatorServiceTest Tests run: 1, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.558 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.gms.ShadowRoundTest
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/commitlog:217
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/data:217
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/saved_caches:217
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/hints:217
[junit] Testsuite: org.apache.cassandra.hints.ChecksummedDataInputTest
[junit] Testsuite: org.apache.cassandra.hints.ChecksummedDataInputTest 
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.175 sec
[junit] 
[junit] Testsuite: org.apache.cassandra.hints.HintMessageTest
[junit] Testsuite: org.apache.cassandra.gms.ShadowRoundTest Tests run: 1, 
Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.446 sec
[junit] 
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/commitlog:219
   [delete] Deleting directory 
/home/ubuntu/cassandra/build/test/cassandra/data:219
   [delete] Deleting directory 
/home/ub

[jira] [Comment Edited] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession

2017-04-05 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957104#comment-15957104
 ] 

Michael Shuler edited comment on CASSANDRA-13416 at 4/5/17 3:59 PM:


It looks like this was fixed in 
https://github.com/apache/cassandra/commit/633babf0f02fac56cad7bff03a4ff415feb38f39


was (Author: mshuler):
I looks like this was fixed in 
https://github.com/apache/cassandra/commit/633babf0f02fac56cad7bff03a4ff415feb38f39

> Multiple test failures with NPE in 
> org.apache.cassandra.streaming.StreamSession
> ---
>
> Key: CASSANDRA-13416
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13416
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>Priority: Critical
>  Labels: test-failure
> Attachments: jenkins-trunk_testall-1491_logs.tar.gz
>
>
> example failures:
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression
> one example stack trace:
> {code}
> Stacktrace
> java.lang.NullPointerException
>   at 
> org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244)
>   at 
> org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196)
>   at 
> org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293)
>   at 
> org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158)
>   at 
> org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94)
>   at 
> org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85)
>   at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75)
>   at 
> org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession

2017-04-05 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler resolved CASSANDRA-13416.

Resolution: Fixed

I looks like this was fixed in 
https://github.com/apache/cassandra/commit/633babf0f02fac56cad7bff03a4ff415feb38f39

> Multiple test failures with NPE in 
> org.apache.cassandra.streaming.StreamSession
> ---
>
> Key: CASSANDRA-13416
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13416
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>Priority: Critical
>  Labels: test-failure
> Attachments: jenkins-trunk_testall-1491_logs.tar.gz
>
>
> example failures:
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression
> one example stack trace:
> {code}
> Stacktrace
> java.lang.NullPointerException
>   at 
> org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244)
>   at 
> org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196)
>   at 
> org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293)
>   at 
> org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158)
>   at 
> org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94)
>   at 
> org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85)
>   at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75)
>   at 
> org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession

2017-04-05 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler reassigned CASSANDRA-13416:
--

Assignee: Michael Shuler

> Multiple test failures with NPE in 
> org.apache.cassandra.streaming.StreamSession
> ---
>
> Key: CASSANDRA-13416
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13416
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>Priority: Critical
>  Labels: test-failure
> Attachments: jenkins-trunk_testall-1491_logs.tar.gz
>
>
> example failures:
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression
> http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression
> one example stack trace:
> {code}
> Stacktrace
> java.lang.NullPointerException
>   at 
> org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244)
>   at 
> org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196)
>   at 
> org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293)
>   at 
> org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158)
>   at 
> org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94)
>   at 
> org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85)
>   at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75)
>   at 
> org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession

2017-04-05 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13416:
--

 Summary: Multiple test failures with NPE in 
org.apache.cassandra.streaming.StreamSession
 Key: CASSANDRA-13416
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13416
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
Priority: Critical
 Attachments: jenkins-trunk_testall-1491_logs.tar.gz

example failures:

http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression
http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression

one example stack trace:
{code}
Stacktrace

java.lang.NullPointerException
at 
org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244)
at 
org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196)
at 
org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293)
at 
org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158)
at 
org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94)
at 
org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85)
at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75)
at 
org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13415) test failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.getNextBackgroundTask-compression

2017-04-05 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13415:
--

 Summary: test failure in 
org.apache.cassandra.db.compaction.PendingRepairManagerTest.getNextBackgroundTask-compression
 Key: CASSANDRA-13415
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13415
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: 
TEST-org.apache.cassandra.db.compaction.PendingRepairManagerTest.log

example failure:

http://cassci.datastax.com/job/trunk_testall/1490/testReport/org.apache.cassandra.db.compaction/PendingRepairManagerTest/getNextBackgroundTask_compression

{code}
Stacktrace

junit.framework.AssertionFailedError
at 
org.apache.cassandra.db.compaction.PendingRepairManagerTest.getNextBackgroundTask(PendingRepairManagerTest.java:155)
Standard Output

ERROR [main] 2017-04-03 20:02:09,109 SubstituteLogger.java:250 - SLF4J: stderr
INFO  [main] 2017-04-03 20:02:09,474 YamlConfigurationLoader.java:89 - 
Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-04-03 20:02:09,477 YamlConfigurationLoader.java:108 - Loading 
settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml
INFO  [main] 2017-04-03 20:02:11,007 Config.java:454 - Node 
configuration:[allocate_tokens_for_keyspace=null; authentica
...[truncated 84651 chars]...
 position=21545)
DEBUG [MemtableFlushWriter:2] 2017-04-03 20:02:19,371 
ColumnFamilyStore.java:1226 - Flushed to 
[BigTableReader(path='/home/automaton/cassandra/build/test/cassandra/data:165/ks_1491249739206/tbl-7145c66018a811e7b0c3bf9fab0791de/na-1-big-Data.db')]
 (1 sstables, 4.760KiB), biggest 4.760KiB, smallest 4.760KiB
DEBUG [main] 2017-04-03 20:02:19,374 PendingRepairManager.java:101 - Creating 
ks_1491249739206.tbl compaction strategy for pending repair: 
715a11b0-18a8-11e7-b0c3-bf9fab0791de
{code}

possibly related to CASSANDRA-13224



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list

2017-04-05 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13414:
---
Component/s: Testing

> circle.yml: parallelize tests and install word list
> ---
>
> Key: CASSANDRA-13414
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13414
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Testing
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>Priority: Minor
> Fix For: 4.0, 2.1.x, 2.2.x, 3.0.x, 3.11.x
>
> Attachments: 
> 0001-Parallelize-tests-and-install-word-list-in-circleci.patch
>
>
> - Run 2 test runners, since circleci container has 2 vCPUs.
> - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later 
> branches when test word list is unavailable.
> I verified that compareBitSets passes again in a 2.1 run, and I have a trunk 
> test with 2 runners in progress. Will check run time, when that has completed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list

2017-04-05 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13414:
---
Fix Version/s: 3.11.x
   3.0.x
   2.2.x
   2.1.x
   4.0

> circle.yml: parallelize tests and install word list
> ---
>
> Key: CASSANDRA-13414
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13414
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>Priority: Minor
> Fix For: 4.0, 2.1.x, 2.2.x, 3.0.x, 3.11.x
>
> Attachments: 
> 0001-Parallelize-tests-and-install-word-list-in-circleci.patch
>
>
> - Run 2 test runners, since circleci container has 2 vCPUs.
> - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later 
> branches when test word list is unavailable.
> I verified that compareBitSets passes again in a 2.1 run, and I have a trunk 
> test with 2 runners in progress. Will check run time, when that has completed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list

2017-04-05 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13414:
---
Attachment: 0001-Parallelize-tests-and-install-word-list-in-circleci.patch

> circle.yml: parallelize tests and install word list
> ---
>
> Key: CASSANDRA-13414
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13414
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>Priority: Minor
> Attachments: 
> 0001-Parallelize-tests-and-install-word-list-in-circleci.patch
>
>
> - Run 2 test runners, since circleci container has 2 vCPUs.
> - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later 
> branches when test word list is unavailable.
> I verified that compareBitSets passes again in a 2.1 run, and I have a trunk 
> test with 2 runners in progress. Will check run time, when that has completed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13414) circle.yml: parallelize tests and install word list

2017-04-05 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13414:
--

 Summary: circle.yml: parallelize tests and install word list
 Key: CASSANDRA-13414
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13414
 Project: Cassandra
  Issue Type: Improvement
Reporter: Michael Shuler
Assignee: Michael Shuler
Priority: Minor


- Run 2 test runners, since circleci container has 2 vCPUs.
- o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later 
branches when test word list is unavailable.

I verified that compareBitSets passes again in a 2.1 run, and I have a trunk 
test with 2 runners in progress. Will check run time, when that has completed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13394) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_0_x.bootstrap_multidc_test

2017-03-30 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13394:
--

 Summary: test failure in 
upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_0_x.bootstrap_multidc_test
 Key: CASSANDRA-13394
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13394
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log, 
node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, 
node3.log, node4_debug.log, node4_gc.log, node4.log

example failure:

http://cassci.datastax.com/job/cassandra-3.0_large_dtest/60/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_1_x_To_indev_3_0_x/bootstrap_multidc_test

{code}
Error Message

errors={: ReadTimeout('Error from server: code=1200 
[Coordinator node timed out waiting for replica nodes\' responses] 
message="Operation timed out - received only 2 responses." 
info={\'received_responses\': 2, \'required_responses\': 3, \'consistency\': 
\'ALL\'}',)}, last_host=127.0.0.2
{code}
{code}
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 716, in bootstrap_multidc_test
self.upgrade_scenario(populate=False, create_schema=False, 
after_upgrade_call=(self._bootstrap_new_node_multidc,))
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 370, in upgrade_scenario
self._check_values()
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 508, in _check_values
result = session.execute(query)
  File "/home/automaton/venv/src/cassandra-driver/cassandra/cluster.py", line 
2012, in execute
return self.execute_async(query, parameters, trace, custom_payload, 
timeout, execution_profile, paging_state).result()
  File "/home/automaton/venv/src/cassandra-driver/cassandra/cluster.py", line 
3801, in result
raise self._final_exception
'errors={: ReadTimeout(\'Error from server: code=1200 
[Coordinator node timed out waiting for replica nodes\\\' responses] 
message="Operation timed out - received only 2 responses." 
info={\\\'received_responses\\\': 2, \\\'required_responses\\\': 3, 
\\\'consistency\\\': \\\'ALL\\\'}\',)}, last_host=127.0.0.2
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13216) testall failure in org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages

2017-03-28 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13216:
---
Attachment: TEST-org.apache.cassandra.net.MessagingServiceTest.log

new log from above attached

> testall failure in 
> org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages
> 
>
> Key: CASSANDRA-13216
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13216
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Alex Petrov
>  Labels: test-failure, testall
> Fix For: 3.0.13, 3.11.0, 4.0
>
> Attachments: TEST-org.apache.cassandra.net.MessagingServiceTest.log, 
> TEST-org.apache.cassandra.net.MessagingServiceTest.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.11_testall/81/testReport/org.apache.cassandra.net/MessagingServiceTest/testDroppedMessages
> {code}
> Error Message
> expected:<... dropped latency: 27[30 ms and Mean cross-node dropped latency: 
> 2731] ms> but was:<... dropped latency: 27[28 ms and Mean cross-node dropped 
> latency: 2730] ms>
> {code}{code}
> Stacktrace
> junit.framework.AssertionFailedError: expected:<... dropped latency: 27[30 ms 
> and Mean cross-node dropped latency: 2731] ms> but was:<... dropped latency: 
> 27[28 ms and Mean cross-node dropped latency: 2730] ms>
>   at 
> org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages(MessagingServiceTest.java:83)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Reopened] (CASSANDRA-13216) testall failure in org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages

2017-03-28 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler reopened CASSANDRA-13216:


Reopening, since this was so recent. Trunk run that just finished recently 
shows a similar error on
http://cassci.datastax.com/job/trunk_testall/1477/testReport/org.apache.cassandra.net/MessagingServiceTest/testDroppedMessages_compression/

{noformat}
Error Message

expected:<...dropped latency: 227[8] ms> but was:<...dropped latency: 227[7] ms>
Stacktrace

junit.framework.AssertionFailedError: expected:<...dropped latency: 227[8] ms> 
but was:<...dropped latency: 227[7] ms>
at 
org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages(MessagingServiceTest.java:114)
Standard Output

ERROR [main] 2017-03-28 11:07:24,199 SubstituteLogger.java:250 - SLF4J: stderr
INFO  [main] 2017-03-28 11:07:24,668 YamlConfigurationLoader.java:89 - 
Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-03-28 11:07:24,669 YamlConfigurationLoader.java:108 - Loading 
settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml
INFO  [main] 2017-03-28 11:07:25,547 Config.java:446 - Node 
configuration:[allocate_tokens_for_keyspace=null; authentica
...[truncated 10545 chars]...
close for /127.0.0.250
DEBUG [main] 2017-03-28 11:07:28,551 MessagingService.java:698 - Not resetting 
pool for /127.0.0.250 because internode authenticator said not to connect
DEBUG [main] 2017-03-28 11:07:28,583 OutboundTcpConnection.java:184 - Enqueuing 
socket close for /127.0.0.2
DEBUG [main] 2017-03-28 11:07:28,583 OutboundTcpConnection.java:184 - Enqueuing 
socket close for /127.0.0.2
DEBUG [main] 2017-03-28 11:07:28,584 OutboundTcpConnection.java:184 - Enqueuing 
socket close for /127.0.0.2
{noformat}

> testall failure in 
> org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages
> 
>
> Key: CASSANDRA-13216
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13216
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Alex Petrov
>  Labels: test-failure, testall
> Fix For: 3.0.13, 3.11.0, 4.0
>
> Attachments: TEST-org.apache.cassandra.net.MessagingServiceTest.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.11_testall/81/testReport/org.apache.cassandra.net/MessagingServiceTest/testDroppedMessages
> {code}
> Error Message
> expected:<... dropped latency: 27[30 ms and Mean cross-node dropped latency: 
> 2731] ms> but was:<... dropped latency: 27[28 ms and Mean cross-node dropped 
> latency: 2730] ms>
> {code}{code}
> Stacktrace
> junit.framework.AssertionFailedError: expected:<... dropped latency: 27[30 ms 
> and Mean cross-node dropped latency: 2731] ms> but was:<... dropped latency: 
> 27[28 ms and Mean cross-node dropped latency: 2730] ms>
>   at 
> org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages(MessagingServiceTest.java:83)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13377) test failure in org.apache.cassandra.service.RemoveTest.testLocalHostId-compression

2017-03-24 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13377:
--

 Summary: test failure in 
org.apache.cassandra.service.RemoveTest.testLocalHostId-compression
 Key: CASSANDRA-13377
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13377
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: jenkins-cassandra-3.11_testall-124_logs.tar.gz

example failure:

http://cassci.datastax.com/job/cassandra-3.11_testall/124/testReport/org.apache.cassandra.service/RemoveTest/testLocalHostId_compression

{noformat}
Stacktrace

java.lang.NullPointerException
at org.apache.cassandra.gms.Gossiper.getHostId(Gossiper.java:881)
at org.apache.cassandra.gms.Gossiper.getHostId(Gossiper.java:876)
at 
org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:2275)
at 
org.apache.cassandra.service.StorageService.onChange(StorageService.java:1928)
at org.apache.cassandra.Util.createInitialRing(Util.java:222)
at org.apache.cassandra.service.RemoveTest.setup(RemoveTest.java:89)
Standard Output

ERROR [main] 2017-03-23 21:27:05,889 SubstituteLogger.java:250 - SLF4J: stderr
INFO  [main] 2017-03-23 21:27:06,238 YamlConfigurationLoader.java:89 - 
Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-03-23 21:27:06,241 YamlConfigurationLoader.java:108 - Loading 
settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml
INFO  [main] 2017-03-23 21:27:07,506 Config.java:475 - Node 
configuration:[allocate_tokens_for_keyspace=null; authentica
...[truncated 176636 chars]...
ain] 2017-03-23 21:27:16,054 YamlConfigurationLoader.java:108 - Loading 
settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-03-23 21:27:16,059 StorageService.java:2171 - Node /127.0.0.5 
state bootstrapping, token [31359799266797610263756179790339965311]
INFO  [main] 2017-03-23 21:27:16,059 StorageService.java:2184 - Node /127.0.0.5 
state jump to bootstrap
INFO  [main] 2017-03-23 21:27:16,059 MessagingService.java:979 - Waiting for 
messaging service to quiesce
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13376) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test

2017-03-24 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13376:
--

 Summary: test failure in 
upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test
 Key: CASSANDRA-13376
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13376
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log, 
node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, 
node3.log

example failure:

http://cassci.datastax.com/job/cassandra-3.11_large_dtest/25/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_3_x_To_indev_3_x/rolling_upgrade_with_internode_ssl_test

{noformat}
Error Message

Ran out of time waiting for queue size (1) to be 'le' to 0. Aborting.

Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 291, in rolling_upgrade_with_internode_ssl_test
self.upgrade_scenario(rolling=True, internode_ssl=True)
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 356, in upgrade_scenario
self._wait_until_queue_condition('writes pending verification', 
verification_queue, operator.le, 0, max_wait_s=1200)
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 541, in _wait_until_queue_condition
raise RuntimeError("Ran out of time waiting for queue size ({}) to be '{}' 
to {}. Aborting.".format(qsize, opfunc.__name__, required_len))
"Ran out of time waiting for queue size (1) to be 'le' to 0. Aborting.
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-03-20 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932785#comment-15932785
 ] 

Michael Shuler commented on CASSANDRA-13230:


Luke, see CASSANDRA-13252

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0
>
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12967) Spec for Cassandra RPM Build

2017-03-20 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932778#comment-15932778
 ] 

Michael Shuler commented on CASSANDRA-12967:


{{cqlsh}} requires python-2.7. If that can be satisfied by a savvy user prior 
to installation, so the dependency is met, then installation should work. I've 
tried using "supported" third-party python-2.7 packages from SCL on 
CentOS-6.something and it can be excruciatingly painful. My suggestion would be 
to just use RHEL/CentOS-7.

> Spec for Cassandra RPM Build
> 
>
> Key: CASSANDRA-12967
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12967
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Bhuvan Rawal
>Assignee: Michael Shuler
> Fix For: 2.1.17, 2.2.9, 3.0.11, 3.10, 4.0
>
>
> Currently there is no RPM packaging for cassandra community. We tried 
> creating a RPM build for cassandra 3.0.9 using cassandra spec found in 
> https://github.com/riptano/cassandra-rpm, but we found some incompatibilities 
> as the spec was meant for 2.X versions. 
> It would be great to have a community RPM build for cassandra, with the 
> recommended cassandra recommendations and tools.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-12748) Cassandra fails to start up if GREP_COLOR is set

2017-03-20 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932768#comment-15932768
 ] 

Michael Shuler commented on CASSANDRA-12748:


Unsetting {{GREP_COLOR}} seems like a reasonable fix. Thanks!

> Cassandra fails to start up if GREP_COLOR is set
> 
>
> Key: CASSANDRA-12748
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12748
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Benjamin Roth
>Priority: Minor
>
> If env var GREP_COLOR is set, CS fails to start as startup command then 
> contains ANSI codes.
> See cassandra-env.sh when JVM_OPTS_FILE is parsed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-12748) Cassandra fails to start up if GREP_COLOR is set

2017-03-20 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-12748:
---
Summary: Cassandra fails to start up if GREP_COLOR is set  (was: CS fails 
to start up if GREP_COLOR is set)

> Cassandra fails to start up if GREP_COLOR is set
> 
>
> Key: CASSANDRA-12748
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12748
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Benjamin Roth
>Priority: Minor
>
> If env var GREP_COLOR is set, CS fails to start as startup command then 
> contains ANSI codes.
> See cassandra-env.sh when JVM_OPTS_FILE is parsed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13269) Snapshot support for custom secondary indices

2017-03-10 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13269:
---
Fix Version/s: (was: 3.0.12)
   (was: 3.11.0)
   3.11.x
   3.0.x

> Snapshot support for custom secondary indices
> -
>
> Key: CASSANDRA-13269
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13269
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Reporter: vincent royer
>Priority: Trivial
>  Labels: features
> Fix For: 3.0.x, 3.11.x
>
> Attachments: 0001-CASSANDRA-13269-custom-indices-snapshot.patch
>
>
> Enhance the index API to support snapshot of custom secondary indices.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13270) Add function hooks to deliver Elasticsearch as a Cassandra plugin

2017-03-10 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13270:
---
Fix Version/s: (was: 3.0.12)
   (was: 3.11.0)
   4.x

> Add function hooks to deliver Elasticsearch as a Cassandra plugin
> -
>
> Key: CASSANDRA-13270
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13270
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Reporter: vincent royer
>Priority: Minor
>  Labels: features
> Fix For: 4.x
>
> Attachments: 0001-CASSANDRA-13270-elasticsearch-as-a-plugin.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> With these basic modifications (see the patch) and the following tickets, the 
> Elassandra project (see https://github.com/strapdata/elassandra) could be an 
> Elasticsearch plugin for Cassandra.
> * CASSANDRA-12837 Add multi-threaded support to nodetool rebuild_index.
> * CASSANDRA-13267 Add CQL functions.
> * CASSANDRA-13268 Allow to create custom secondary index on static columns.
> * CASSANDRA-13269 Snapshot support for custom secondary indices



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13294) Possible data loss on upgrade 2.1 - 3.0

2017-03-06 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898736#comment-15898736
 ] 

Michael Shuler commented on CASSANDRA-13294:


Thanks all! I started all the cassandra-3.0 branch tests on commit {{1ba68a1}} 
and will check on them in the morning for a look at a release.

> Possible data loss on upgrade 2.1 - 3.0
> ---
>
> Key: CASSANDRA-13294
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13294
> Project: Cassandra
>  Issue Type: Bug
>  Components: Local Write-Read Paths
>Reporter: Marcus Eriksson
>Assignee: Stefania
>Priority: Blocker
> Fix For: 3.0.12, 3.11.0
>
>
> After finishing a compaction we delete the compacted away files. This is done 
> [here|https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/db/lifecycle/LogFile.java#L328-L337]
>  which uses 
> [this|https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/db/lifecycle/LogRecord.java#L265-L271]
>  to get the files - we get all files starting with {{absoluteFilePath}}. 
> Absolute file path is generated 
> [here|https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/io/sstable/Descriptor.java#L142-L153].
>  For 3.0 version files the filename looks like this: 
> {{/blabla/keyspace1/standard1-bdb031c0ff7b11e6940fdd0479dd8912/mc-1332-big}} 
> but for 2.1 version files, they look like this: 
> {{/blabla/keyspace1/standard1-bdb031c0ff7b11e6940fdd0479dd8912/keyspace1-standard1-ka-2}}.
> The problem is then that if we were to finish a compaction including the 
> legacy file, we would actually delete all legacy files having a generation 
> starting with '2'



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13090) Coalescing strategy sleeps too much

2017-03-03 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13090:
---
Fix Version/s: (was: 3.0.11)
   3.0.12

> Coalescing strategy sleeps too much
> ---
>
> Key: CASSANDRA-13090
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13090
> Project: Cassandra
>  Issue Type: Bug
>  Components: Streaming and Messaging
>Reporter: Corentin Chary
>Assignee: Corentin Chary
> Fix For: 2.2.10, 3.0.12, 3.11.0, 4.0
>
> Attachments: 0001-Fix-wait-time-coalescing-CASSANDRA-13090-2.patch, 
> 0001-Fix-wait-time-coalescing-CASSANDRA-13090.patch
>
>
> With the current code maybeSleep is called even if we managed to take 
> maxItems out of the backlog. In this case we should really avoid sleeping 
> because it means that backlog is building up.
> I'll send a patch shortly.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13296) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_0_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test

2017-03-03 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13296:
--

 Summary: test failure in 
upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_0_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test
 Key: CASSANDRA-13296
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13296
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log, 
node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, 
node3.log

example failure:

http://cassci.datastax.com/job/cassandra-3.11_large_dtest/22/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_3_0_x_To_indev_3_x/rolling_upgrade_with_internode_ssl_test

{code}
Error Message

Ran out of time waiting for queue size (1) to be 'le' to 0. Aborting.

Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 291, in rolling_upgrade_with_internode_ssl_test
self.upgrade_scenario(rolling=True, internode_ssl=True)
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 356, in upgrade_scenario
self._wait_until_queue_condition('writes pending verification', 
verification_queue, operator.le, 0, max_wait_s=1200)
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 541, in _wait_until_queue_condition
raise RuntimeError("Ran out of time waiting for queue size ({}) to be '{}' 
to {}. Aborting.".format(qsize, opfunc.__name__, required_len))
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13295) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_x.bootstrap_test

2017-03-03 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13295:
--

 Summary: test failure in 
upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_x.bootstrap_test
 Key: CASSANDRA-13295
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13295
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log, 
node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, 
node3.log, node4_debug.log, node4_gc.log, node4.log

example failure:

http://cassci.datastax.com/job/cassandra-3.11_large_dtest/22/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_1_x_To_indev_3_x/bootstrap_test

{code}
Error Message

03 Mar 2017 12:58:17 [node2] Missing: ['127.0.0.4.* now UP']:
INFO  [HANDSHAKE-/127.0.0.4] 2017-03-03 12:54:12,1.
See system.log for remainder

Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 700, in bootstrap_test
self.upgrade_scenario(after_upgrade_call=(self._bootstrap_new_node,))
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 376, in upgrade_scenario
call()
  File 
"/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py",
 line 681, in _bootstrap_new_node
nnode.start(use_jna=True, wait_other_notice=240, wait_for_binary_proto=True)
  File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", 
line 686, in start
node.watch_log_for_alive(self, from_mark=mark, timeout=wait_other_notice)
  File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", 
line 503, in watch_log_for_alive
self.watch_log_for(tofind, from_mark=from_mark, timeout=timeout, 
filename=filename)
  File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", 
line 471, in watch_log_for
raise TimeoutError(time.strftime("%d %b %Y %H:%M:%S", time.gmtime()) + " [" 
+ self.name + "] Missing: " + str([e.pattern for e in tofind]) + ":\n" + 
reads[:50] + ".\nSee {} for remainder".format(filename))
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13278) Update build.xml and build.properties.default maven repos

2017-03-01 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890669#comment-15890669
 ] 

Michael Shuler commented on CASSANDRA-13278:


+1
Thanks!

> Update build.xml and build.properties.default maven repos
> -
>
> Key: CASSANDRA-13278
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13278
> Project: Cassandra
>  Issue Type: Bug
>  Components: Build
>Reporter: Michael Shuler
>Assignee: Robert Stupp
>Priority: Minor
>  Labels: lhf
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x
>
>
> Only 2 of the 5 urls in build.properties.default are currently valid.
> java.net2, jclouds, and oauth urls all 404.
> {noformat}
> $ git grep remoteRepository
> build.properties.default:artifact.remoteRepository.central: 
> http://repo1.maven.org/maven2
> build.properties.default:artifact.remoteRepository.java.net2:   
> http://download.java.net/maven/2
> build.properties.default:artifact.remoteRepository.apache:  
> https://repository.apache.org/content/repositories/releases
> build.properties.default:artifact.remoteRepository.jclouds: 
> http://jclouds.googlecode.com/svn/repo
> build.properties.default:artifact.remoteRepository.oauth:   
> http://oauth.googlecode.com/svn/code/maven
> build.xml:   url="${artifact.remoteRepository.central}"/>
> build.xml:   url="${artifact.remoteRepository.java.net2}"/>
> build.xml:   url="${artifact.remoteRepository.apache}"/>
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:
> build.xml:
> build.xml:
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13278) Update build.xml and build.properties.default maven repos

2017-02-27 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13278:
---
Labels: lhf  (was: )

> Update build.xml and build.properties.default maven repos
> -
>
> Key: CASSANDRA-13278
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13278
> Project: Cassandra
>  Issue Type: Bug
>  Components: Build
>Reporter: Michael Shuler
>Priority: Minor
>  Labels: lhf
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x
>
>
> Only 2 of the 5 urls in build.properties.default are currently valid.
> java.net2, jclouds, and oauth urls all 404.
> {noformat}
> $ git grep remoteRepository
> build.properties.default:artifact.remoteRepository.central: 
> http://repo1.maven.org/maven2
> build.properties.default:artifact.remoteRepository.java.net2:   
> http://download.java.net/maven/2
> build.properties.default:artifact.remoteRepository.apache:  
> https://repository.apache.org/content/repositories/releases
> build.properties.default:artifact.remoteRepository.jclouds: 
> http://jclouds.googlecode.com/svn/repo
> build.properties.default:artifact.remoteRepository.oauth:   
> http://oauth.googlecode.com/svn/code/maven
> build.xml:   url="${artifact.remoteRepository.central}"/>
> build.xml:   url="${artifact.remoteRepository.java.net2}"/>
> build.xml:   url="${artifact.remoteRepository.apache}"/>
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:  
> build.xml:
> build.xml:
> build.xml:
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13278) Update build.xml and build.properties.default maven repos

2017-02-27 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13278:
--

 Summary: Update build.xml and build.properties.default maven repos
 Key: CASSANDRA-13278
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13278
 Project: Cassandra
  Issue Type: Bug
  Components: Build
Reporter: Michael Shuler
Priority: Minor
 Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x


Only 2 of the 5 urls in build.properties.default are currently valid.

java.net2, jclouds, and oauth urls all 404.

{noformat}
$ git grep remoteRepository
build.properties.default:artifact.remoteRepository.central: 
http://repo1.maven.org/maven2
build.properties.default:artifact.remoteRepository.java.net2:   
http://download.java.net/maven/2
build.properties.default:artifact.remoteRepository.apache:  
https://repository.apache.org/content/repositories/releases
build.properties.default:artifact.remoteRepository.jclouds: 
http://jclouds.googlecode.com/svn/repo
build.properties.default:artifact.remoteRepository.oauth:   
http://oauth.googlecode.com/svn/code/maven
build.xml:  
build.xml:  
build.xml:  
build.xml:  
build.xml:  
build.xml:  
build.xml:  
build.xml:  
build.xml:  
build.xml:  
build.xml:
build.xml:
build.xml:
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13090) Coalescing strategy sleeps too much

2017-02-27 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886058#comment-15886058
 ] 

Michael Shuler commented on CASSANDRA-13090:


The CHANGE.txt entry for this ticket is under the incorrect releases in the 
cassandra-2.2, cassandra-3.0, cassandra-3.11, and trunk branches. This was 
committed during release votes were -tentative tagged.  The JIRA fix versions 
for 2.2.x and 3.0.x should be corrected, as well, since this commit should be 
listed in CHANGES.txt under:
- 2.2.10 (currently under 2.2.9)
- 3.0.12 (currently under 3.0.11)
- 3.11.0 (currently under 3.10 in both cassandra-3.11 and trunk branches 
CHANGES.txt)

> Coalescing strategy sleeps too much
> ---
>
> Key: CASSANDRA-13090
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13090
> Project: Cassandra
>  Issue Type: Bug
>  Components: Streaming and Messaging
>Reporter: Corentin Chary
>Assignee: Corentin Chary
> Fix For: 2.2.9, 3.0.11, 3.11.0, 4.0
>
> Attachments: 0001-Fix-wait-time-coalescing-CASSANDRA-13090-2.patch, 
> 0001-Fix-wait-time-coalescing-CASSANDRA-13090.patch
>
>
> With the current code maybeSleep is called even if we managed to take 
> maxItems out of the backlog. In this case we should really avoid sleeping 
> because it means that backlog is building up.
> I'll send a patch shortly.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-6246) EPaxos

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-6246:
--
Fix Version/s: (was: 3.11.x)
   4.x

> EPaxos
> --
>
> Key: CASSANDRA-6246
> URL: https://issues.apache.org/jira/browse/CASSANDRA-6246
> Project: Cassandra
>  Issue Type: Improvement
>Reporter: Jonathan Ellis
>Assignee: Blake Eggleston
>  Labels: messaging-service-bump-required
> Fix For: 4.x
>
>
> One reason we haven't optimized our Paxos implementation with Multi-paxos is 
> that Multi-paxos requires leader election and hence, a period of 
> unavailability when the leader dies.
> EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, 
> (2) is particularly useful across multiple datacenters, and (3) allows any 
> node to act as coordinator: 
> http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf
> However, there is substantial additional complexity involved if we choose to 
> implement it.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879599#comment-15879599
 ] 

Michael Shuler commented on CASSANDRA-13230:


That is an excellent question. I'm not entirely sure, since this is not in the 
cassandra repo, but in cassandra-builds. Once things are worked out for 
inclusion, I see no reason we can't build for all the releases 2.1+ that we're 
still committing to, so I'll add all those current versions. Thanks!

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0
>
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13230:
---
Fix Version/s: 4.0
   3.11.0
   3.0.12
   2.2.10
   2.1.18

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0
>
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13230:
---
Resolution: Fixed
Status: Resolved  (was: Ready to Commit)

I committed a couple fixes and we have packages! I really appreciate your help. 
Going to call this ticket done and we can work on CASSANDRA-13252 for inclusion.
{code}
(master)mshuler@hana:~/git/cassandra-builds$ ls -l dist/
total 324980
-rw-r--r-- 1 mshuler mshuler  27039356 Feb 22 10:49 cassandra-4.0-1.noarch.rpm
-rw-r--r-- 1 mshuler mshuler  30471871 Feb 22 10:49 cassandra-4.0-1.src.rpm
-rw-r--r-- 1 mshuler mshuler  5268 Feb 22 10:49 
cassandra-tools-4.0-1.noarch.rpm
-rw-r--r-- 1 mshuler mshuler  4584 Feb 22 10:50 cassandra-tools_4.0_all.deb
-rw-r--r-- 1 mshuler mshuler   903 Feb 22 10:50 cassandra_4.0.dsc
-rw-r--r-- 1 mshuler mshuler 248183858 Feb 22 10:50 cassandra_4.0.tar.gz
-rw-r--r-- 1 mshuler mshuler  27043084 Feb 22 10:50 cassandra_4.0_all.deb
-rw-r--r-- 1 mshuler mshuler  1493 Feb 22 10:50 cassandra_4.0_amd64.changes
{code}

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13230:
---
Status: Ready to Commit  (was: Patch Available)

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13252) Include RPM packages in releases

2017-02-22 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13252:
--

 Summary: Include RPM packages in releases
 Key: CASSANDRA-13252
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13252
 Project: Cassandra
  Issue Type: New Feature
  Components: Packaging
Reporter: Michael Shuler
Assignee: Michael Shuler


CASSANDRA-13230 sets up docker builds for deb and rpm packages out of the 
{{cassandra-builds}} git repo. We should now be able to do builds in CI, at 
least for build testing of snapshot packages.

In order to include in releases, we may wish to set up bintray for RPMs in a 
{{redhat/}} dir, similar to the current {{debian/}} dir redirect from 
cassandra-dist, or start with direct downloads from cassandra-dist and see how 
it goes.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-02-22 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878418#comment-15878418
 ] 

Michael Shuler commented on CASSANDRA-13230:


Great, thanks! Committed to master. I'll do a trial run and then see if we can 
get builds working right in CI. Much appreciated.

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
> Attachments: 13230.patch
>
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-02-17 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872023#comment-15872023
 ] 

Michael Shuler commented on CASSANDRA-13230:


Historical precedent :)  I'm not sure of the possible differences between 
Oracle and OpenJDK javac bytecode, but will ask around. Using OpenJDK does make 
build dependency install much simpler and maintainable in the long run, so I'm 
happy to give it a shot.

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release

2017-02-17 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871937#comment-15871937
 ] 

Michael Shuler commented on CASSANDRA-13230:


Sounds great! Those scripts were only a start on what dependencies needed to be 
installed to get through a build successfully and I never got back to them to 
work out a shared volume to drop the packages in when complete. Your suggestion 
is exactly what I was thinking.

> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>Assignee: Stefan Podkowinski
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release

2017-02-16 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13230:
---
Description: 
Currently, releases are built locally on Debian/Ubuntu based machines, without 
native support for building RPM packages. This can be done with a docker image.

The current cassandra-release scripts are here (please, do not randomly run and 
push tags..):
https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
A couple incomplete docker run scripts are here:
https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip

{code}
git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
{code}

Patches for build infra improvements are welcome!
/cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
review :)

  was:
Currently, releases are built locally on Debian/Ubuntu based machines, without 
native support for building RPM packages. This can be done with a docker image.

The current cassandra-release scripts are here (please, do not randomly run and 
push tags..):
https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
A couple incomplete docker run scripts are here:
https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip

Patches for build infra improvements are welcome!
/cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
review :)


> Build RPM packages for release
> --
>
> Key: CASSANDRA-13230
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Packaging
>Reporter: Michael Shuler
>
> Currently, releases are built locally on Debian/Ubuntu based machines, 
> without native support for building RPM packages. This can be done with a 
> docker image.
> The current cassandra-release scripts are here (please, do not randomly run 
> and push tags..):
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
> A couple incomplete docker run scripts are here:
> https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip
> {code}
> git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git
> {code}
> Patches for build infra improvements are welcome!
> /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
> review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13230) Build RPM packages for release

2017-02-16 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13230:
--

 Summary: Build RPM packages for release
 Key: CASSANDRA-13230
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13230
 Project: Cassandra
  Issue Type: New Feature
  Components: Packaging
Reporter: Michael Shuler


Currently, releases are built locally on Debian/Ubuntu based machines, without 
native support for building RPM packages. This can be done with a docker image.

The current cassandra-release scripts are here (please, do not randomly run and 
push tags..):
https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release
A couple incomplete docker run scripts are here:
https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip

Patches for build infra improvements are welcome!
/cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to 
review :)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup

2017-02-15 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13211:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Commit {{cb090791c3d16011665f0f56afd66bbce2a0e40f}} pushed to cassandra-2.1 and 
up. Thanks!

> Use portable stderr for java error in startup
> -
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>Assignee: Michael Shuler
> Fix For: 2.1.17, 2.2.9, 3.0.11, 3.11.0, 4.0
>
> Attachments: 13211_use-portable-stderr.patch
>
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup

2017-02-15 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13211:
---
Fix Version/s: (was: 2.1.x)
   4.0
   3.11.0
   3.0.11
   2.2.9
   2.1.17

> Use portable stderr for java error in startup
> -
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>Assignee: Michael Shuler
> Fix For: 2.1.17, 2.2.9, 3.0.11, 3.11.0, 4.0
>
> Attachments: 13211_use-portable-stderr.patch
>
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-12837) Add multi-threaded support to nodetool rebuild_index

2017-02-15 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-12837:
---
Fix Version/s: (was: 2.2.9)
   4.x

> Add multi-threaded support to nodetool rebuild_index
> 
>
> Key: CASSANDRA-12837
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12837
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Core
>Reporter: vincent royer
>Priority: Minor
>  Labels: patch
> Fix For: 4.x
>
> Attachments: CASSANDRA-12837-2.2.9.txt
>
>
> Add multi-thread nodetool rebuild_index to improve performances.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13220) test failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_2_0_x_To_indev_2_1_x.ticket_5230_test

2017-02-14 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13220:
--

 Summary: test failure in 
upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_2_0_x_To_indev_2_1_x.ticket_5230_test
 Key: CASSANDRA-13220
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13220
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1.log, node2.log, node3.log

example failure:

http://cassci.datastax.com/job/cassandra-2.1_dtest_upgrade/21/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_2_0_x_To_indev_2_1_x/ticket_5230_test

{noformat}
Error Message

Unexpected error in log, see stdout
 >> begin captured logging << 
dtest: DEBUG: Upgrade test beginning, setting CASSANDRA_VERSION to 2.0.17, and 
jdk to 7. (Prior values will be restored after test).
dtest: DEBUG: Switching jdk to version 7 (JAVA_HOME is changing from 
/usr/lib/jvm/jdk1.8.0_51 to /usr/lib/jvm/jdk1.7.0_80)
dtest: DEBUG: cluster ccm directory: /tmp/dtest-NvCzEj
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
cassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster nodes
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
dtest: DEBUG: upgrading node1 to 
github:apache/a6237bf65a95d654b7e702e81fd0d353460d0c89
dtest: DEBUG: Switching jdk to version 8 (JAVA_HOME is changing from 
/usr/lib/jvm/jdk1.7.0_80 to /usr/lib/jvm/jdk1.8.0_51)
ccm: INFO: Fetching Cassandra updates...
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
dtest: DEBUG: Querying upgraded node
dtest: DEBUG: Querying old node
dtest: DEBUG: removing ccm cluster test at: /tmp/dtest-NvCzEj
dtest: DEBUG: clearing ssl stores from [/tmp/dtest-NvCzEj] directory
- >> end captured logging << -
{noformat}

{noformat}
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 358, in run
self.tearDown()
  File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_base.py", line 
219, in tearDown
super(UpgradeTester, self).tearDown()
  File "/home/automaton/cassandra-dtest/dtest.py", line 593, in tearDown
raise AssertionError('Unexpected error in log, see stdout')
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13219) Cassandra.yaml now unicode instead of ascii after 13090

2017-02-14 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13219:
---
Attachment: utf8-to-ascii_yaml.patch

> Cassandra.yaml now unicode instead of ascii after 13090
> ---
>
> Key: CASSANDRA-13219
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13219
> Project: Cassandra
>  Issue Type: Bug
>  Components: Configuration
>Reporter: Philip Thompson
>Assignee: Ariel Weisberg
>Priority: Minor
> Fix For: 2.2.9, 3.0.11, 3.11.0, 4.0
>
> Attachments: utf8-to-ascii_yaml.patch
>
>
> After CASSANDRA-13090, which was commit 
> 5725e2c422d21d8efe5ae3bc4389842939553650, cassandra.yaml now has unicode 
> characters, specifically 
> [0xe2|http://utf8-chartable.de/unicode-utf8-table.pl?start=8320&number=128&names=2&utf8=0x].
>  Previously, it was only ascii.
> This is an admittedly minor change, but it is breaking. It affects (at least) 
> a subset of python yaml parsing tools (which is a large number of tools that 
> use C*).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup

2017-02-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13211:
---
Status: Patch Available  (was: Open)

> Use portable stderr for java error in startup
> -
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>Assignee: Michael Shuler
> Fix For: 2.1.x
>
> Attachments: 13211_use-portable-stderr.patch
>
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup

2017-02-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13211:
---
Summary: Use portable stderr for java error in startup  (was: cassandra 
shell script uses bad approach to write "Unable to find java" error to stderr, 
causing real issue to be masked by a permission error if user has changed user 
since logging in)

> Use portable stderr for java error in startup
> -
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>Assignee: Michael Shuler
> Fix For: 2.1.x
>
> Attachments: 13211_use-portable-stderr.patch
>
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed us

2017-02-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13211:
---
Fix Version/s: 2.1.x

> cassandra shell script uses bad approach to write "Unable to find java" error 
> to stderr, causing real issue to be masked by a permission error if user has 
> changed user since logging in
> 
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>Assignee: Michael Shuler
> Fix For: 2.1.x
>
> Attachments: 13211_use-portable-stderr.patch
>
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed us

2017-02-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13211:
---
Attachment: 13211_use-portable-stderr.patch

cassandra-2.1-based patch attached. A test job will never hit this, since we 
set up java properly on test servers before doing any testing.

> cassandra shell script uses bad approach to write "Unable to find java" error 
> to stderr, causing real issue to be masked by a permission error if user has 
> changed user since logging in
> 
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>Assignee: Michael Shuler
> Attachments: 13211_use-portable-stderr.patch
>
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Assigned] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed u

2017-02-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler reassigned CASSANDRA-13211:
--

Assignee: Michael Shuler

> cassandra shell script uses bad approach to write "Unable to find java" error 
> to stderr, causing real issue to be masked by a permission error if user has 
> changed user since logging in
> 
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>Assignee: Michael Shuler
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Comment Edited] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has cha

2017-02-13 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864167#comment-15864167
 ] 

Michael Shuler edited comment on CASSANDRA-13211 at 2/13/17 6:36 PM:
-

I think this change to {{echo ... >&2}} would be fine and accomplishes the 
same. (When I move my /usr/bin/java out of the way, I get trapped earlier in 
the version check in cassandra-env.sh, since no java can be found)


was (Author: mshuler):
I think this change to {{ echo ... >&2}} would be fine and accomplishes the 
same. (When I move my /usr/bin/java out of the way, I get trapped earlier in 
the version check in cassandra-env.sh, since no java can be found)

> cassandra shell script uses bad approach to write "Unable to find java" error 
> to stderr, causing real issue to be masked by a permission error if user has 
> changed user since logging in
> 
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed

2017-02-13 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864167#comment-15864167
 ] 

Michael Shuler commented on CASSANDRA-13211:


I think this change to {{ echo ... >&2}} would be fine and accomplishes the 
same. (When I move my /usr/bin/java out of the way, I get trapped earlier in 
the version check in cassandra-env.sh, since no java can be found)

> cassandra shell script uses bad approach to write "Unable to find java" error 
> to stderr, causing real issue to be masked by a permission error if user has 
> changed user since logging in
> 
>
> Key: CASSANDRA-13211
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13211
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Max Bowsher
>
> The cassandra startup shell script contains this line:
> echo Unable to find java executable. Check JAVA_HOME and PATH environment 
> variables. > /dev/stderr
> The problem here is the construct "> /dev/stderr". If the user invoking 
> Cassandra has changed user (for example, by SSHing in as a personal user, and 
> then sudo-ing to an application user responsible for executing the Cassandra 
> daemon), then the attempt to open /dev/stderr will fail, because it will 
> point to a PTY node under /dev/pts/ owned by the original user.
> Ultimately this leads to the real problem being masked by the confusing error 
> message "bash: /dev/stderr: Permission denied".
> The correct technique is to replace "> /dev/stderr" with ">&2" which will 
> write to the already open stderr file descriptor, instead of resolving the 
> chain of symlinks starting at /dev/stderr, and attempting to reopen the 
> target by name.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13210) test failure in repair_tests.incremental_repair_test.TestIncRepair.sstable_marking_test_not_intersecting_all_ranges

2017-02-10 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13210:
--

 Summary: test failure in 
repair_tests.incremental_repair_test.TestIncRepair.sstable_marking_test_not_intersecting_all_ranges
 Key: CASSANDRA-13210
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13210
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log, 
node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, 
node3.log, node4_debug.log, node4_gc.log, node4.log

example failure:

http://cassci.datastax.com/job/trunk_large_dtest/53/testReport/repair_tests.incremental_repair_test/TestIncRepair/sstable_marking_test_not_intersecting_all_ranges

{noformat}
Error Message

'Repaired at: 0' unexpectedly found in 'SSTable: 
/tmp/dtest-N7zjo6/test/node1/data0/keyspace1/standard1-a79a0c50efa211e6bf211330662f36ef/md-6-big\nPartitioner:
 org.apache.cassandra.dht.Murmur3Partitioner\nBloom Filter FP chance: 
0.01\nMinimum timestamp: 148673926323\nMaximum timestamp: 
148673926323\nSSTable min local deletion time: 2147483647\nSSTable max 
local deletion time: 2147483647\nCompressor: -\nTTL min: 0\nTTL max: 0\nFirst 
token: 296988783704308703 (key=30503337373039503231)\nLast token: 
296988783704308703 (key=30503337373039503231)\nEstimated droppable tombstones: 
0.0\nSSTable Level: 0\nRepaired at: 0\nPending repair: 
b099d1f0-efa2-11e6-89ec-d14624f1e47e\nReplay positions covered: 
{CommitLogPosition(segmentId=1486739234777, 
position=46796)=CommitLogPosition(segmentId=1486739234777, 
position=50819)}\ntotalColumnsSet: 5\ntotalRows: 1\nEstimated tombstone drop 
times:\nCount   Row SizeCell Count\n1   
   0 0\n2  0 0\n3   
   0 0\n4  0
 0\n5  0 2\n6   
   0 0\n7  0 0\n8   
   0 0\n10 0
 0\n12 0 0\n14  
   0 0\n17 0 0\n20  
   0 0\n24 0
 0\n29 0 0\n35  
   0 0\n42 0 0\n50  
   0 0\n60 0
 0\n72 0 0\n86  
   0 0\n1030 0\n124 
   0 0\n1490
 0\n1790 0\n215 
   1 0\n2580 0\n310 
   0 0\n3720
 0\n4460 0\n535 
   0 0\n6420 0\n770 
   0 0\n9240
 0\n1109   0 0\n1331
   0 0\n1597   0 0\n1916
   0 0\n2299   0
 0\n2759   0 0\n3311
   0 0\n3973   0 0\n4768
   0 0\n5722   0
 0\n6866   0 0\n8239
   0 0\n9887   0 0\n11864   
   0 0\n14237  0
 0\n17084  0 0\n20501   
   0 0\n24601  0 0\n29521   
   0 0\n35425  0
 0\n42510  0 0\n51012   
   0 0\n61214  0 0\n73457   
   0 0\n88148  0
 0\n105778 0 0\n126934  
   0 0\n152321 0 0\n182785  
   0 0\n219342 0
 0\n263210 0 0\n315852  
   0 0

[jira] [Created] (CASSANDRA-13209) test failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts_with_max_connections

2017-02-10 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13209:
--

 Summary: test failure in 
cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts_with_max_connections
 Key: CASSANDRA-13209
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13209
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1.log, node2.log, node3.log, node4.log, node5.log

example failure:

http://cassci.datastax.com/job/cassandra-2.1_dtest/528/testReport/cqlsh_tests.cqlsh_copy_tests/CqlshCopyTest/test_bulk_round_trip_blogposts_with_max_connections

{noformat}
Error Message

errors={'127.0.0.4': 'Client request timeout. See 
Session.execute[_async](timeout)'}, last_host=127.0.0.4
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-792s6j
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
dtest: DEBUG: removing ccm cluster test at: /tmp/dtest-792s6j
dtest: DEBUG: clearing ssl stores from [/tmp/dtest-792s6j] directory
dtest: DEBUG: cluster ccm directory: /tmp/dtest-uNMsuW
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
cassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster nodes
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
dtest: DEBUG: Running stress with user profile 
/home/automaton/cassandra-dtest/cqlsh_tests/blogposts.yaml
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/dtest.py", line 1090, in wrapped
f(obj)
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 
2571, in test_bulk_round_trip_blogposts_with_max_connections
copy_from_options={'NUMPROCESSES': 2})
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 
2500, in _test_bulk_round_trip
num_records = create_records()
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 
2473, in create_records
ret = rows_to_list(self.session.execute(count_statement))[0][0]
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, 
in execute
return self.execute_async(query, parameters, trace, custom_payload, 
timeout, execution_profile, paging_state).result()
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, 
in result
raise self._final_exception
"errors={'127.0.0.4': 'Client request timeout. See 
Session.execute[_async](timeout)'}, last_host=127.0.0.4\n 
>> begin captured logging << \ndtest: DEBUG: cluster ccm 
directory: /tmp/dtest-792s6j\ndtest: DEBUG: Done setting configuration 
options:\n{   'initial_token': None,\n'num_tokens': '32',\n
'phi_convict_threshold': 5,\n'range_request_timeout_in_ms': 1,\n
'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n
'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
1}\ndtest: DEBUG: removing ccm cluster test at: /tmp/dtest-792s6j\ndtest: 
DEBUG: clearing ssl stores from [/tmp/dtest-792s6j] directory\ndtest: DEBUG: 
cluster ccm directory: /tmp/dtest-uNMsuW\ndtest: DEBUG: Done setting 
configuration options:\n{   'initial_token': None,\n'num_tokens': '32',\n   
 'phi_convict_threshold': 5,\n'range_request_timeout_in_ms': 1,\n
'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n
'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster 
nodes\ncassandra.cluster: INFO: New Cassandra host  discovered\ncassandra.cluster: INFO: New Cassandra host  discovered\ncassandra.cluster: INFO: New Cassandra host 
 discovered\ncassandra.cluster: INFO: 

[jira] [Created] (CASSANDRA-13208) test failure in paging_test.TestPagingWithDeletions.test_failure_threshold_deletions

2017-02-10 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13208:
--

 Summary: test failure in 
paging_test.TestPagingWithDeletions.test_failure_threshold_deletions
 Key: CASSANDRA-13208
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13208
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1.log, node2.log, node3.log

example failure:

http://cassci.datastax.com/job/cassandra-2.1_dtest/528/testReport/paging_test/TestPagingWithDeletions/test_failure_threshold_deletions

{noformat}
Error Message

errors={'127.0.0.2': 'Client request timeout. See 
Session.execute[_async](timeout)'}, last_host=127.0.0.2
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-iXUhoT
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
cassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster nodes
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/paging_test.py", line 3404, in 
test_failure_threshold_deletions
self.session.execute(SimpleStatement("select * from paging_test", 
fetch_size=1000, consistency_level=CL.ALL, 
retry_policy=FallthroughRetryPolicy()))
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, 
in execute
return self.execute_async(query, parameters, trace, custom_payload, 
timeout, execution_profile, paging_state).result()
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, 
in result
raise self._final_exception
"errors={'127.0.0.2': 'Client request timeout. See 
Session.execute[_async](timeout)'}, last_host=127.0.0.2\n 
>> begin captured logging << \ndtest: DEBUG: cluster ccm 
directory: /tmp/dtest-iXUhoT\ndtest: DEBUG: Done setting configuration 
options:\n{   'initial_token': None,\n'num_tokens': '32',\n
'phi_convict_threshold': 5,\n'range_request_timeout_in_ms': 1,\n
'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n
'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster 
nodes\ncassandra.cluster: INFO: New Cassandra host  discovered\ncassandra.cluster: INFO: New Cassandra host  discovered\n- >> end captured 
logging << -"
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13207) test failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.maximalTaskNeedsCleanup

2017-02-09 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13207:
--

 Summary: test failure in 
org.apache.cassandra.db.compaction.PendingRepairManagerTest.maximalTaskNeedsCleanup
 Key: CASSANDRA-13207
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13207
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler


example failure:

http://cassci.datastax.com/job/trunk_testall/1396/testReport/org.apache.cassandra.db.compaction/PendingRepairManagerTest/maximalTaskNeedsCleanup

{noformat}
Stacktrace

java.lang.NullPointerException
at 
org.apache.cassandra.db.compaction.PendingRepairManagerTest.maximalTaskNeedsCleanup(PendingRepairManagerTest.java:182)
Standard Output

ERROR [main] 2017-02-09 23:00:16,661 ?:? - SLF4J: stderr
INFO  [main] 2017-02-09 23:00:16,881 ?:? - Configuration location: 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-02-09 23:00:16,884 ?:? - Loading settings from 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
INFO  [main] 2017-02-09 23:00:17,550 ?:? - Node 
configuration:[allocate_tokens_for_keyspace=null; authenticator=null; 
authorizer=null; auto_bootstrap=true; auto_snapshot=true; 
back_pressure_enabled=false; back_pressure_strategy=null; 
batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; 
batchlog_replay_throttle_in_kb=1024; broadcast_address=null; 
broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; 
cas_contention_timeout_in_ms=1000; cdc_enabled=false; 
cdc_free_space_check_interval_ms=250; 
cdc_raw_directory=build/test/cassandra/cdc_raw:165; cdc_total_space_in_mb=0; 
client_encryption_options=; cluster_name=Test Cluster; 
column_index_cache_size_in_kb=2; column_index_size_in_kb=4; 
commit_failure_policy=stop; commitlog_compression=null; 
commitlog_directory=build/test/cassandra/commitlog:165; 
commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; 
commitlog_segment_size_in_mb=5; commitlog_sync=batch; 
commitlog_sync_batch_window_in_ms=1.0; commitlog_sync_period_in_ms=0; 
commitlog_total_space_in_mb=null; 
compaction_large_partition_warning_threshold_mb=100; 
compaction_throughput_mb_per_sec=0; concurrent_compactors=4; 
concurrent_counter_writes=32; concurrent_materialized_view_writes=32; 
concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; 
counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; 
counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; 
credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; 
credentials_validity_in_ms=2000; cross_node_timeout=false; 
data_file_directories=[Ljava.lang.String;@1757cd72; disk_access_mode=mmap; 
disk_failure_policy=ignore; disk_optimization_estimate_percentile=0.95; 
disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; 
dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; 
dynamic_snitch_reset_interval_in_ms=60; 
dynamic_snitch_update_interval_in_ms=100; 
enable_scripted_user_defined_functions=true; 
enable_user_defined_functions=true; enable_user_defined_functions_threads=true; 
encryption_options=null; 
endpoint_snitch=org.apache.cassandra.locator.SimpleSnitch; 
file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; 
gc_warn_threshold_in_ms=0; hinted_handoff_disabled_datacenters=[]; 
hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; 
hints_compression=null; hints_directory=build/test/cassandra/hints:165; 
hints_flush_period_in_ms=1; incremental_backups=true; index_interval=null; 
index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; 
initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; 
inter_dc_tcp_nodelay=true; internode_authenticator=null; 
internode_compression=none; internode_recv_buff_size_in_bytes=0; 
internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; 
key_cache_save_period=14400; key_cache_size_in_mb=null; 
listen_address=127.0.0.1; listen_interface=null; 
listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; 
max_hint_window_in_ms=1080; max_hints_delivery_threads=2; 
max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; 
max_streaming_retries=3; max_value_size_in_mb=256; 
memtable_allocation_type=offheap_objects; memtable_cleanup_threshold=null; 
memtable_flush_writers=0; memtable_heap_space_in_mb=null; 
memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; 
native_transport_max_concurrent_connections=-1; 
native_transport_max_concurrent_connections_per_ip=-1; 
native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; 
native_transport_port=9207; native_transport_port_ssl=null; num_tokens=1; 
otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; 
partitioner=org.apache.cassandra.dht.ByteOrderedPartitioner; 
permissions_cache_max_entries=1000; permissions_upda

[jira] [Created] (CASSANDRA-13206) test failure in org.apache.cassandra.db.compaction.CompactionStrategyManagerPendingRepairTest.cleanupCompactionFinalized-compression

2017-02-09 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13206:
--

 Summary: test failure in 
org.apache.cassandra.db.compaction.CompactionStrategyManagerPendingRepairTest.cleanupCompactionFinalized-compression
 Key: CASSANDRA-13206
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13206
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler


example failure:

http://cassci.datastax.com/job/trunk_testall/1396/testReport/org.apache.cassandra.db.compaction/CompactionStrategyManagerPendingRepairTest/cleanupCompactionFinalized_compression

{noformat}
Error Message

Index: 0, Size: 0
Stacktrace

java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at 
org.apache.cassandra.db.compaction.PendingRepairManager.getNextBackgroundTask(PendingRepairManager.java:285)
at 
org.apache.cassandra.db.compaction.CompactionStrategyManager.lambda$getNextBackgroundTask$175(CompactionStrategyManager.java:152)
at 
org.apache.cassandra.db.compaction.CompactionStrategyManager$$Lambda$171/1299262669.get(Unknown
 Source)
at 
org.apache.cassandra.db.compaction.CompactionStrategyManager.getNextBackgroundTask(CompactionStrategyManager.java:163)
at 
org.apache.cassandra.db.compaction.CompactionStrategyManagerPendingRepairTest.cleanupCompactionFinalized(CompactionStrategyManagerPendingRepairTest.java:238)
Standard Output

ERROR [main] 2017-02-09 22:59:29,222 ?:? - SLF4J: stderr
INFO  [main] 2017-02-09 22:59:29,469 ?:? - Configuration location: 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-02-09 22:59:29,472 ?:? - Loading settings from 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
INFO  [main] 2017-02-09 22:59:30,552 ?:? - Node 
configuration:[allocate_tokens_for_keyspace=null; authenticator=null; 
authorizer=null; auto_bootstrap=true; auto_snapshot=true; 
back_pressure_enabled=f
...[truncated 58459 chars]...
7324.tbl compaction strategy for pending repair: 
6e3dd400-ef1b-11e6-a349-8bda75118b8f
DEBUG [main] 2017-02-09 22:59:37,470 ?:? - Setting repairedAt to 0 on 
BigTableReader(path='/home/automaton/cassandra/build/test/cassandra/data:157/ks_1486681177324/tbl-6e3129d0ef1b11e6a3498bda75118b8f/md-1-big-Data.db')
 for 6e3dd400-ef1b-11e6-a349-8bda75118b8f
DEBUG [main] 2017-02-09 22:59:37,472 ?:? - Removing compaction strategy for 
pending repair 6e3dd400-ef1b-11e6-a349-8bda75118b8f on  ks_1486681177324.tbl
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13159) Coalescing strategy can enter infinite loop

2017-02-09 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13159:
---
Fix Version/s: 3.11.x
   2.2.x
   2.1.x
   3.0.11

> Coalescing strategy can enter infinite loop
> ---
>
> Key: CASSANDRA-13159
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13159
> Project: Cassandra
>  Issue Type: Bug
>  Components: Streaming and Messaging
>Reporter: Corentin Chary
>Assignee: Corentin Chary
> Fix For: 3.0.11, 2.1.x, 2.2.x, 3.11.x
>
>
> {code}boolean maybeSleep(int messages, long averageGap, long 
> maxCoalesceWindow, Parker parker){code} 
> maybeSleep() can enter an infinite loop if messages or averageGap ends up 
> being 0 because sleep will be 0 and the while loop will never exit. I've 
> noticed that on one of my clusters twice this week.
> This can happen if in averageGap() sum is bigger than MEASURED_INTERVAL, 
> which should be pretty rare but apparently happen to me.
> Even if the diagnostic is wrong (and I'm pretty sure that this thread was 
> using 100% CPU doing nothing), the fix seems pretty safe to apply.
> {code}
> diff --git a/src/java/org/apache/cassandra/utils/CoalescingStrategies.java 
> b/src/java/org/apache/cassandra/utils/CoalescingStrategies.java
> index 0aa980f..982d4a6 100644
> --- a/src/java/org/apache/cassandra/utils/CoalescingStrategies.java
> +++ b/src/java/org/apache/cassandra/utils/CoalescingStrategies.java
> @@ -100,7 +100,7 @@ public class CoalescingStrategies
>  {
>  // only sleep if we can expect to double the number of messages 
> we're sending in the time interval
>  long sleep = messages * averageGap;
> -if (sleep > maxCoalesceWindow)
> +if (!sleep || sleep > maxCoalesceWindow)
>  return false;
>  
>  // assume we receive as many messages as we expect; apply the same 
> logic to the future batch:
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13204) Thread Leak in OutboundTcpConnection

2017-02-09 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13204:
---
Fix Version/s: 3.11.x
   2.2.x
   2.1.x
   3.0.11

> Thread Leak in OutboundTcpConnection
> 
>
> Key: CASSANDRA-13204
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13204
> Project: Cassandra
>  Issue Type: Bug
>Reporter: sankalp kohli
>Assignee: Jason Brown
> Fix For: 3.0.11, 2.1.x, 2.2.x, 3.11.x
>
>
> We found threads leaking from OutboundTcpConnection to machines which are not 
> part of the cluster and still in Gossip for some reason. There are two issues 
> here, this JIRA will cover the second one which is most important. 
> 1) First issue is that Gossip has information about machines not in the ring 
> which has been replaced out. It causes Cassandra to connect to those machines 
> but due to internode auth, it wont be able to connect to them at the socket 
> level.  
> 2) Second issue is a race between creating a connection and closing a 
> connections which is triggered by the gossip bug explained above. Let me try 
> to explain it using the code
> In OutboundTcpConnection, we are calling closeSocket(true) which will set 
> isStopped=true and also put a close sentinel into the queue to exit the 
> thread. On the ack connection, Gossip tries to send a message which calls 
> connect() which will block for 10 seconds which is RPC timeout. The reason we 
> will block is because Cassandra might not be running there or internode auth 
> will not let it connect. During this 10 seconds, if Gossip calls closeSocket, 
> it will put close sentinel into the queue. When we return from the connect 
> method after 10 seconds, we will clear the backlog queue causing this thread 
> to leak. 
> Proofs from the heap dump of the affected machine which is leaking threads 
> 1. Only ack connection is leaking and not the command connection which is not 
> used by Gossip. 
> 2. We see thread blocked on the backlog queue, isStopped=true and backlog 
> queue is empty. This is happening on the threads which have already leaked. 
> 3. A running thread was blocked on the connect waiting for timeout(10 
> seconds) and we see backlog queue to contain the close sentinel. Once the 
> connect will return false, we will clear the backlog and this thread will 
> have leaked.  
> Interesting bits from j stack 
> 1282 number of threads for "MessagingService-Outgoing-/"
> Thread which is about to leak:
> "MessagingService-Outgoing-/" 
>java.lang.Thread.State: RUNNABLE
>   at sun.nio.ch.Net.connect0(Native Method)
>   at sun.nio.ch.Net.connect(Net.java:454)
>   at sun.nio.ch.Net.connect(Net.java:446)
>   at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:648)
>   - locked <> (a java.lang.Object)
>   - locked <> (a java.lang.Object)
>   - locked <> (a java.lang.Object)
>   at 
> org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:137)
>   at 
> org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:119)
>   at 
> org.apache.cassandra.net.OutboundTcpConnection.connect(OutboundTcpConnection.java:381)
>   at 
> org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:217)
> Thread already leaked:
> "MessagingService-Outgoing-/"
>java.lang.Thread.State: WAITING (parking)
>   at sun.misc.Unsafe.park(Native Method)
>   - parking to wait for  <> (a 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>   at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>   at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>   at 
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>   at 
> org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482)
>   at 
> org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213)
>   at 
> org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13114) 3.0.x: update netty

2017-02-09 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13114:
---
Priority: Blocker  (was: Major)

> 3.0.x: update netty
> ---
>
> Key: CASSANDRA-13114
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13114
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Tom van der Woerdt
>Assignee: Stefan Podkowinski
>Priority: Blocker
> Fix For: 3.0.11
>
> Attachments: 13114_netty-4.0.44_2.x-3.0.patch, 
> 13114_netty-4.0.44_3.11.patch
>
>
> https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for 
> Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with 
> Cassandra 3.0.x, has some serious bugs around memory handling for SSL 
> connections.
> It would be nice if both were updated to 4.0.42, a version released this year.
> 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory 
> every ~30 minutes. This was fixed in 4.0.27.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13114) 3.0.x: update netty

2017-02-09 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859746#comment-15859746
 ] 

Michael Shuler commented on CASSANDRA-13114:


I set this ticket as a blocker for 3.0.11.

Is there any additional testing required to merge this to the cassandra-3.0 
branch, so we can release 3.0.11?  Thanks!

> 3.0.x: update netty
> ---
>
> Key: CASSANDRA-13114
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13114
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Tom van der Woerdt
>Assignee: Stefan Podkowinski
>Priority: Blocker
> Fix For: 3.0.11
>
> Attachments: 13114_netty-4.0.44_2.x-3.0.patch, 
> 13114_netty-4.0.44_3.11.patch
>
>
> https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for 
> Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with 
> Cassandra 3.0.x, has some serious bugs around memory handling for SSL 
> connections.
> It would be nice if both were updated to 4.0.42, a version released this year.
> 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory 
> every ~30 minutes. This was fixed in 4.0.27.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13114) 3.0.x: update netty

2017-02-09 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13114:
---
Fix Version/s: 3.0.11

> 3.0.x: update netty
> ---
>
> Key: CASSANDRA-13114
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13114
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Tom van der Woerdt
>Assignee: Stefan Podkowinski
>Priority: Blocker
> Fix For: 3.0.11
>
> Attachments: 13114_netty-4.0.44_2.x-3.0.patch, 
> 13114_netty-4.0.44_3.11.patch
>
>
> https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for 
> Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with 
> Cassandra 3.0.x, has some serious bugs around memory handling for SSL 
> connections.
> It would be nice if both were updated to 4.0.42, a version released this year.
> 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory 
> every ~30 minutes. This was fixed in 4.0.27.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13196) test failure in snitch_test.TestGossipingPropertyFileSnitch.test_prefer_local_reconnect_on_listen_address

2017-02-07 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13196:
--

 Summary: test failure in 
snitch_test.TestGossipingPropertyFileSnitch.test_prefer_local_reconnect_on_listen_address
 Key: CASSANDRA-13196
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13196
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log, 
node2_debug.log, node2_gc.log, node2.log

example failure:

http://cassci.datastax.com/job/trunk_dtest/1487/testReport/snitch_test/TestGossipingPropertyFileSnitch/test_prefer_local_reconnect_on_listen_address

{novnode}
Error Message

Error from server: code=2200 [Invalid query] message="keyspace keyspace1 does 
not exist"
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-k6b0iF
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
cassandra.policies: INFO: Using datacenter 'dc1' for DCAwareRoundRobinPolicy 
(via host '127.0.0.1'); if incorrect, please specify a local_dc to the 
constructor, or limit contact points to local cluster nodes
cassandra.cluster: INFO: New Cassandra host  discovered
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/snitch_test.py", line 87, in 
test_prefer_local_reconnect_on_listen_address
new_rows = list(session.execute("SELECT * FROM {}".format(stress_table)))
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, 
in execute
return self.execute_async(query, parameters, trace, custom_payload, 
timeout, execution_profile, paging_state).result()
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, 
in result
raise self._final_exception
'Error from server: code=2200 [Invalid query] message="keyspace keyspace1 does 
not exist"\n >> begin captured logging << 
\ndtest: DEBUG: cluster ccm directory: 
/tmp/dtest-k6b0iF\ndtest: DEBUG: Done setting configuration options:\n{   
\'initial_token\': None,\n\'num_tokens\': \'32\',\n
\'phi_convict_threshold\': 5,\n\'range_request_timeout_in_ms\': 1,\n
\'read_request_timeout_in_ms\': 1,\n\'request_timeout_in_ms\': 1,\n 
   \'truncate_request_timeout_in_ms\': 1,\n
\'write_request_timeout_in_ms\': 1}\ncassandra.policies: INFO: Using 
datacenter \'dc1\' for DCAwareRoundRobinPolicy (via host \'127.0.0.1\'); if 
incorrect, please specify a local_dc to the constructor, or limit contact 
points to local cluster nodes\ncassandra.cluster: INFO: New Cassandra host 
 discovered\n- >> end captured logging 
<< -'
{novnode}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (CASSANDRA-13183) test failure in compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test

2017-02-07 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler resolved CASSANDRA-13183.

Resolution: Duplicate

Thanks. It does look like the last few runs have passed.

> test failure in 
> compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test
> --
>
> Key: CASSANDRA-13183
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13183
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Michael Shuler
>  Labels: dtest, test-failure
> Attachments: logs.tar.gz
>
>
> This test failed on both Leveled and DateTiered.
> example failures:
> http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_LeveledCompactionStrategy/compaction_throughput_test
> http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_DateTieredCompactionStrategy/compaction_throughput_test/
> Leveled:
> {noformat}
> Error Message
> 5.5 not greater than or equal to 6.316
>  >> begin captured logging << 
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-lhjy7D
> dtest: DEBUG: Done setting configuration options:
> {   'num_tokens': None,
> 'phi_convict_threshold': 5,
> 'range_request_timeout_in_ms': 1,
> 'read_request_timeout_in_ms': 1,
> 'request_timeout_in_ms': 1,
> 'truncate_request_timeout_in_ms': 1,
> 'write_request_timeout_in_ms': 1}
> parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 
> '(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s'
> dtest: DEBUG: 6.316
> - >> end captured logging << -
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in 
> compaction_throughput_test
> self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput))
>   File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual
> self.fail(self._formatMessage(msg, standardMsg))
>   File "/usr/lib/python2.7/unittest/case.py", line 410, in fail
> raise self.failureException(msg)
> "5.5 not greater than or equal to 6.316\n >> begin 
> captured logging << \ndtest: DEBUG: cluster ccm 
> directory: /tmp/dtest-lhjy7D\ndtest: DEBUG: Done setting configuration 
> options:\n{   'num_tokens': None,\n'phi_convict_threshold': 5,\n
> 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 
> 1,\n'request_timeout_in_ms': 1,\n
> 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
> 1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 
> '(.+?)=(?P[-+ ]?d+.d+)(?P.+?)/s'\ndtest: 
> DEBUG: 6.316\n- >> end captured logging << 
> -"
> {noformat}
> DateTiered:
> {noformat}
> Error Message
> 5.5 not greater than or equal to 5.681
>  >> begin captured logging << 
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-FXOwMR
> dtest: DEBUG: Done setting configuration options:
> {   'num_tokens': None,
> 'phi_convict_threshold': 5,
> 'range_request_timeout_in_ms': 1,
> 'read_request_timeout_in_ms': 1,
> 'request_timeout_in_ms': 1,
> 'truncate_request_timeout_in_ms': 1,
> 'write_request_timeout_in_ms': 1}
> parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 
> '(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s'
> dtest: DEBUG: 5.681
> - >> end captured logging << -
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in 
> compaction_throughput_test
> self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput))
>   File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual
> self.fail(self._formatMessage(msg, standardMsg))
>   File "/usr/lib/python2.7/unittest/case.py", line 410, in fail
> raise self.failureException(msg)
> "5.5 not greater than or equal to 5.681\n >> begin 
> captured logging << \ndtest: DEBUG: cluster ccm 
> directory: /tmp/dtest-FXOwMR\ndtest: DEBUG: Done setting configuration 
> options:\n{   'num_tokens': None,\n'phi_convict_threshold': 5,\n
> 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 
> 1,\n'request_timeout_in_ms': 1,\n
> 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
> 1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 

[jira] [Created] (CASSANDRA-13194) test failure in repair_tests.incremental_repair_test.TestIncRepair.compaction_test

2017-02-07 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13194:
--

 Summary: test failure in 
repair_tests.incremental_repair_test.TestIncRepair.compaction_test
 Key: CASSANDRA-13194
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13194
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log, 
node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, 
node3.log

example failure:

http://cassci.datastax.com/job/cassandra-3.0_novnode_dtest/333/testReport/repair_tests.incremental_repair_test/TestIncRepair/compaction_test

{noformat}
Error Message

errors={'127.0.0.3': 'Client request timeout. See 
Session.execute[_async](timeout)'}, last_host=127.0.0.3
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-2JszEQ
dtest: DEBUG: Done setting configuration options:
{   'num_tokens': None,
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
cassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster nodes
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File 
"/home/automaton/cassandra-dtest/repair_tests/incremental_repair_test.py", line 
225, in compaction_test
create_ks(session, 'ks', 3)
  File "/home/automaton/cassandra-dtest/dtest.py", line 725, in create_ks
session.execute(query % (name, "'class':'SimpleStrategy', 
'replication_factor':%d" % rf))
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, 
in execute
return self.execute_async(query, parameters, trace, custom_payload, 
timeout, execution_profile, paging_state).result()
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, 
in result
raise self._final_exception
"errors={'127.0.0.3': 'Client request timeout. See 
Session.execute[_async](timeout)'}, last_host=127.0.0.3\n 
>> begin captured logging << \ndtest: DEBUG: cluster ccm 
directory: /tmp/dtest-2JszEQ\ndtest: DEBUG: Done setting configuration 
options:\n{   'num_tokens': None,\n'phi_convict_threshold': 5,\n
'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 
1,\n'request_timeout_in_ms': 1,\n
'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster 
nodes\ncassandra.cluster: INFO: New Cassandra host  discovered\ncassandra.cluster: INFO: New Cassandra host  discovered\n- >> end captured 
logging << -"
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13191) test failure in org.apache.cassandra.hints.HintsBufferPoolTest.testBackpressure

2017-02-07 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13191:
--

 Summary: test failure in 
org.apache.cassandra.hints.HintsBufferPoolTest.testBackpressure
 Key: CASSANDRA-13191
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13191
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler


example failure:

http://cassci.datastax.com/job/trunk_testall/1392/testReport/org.apache.cassandra.hints/HintsBufferPoolTest/testBackpressure

{noformat}
Error Message

Connection reset
Stacktrace

java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:209)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
at java.io.InputStreamReader.read(InputStreamReader.java:184)
at java.io.BufferedReader.fill(BufferedReader.java:161)
at java.io.BufferedReader.readLine(BufferedReader.java:324)
at java.io.BufferedReader.readLine(BufferedReader.java:389)
at 
org.jboss.byteman.agent.submit.Submit$Comm.readResponse(Submit.java:941)
at org.jboss.byteman.agent.submit.Submit.submitRequest(Submit.java:790)
at org.jboss.byteman.agent.submit.Submit.addScripts(Submit.java:603)
at 
org.jboss.byteman.contrib.bmunit.BMUnit.loadScriptText(BMUnit.java:268)
at 
org.jboss.byteman.contrib.bmunit.BMUnitRunner$10.evaluate(BMUnitRunner.java:369)
at 
org.jboss.byteman.contrib.bmunit.BMUnitRunner$6.evaluate(BMUnitRunner.java:241)
at 
org.jboss.byteman.contrib.bmunit.BMUnitRunner$1.evaluate(BMUnitRunner.java:75)
Standard Output

ERROR [main] 2017-02-07 11:03:07,465 ?:? - SLF4J: stderr
INFO  [main] 2017-02-07 11:03:07,650 ?:? - Configuration location: 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
DEBUG [main] 2017-02-07 11:03:07,651 ?:? - Loading settings from 
file:/home/automaton/cassandra/test/conf/cassandra.yaml
INFO  [main] 2017-02-07 11:03:08,225 ?:? - Node 
configuration:[allocate_tokens_for_keyspace=null; authenticator=null; 
authorizer=null; auto_bootstrap=true; auto_snapshot=true; 
back_pressure_enabled=false; back_pressure_strategy=null; 
batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; 
batchlog_replay_throttle_in_kb=1024; broadcast_address=null; 
broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; 
cas_contention_timeout_in_ms=1000; cdc_enabled=false; 
cdc_free_space_check_interval_ms=250; 
cdc_raw_directory=build/test/cassandra/cdc_raw:222; cdc_total_space_in_mb=0; 
client_encryption_options=; cluster_name=Test Cluster; 
column_index_cache_size_in_kb=2; column_index_size_in_kb=4; 
commit_failure_policy=stop; commitlog_compression=null; 
commitlog_directory=build/test/cassandra/commitlog:222; 
commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; 
commitlog_segment_size_in_mb=5; commitlog_sync=batch; 
commitlog_sync_batch_window_in_ms=1.0; commitlog_sync_period_in_ms=0; 
commitlog_total_space_in_mb=null; 
compaction_large_partition_warning_threshold_mb=100; 
compaction_throughput_mb_per_sec=0; concurrent_compactors=4; 
concurrent_counter_writes=32; concurrent_materialized_view_writes=32; 
concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; 
counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; 
counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; 
credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; 
credentials_validity_in_ms=2000; cross_node_timeout=false; 
data_file_directories=[Ljava.lang.String;@e7edb54; disk_access_mode=mmap; 
disk_failure_policy=ignore; disk_optimization_estimate_percentile=0.95; 
disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; 
dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; 
dynamic_snitch_reset_interval_in_ms=60; 
dynamic_snitch_update_interval_in_ms=100; 
enable_scripted_user_defined_functions=true; 
enable_user_defined_functions=true; enable_user_defined_functions_threads=true; 
encryption_options=null; 
endpoint_snitch=org.apache.cassandra.locator.SimpleSnitch; 
file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; 
gc_warn_threshold_in_ms=0; hinted_handoff_disabled_datacenters=[]; 
hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; 
hints_compression=null; hints_directory=build/test/cassandra/hints:222; 
hints_flush_period_in_ms=1; incremental_backups=true; index_interval=null; 
index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; 
initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; 
inter_dc_tcp_nodelay=true; internode_authenticator=null; 
internode_compression=none; internode_recv_buff_siz

[jira] [Created] (CASSANDRA-13190) Fix eclipse-warnings from CASSANDRA-9143

2017-02-07 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13190:
--

 Summary: Fix eclipse-warnings from CASSANDRA-9143
 Key: CASSANDRA-13190
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13190
 Project: Cassandra
  Issue Type: Sub-task
  Components: Testing
Reporter: Michael Shuler
Assignee: Blake Eggleston
 Fix For: 4.x


CASSANDRA-9143 introduced an error from eclipse-warnings:
{noformat}
# 2/7/17 5:50:30 AM UTC
# Eclipse Compiler for Java(TM) v20150120-1634, 3.10.2, Copyright IBM Corp 
2000, 2013. All rights reserved.
--
1. ERROR in 
/var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/repair/consistent/PendingAntiCompaction.java
 (at line 103)
return new AcquireResult(cfs, Refs.ref(sstables), txn);
^^^
Potential resource leak: 'txn' may not be closed at this location
--
--
2. ERROR in 
/var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/db/compaction/PendingRepairManager.java
 (at line 236)
return txn == null ? null : new RepairFinishedCompactionTask(cfs, txn, 
sessionID, repairedAt);

^^
Potential resource leak: 'txn' may not be closed at this location
--
2 problems (2 errors)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-10872) Debian Package does not prompt the user to review the config files; it just replaces them causing trouble (since the daemon starts by default)

2017-02-06 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-10872:
---
Fix Version/s: (was: 3.0.x)
   (was: 2.2.x)
   (was: 2.1.x)
   (was: 3.x)

> Debian Package does not prompt the user to review the config files; it just 
> replaces them causing trouble (since the daemon starts by default)
> --
>
> Key: CASSANDRA-10872
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10872
> Project: Cassandra
>  Issue Type: Bug
>  Components: Packaging
> Environment: Ubuntu 12.04, Cassandra 2.0.16 -> 2.0.17
>Reporter: Vasilis
>Assignee: Michael Shuler
>Priority: Critical
>  Labels: debian, packaging
>
> We run Cassandra 2.0.16 on Ubuntu 12.04 and were trying to upgrade to 2.0.17 
> due to CASSANDRA-9662. The problem is that during the upgrade the we were not 
> prompted how to handle cassandra-env.sh and cassandra-rackdc.properties. 
> The output from the upgrade:
> {panel}
> ...
> Setting up cassandra (2.0.17) ...
> Installing new version of config file /etc/cassandra/cassandra-env.sh ...
> Installing new version of config file 
> /etc/cassandra/cassandra-rackdc.properties ...
> vm.max_map_count = 1048575
> net.ipv4.tcp_keepalive_time = 300
> ...
> {panel}
> This meant that the nodes started automatically after the install with the 
> wrong DC name. 
> I don't think that these config files should have been replaced without the 
> admin being asked; this doesn't appear to comply with standard Debian 
> packages.
> Secondly if CASSANDRA-2356 was implemented the problem would not be as 
> severe; i.e. it would be possible to workaround this issue. Whereas 
> currently, there is no way to prevent the node when upgraded from starting in 
> the wrong DC.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-9320) test-burn target should be run occasionally

2017-02-06 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-9320:
--
Fix Version/s: (was: 3.x)

> test-burn target should be run occasionally
> ---
>
> Key: CASSANDRA-9320
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9320
> Project: Cassandra
>  Issue Type: Test
>Reporter: Ariel Weisberg
>Assignee: Michael Shuler
>Priority: Minor
>
> The tests are all concurrency tests right now so they need to run on the 
> largest  # of cores we have available. The tests are not configured to run 
> very long right now, but the intent is that they run for longer periods (days 
> even).
> They aren't described as high value right now because the code under test 
> hasn't change since first introduced so we can defer setting this job up 
> until higher priority things are done.
> I think we should still run them at some low frequency so they don't rot or 
> some change doesn't sneak in that effects them.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-8204) Configure multi-JDK8 build/test jenkins matrix job

2017-02-06 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-8204:
--
Fix Version/s: (was: 3.x)

> Configure multi-JDK8 build/test jenkins matrix job
> --
>
> Key: CASSANDRA-8204
> URL: https://issues.apache.org/jira/browse/CASSANDRA-8204
> Project: Cassandra
>  Issue Type: Sub-task
>  Components: Testing
>Reporter: Michael Shuler
>Assignee: Michael Shuler
>
> Set up Oracle JDK-8 and OpenJDK-8 build/test matrix job in Jenkins.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13183) test failure in compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test

2017-02-03 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13183:
--

 Summary: test failure in 
compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test
 Key: CASSANDRA-13183
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13183
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: logs.tar.gz

This test failed on both Leveled and DateTiered.

example failures:

http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_LeveledCompactionStrategy/compaction_throughput_test
http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_DateTieredCompactionStrategy/compaction_throughput_test/

Leveled:
{noformat}
Error Message

5.5 not greater than or equal to 6.316
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-lhjy7D
dtest: DEBUG: Done setting configuration options:
{   'num_tokens': None,
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 
'(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s'
dtest: DEBUG: 6.316
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in 
compaction_throughput_test
self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput))
  File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual
self.fail(self._formatMessage(msg, standardMsg))
  File "/usr/lib/python2.7/unittest/case.py", line 410, in fail
raise self.failureException(msg)
"5.5 not greater than or equal to 6.316\n >> begin captured 
logging << \ndtest: DEBUG: cluster ccm directory: 
/tmp/dtest-lhjy7D\ndtest: DEBUG: Done setting configuration options:\n{   
'num_tokens': None,\n'phi_convict_threshold': 5,\n
'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 
1,\n'request_timeout_in_ms': 1,\n
'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 
'(.+?)=(?P[-+ ]?d+.d+)(?P.+?)/s'\ndtest: 
DEBUG: 6.316\n- >> end captured logging << 
-"
{noformat}

DateTiered:
{noformat}
Error Message

5.5 not greater than or equal to 5.681
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-FXOwMR
dtest: DEBUG: Done setting configuration options:
{   'num_tokens': None,
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 
'(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s'
dtest: DEBUG: 5.681
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in 
compaction_throughput_test
self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput))
  File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual
self.fail(self._formatMessage(msg, standardMsg))
  File "/usr/lib/python2.7/unittest/case.py", line 410, in fail
raise self.failureException(msg)
"5.5 not greater than or equal to 5.681\n >> begin captured 
logging << \ndtest: DEBUG: cluster ccm directory: 
/tmp/dtest-FXOwMR\ndtest: DEBUG: Done setting configuration options:\n{   
'num_tokens': None,\n'phi_convict_threshold': 5,\n
'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 
1,\n'request_timeout_in_ms': 1,\n
'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> 
'(.+?)=(?P[-+ ]?d+.d+)(?P.+?)/s'\ndtest: 
DEBUG: 5.681\n- >> end captured logging << 
-"
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13182) test failure in sstableutil_test.SSTableUtilTest.compaction_test

2017-02-03 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13182:
--

 Summary: test failure in 
sstableutil_test.SSTableUtilTest.compaction_test
 Key: CASSANDRA-13182
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13182
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler
 Attachments: node1_debug.log, node1_gc.log, node1.log

example failure:

http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/sstableutil_test/SSTableUtilTest/compaction_test

{noformat}
Error Message

Lists differ: ['/tmp/dtest-Rk_3Cs/test/node1... != 
['/tmp/dtest-Rk_3Cs/test/node1...

First differing element 8:
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-CRC.db'
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-CRC.db'

First list contains 7 additional elements.
First extra element 24:
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Data.db'

  
['/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-CRC.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Data.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Digest.crc32',
   
'/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Filter.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Index.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Statistics.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Summary.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-TOC.txt',
-  
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-CRC.db',
-  
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Digest.crc32',
-  
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Filter.db',
-  
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Index.db',
-  
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Statistics.db',
-  
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Summary.db',
-  
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-TOC.txt',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-CRC.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Data.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Digest.crc32',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Filter.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Index.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Statistics.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Summary.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-TOC.txt',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-CRC.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Data.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Digest.crc32',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Filter.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Index.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Statistics.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Summary.db',
   
'/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-TOC.txt']
 >> begin captured logging << 
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CASSANDRA-13181) test failure in paging_test.TestPagingData.test_select_in_clause_with_duplicate_keys

2017-02-03 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13181:
--

 Summary: test failure in 
paging_test.TestPagingData.test_select_in_clause_with_duplicate_keys
 Key: CASSANDRA-13181
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13181
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler


example failure:

http://cassci.datastax.com/job/cassandra-2.2_novnode_dtest/352/testReport/paging_test/TestPagingData/test_select_in_clause_with_duplicate_keys

{noformat}
Error Message

'TestPagingData' object has no attribute 'create_ks'
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-I7zCAw
dtest: DEBUG: Done setting configuration options:
{   'num_tokens': None,
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
cassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster nodes
cassandra.cluster: INFO: New Cassandra host  
discovered
cassandra.cluster: INFO: New Cassandra host  
discovered
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/paging_test.py", line 1721, in 
test_select_in_clause_with_duplicate_keys
self.create_ks(session, 'test_paging_static_cols', 2)
"'TestPagingData' object has no attribute 'create_ks'\n >> 
begin captured logging << \ndtest: DEBUG: cluster ccm 
directory: /tmp/dtest-I7zCAw\ndtest: DEBUG: Done setting configuration 
options:\n{   'num_tokens': None,\n'phi_convict_threshold': 5,\n
'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 
1,\n'request_timeout_in_ms': 1,\n
'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 
1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for 
DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a 
local_dc to the constructor, or limit contact points to local cluster 
nodes\ncassandra.cluster: INFO: New Cassandra host  discovered\ncassandra.cluster: INFO: New Cassandra host  discovered\n- >> end captured 
logging << -"
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (CASSANDRA-13114) 3.0.x: update netty

2017-02-02 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850427#comment-15850427
 ] 

Michael Shuler commented on CASSANDRA-13114:


I built SNAPSHOT artifacts on top of current {{cassandra-3.0}} for Tom to test: 
http://people.apache.org/~mshuler/13114_netty-4.0.44_3.0/

{noformat}
commit cd9a6590dd950d456278461919d7e6a079531ee4 (HEAD -> 
13114_netty-4.0.44_3.0, github/13114_netty-4.0.44_3.0)
Author: Stefan Podkowinski 
Date:   Wed Jan 25 15:16:25 2017 +0100

Upgrade to netty 4.0.44

patch by Stefan Podkowinski; reviewed by X for CASSANDRA-13114

 CHANGES.txt |   1 +
 build.xml   |   2 
+-
 lib/licenses/{netty-all-4.0.23.Final.txt => netty-all-4.0.44.Final.txt} |   0
 lib/netty-all-4.0.23.Final.jar  | Bin 
1779991 -> 0 bytes
 lib/netty-all-4.0.44.Final.jar  | Bin 
0 -> 2342652 bytes
 src/java/org/apache/cassandra/transport/Message.java|  12 

 6 files changed, 10 insertions(+), 5 deletions(-)

commit 6caf3c4f13bb29e3fd732365210be6b3c954f04a (origin/cassandra-3.0, 
cassandra-3.0)
Author: Michael Shuler 
Date:   Wed Feb 1 14:39:35 2017 -0600

Remove 'no upgrades' note from NEWS.txt

{noformat}

> 3.0.x: update netty
> ---
>
> Key: CASSANDRA-13114
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13114
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Tom van der Woerdt
>Assignee: Stefan Podkowinski
> Attachments: 13114_netty-4.0.44_2.x-3.0.patch, 
> 13114_netty-4.0.44_3.11.patch
>
>
> https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for 
> Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with 
> Cassandra 3.0.x, has some serious bugs around memory handling for SSL 
> connections.
> It would be nice if both were updated to 4.0.42, a version released this year.
> 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory 
> every ~30 minutes. This was fixed in 4.0.27.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13115) Read repair is not blocking repair to finish in foreground repair

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13115:
---
Fix Version/s: (was: 3.11)
   3.10

> Read repair is not blocking repair to finish in foreground repair
> -
>
> Key: CASSANDRA-13115
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13115
> Project: Cassandra
>  Issue Type: Bug
> Environment: ccm on OSX 
>Reporter: Xiaolong Jiang
>Assignee: Sylvain Lebresne
> Fix For: 3.0.11, 3.10
>
>
> The code trying to wait(block) for repair result to come back in 3.X is below:
> {code:title= DataResolver.java|borderStyle=solid}
> public void close()
> {
> try
> {
> FBUtilities.waitOnFutures(repairResults, 
> DatabaseDescriptor.getWriteRpcTimeout());
> }
> catch (TimeoutException ex)
> {
> // We got all responses, but timed out while repairing
> int blockFor = consistency.blockFor(keyspace);
> if (Tracing.isTracing())
> Tracing.trace("Timed out while read-repairing after 
> receiving all {} data and digest responses", blockFor);
> else
> logger.debug("Timeout while read-repairing after 
> receiving all {} data and digest responses", blockFor);
> throw new ReadTimeoutException(consistency, blockFor-1, 
> blockFor, true);
> }
> }
> {code}
> in DataResolver class, but this close method is never called and it's also 
> not auto close(RepairMergeListener is not extending from 
> AutoCloseable/CloseableIterator) which means we never wait for repair to 
> finish before returning final result. 
> The steps to reproduce:
> 1. create some keyspace/table with RF = 2
> 2. start 2 nodes using ccm
> 3. stop node2
> 4. disable node1 hinted hand off
> 5. write some data to node1 with consistency level one
> 6. start node2
> 7. query some data from node1 
> This should trigger read repair. I put some log in above close method, and 
> can not see log print put.
> So this bug will basically violate "monotonic quorum reads " guarantee. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13075) Indexer is not correctly invoked when building indexes over sstables

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13075:
---
Fix Version/s: (was: 3.11)
   3.10

> Indexer is not correctly invoked when building indexes over sstables
> 
>
> Key: CASSANDRA-13075
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13075
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Sergio Bossa
>Assignee: Alex Petrov
>Priority: Critical
> Fix For: 3.0.11, 3.10, 4.0
>
> Attachments: CustomIndexTest.java
>
>
> Following CASSANDRA-12796, {{SecondaryIndexManager#indexPartition()}} calls 
> each {{Indexer}} {{begin}} and {{finish}} methods multiple times per 
> partition (depending on the page size), as 
> {{PartitionIterators#getOnlyElement()}} returns an empty partition even when 
> the iterator is exhausted.
> This leads to bugs for {{Indexer}} implementations doing actual work in those 
>  methods, but even worse, it provides the {{Indexer}} the same input of an 
> empty partition containing only a non-live partition deletion, as the 
> {{Indexer#partitionDelete()}} method is *not* actually called.
> My proposed solution:
> 1) Stop the iteration before the empty partition is returned and ingested 
> into the {{Indexer}}.
> 2) Actually call the {{Indexer#partitionDelete()}} method inside 
> {{SecondaryIndexManager#indexPartition()}} (which requires to use a filtered 
> iterator so it actually contains the deletion info).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13025) dtest failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13025:
---
Fix Version/s: (was: 3.11)

> dtest failure in 
> upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test
> 
>
> Key: CASSANDRA-13025
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13025
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Sylvain Lebresne
>Priority: Critical
>  Labels: dtest, test-failure
> Fix For: 3.10
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/28/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x/static_columns_with_distinct_test
> {code}
> Error Message
> 
> {code}{code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/tools/decorators.py", line 46, in 
> wrapped
> f(obj)
>   File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line 
> 4010, in static_columns_with_distinct_test
> rows = list(cursor.execute("SELECT DISTINCT k, s1 FROM test2"))
>   File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 
> 1998, in execute
> return self.execute_async(query, parameters, trace, custom_payload, 
> timeout, execution_profile, paging_state).result()
>   File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 
> 3784, in result
> raise self._final_exception
> {code}{code}
> Standard Output
> http://git-wip-us.apache.org/repos/asf/cassandra.git 
> git:7eac22dd41cb09e6d64fb5ac48b2cca3c8840cc8
> Unexpected error in node2 log, error: 
> ERROR [Native-Transport-Requests-2] 2016-12-08 03:20:04,861 Message.java:617 
> - Unexpected exception during request; channel = [id: 0xf4c13f2c, 
> L:/127.0.0.2:9042 - R:/127.0.0.1:52112]
> java.io.IOError: java.io.IOException: Corrupt empty row found in unfiltered 
> partition
>   at 
> org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:224)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:212)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:133) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.processPartition(SelectStatement.java:779)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:741)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:408)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:273)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:232)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:219) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:204) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:115)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:513)
>  [apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:407)
>  [apache-cassandra-3.9.jar:3.9]
>   at 
> io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   at 
> io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   

[jira] (CASSANDRA-12563) Stress daemon help is incorrect

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-12563:
---
Fix Version/s: (was: 3.11)
   3.10

> Stress daemon help is incorrect
> ---
>
> Key: CASSANDRA-12563
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12563
> Project: Cassandra
>  Issue Type: Bug
>  Components: Tools
>Reporter: Christopher Batey
>Assignee: Christopher Batey
>Priority: Trivial
>  Labels: stress
> Fix For: 3.0.11, 3.10, 4.0
>
>
> It says provide the option -sendToDaemon where as only -send-to and -sendto 
> work
> Fix here:
> https://github.com/chbatey/cassandra-1/tree/stress-daemon



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-12203) AssertionError on compaction after upgrade (2.1.9 -> 3.7)

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-12203:
---
Fix Version/s: (was: 3.11)
   3.10

> AssertionError on compaction after upgrade (2.1.9 -> 3.7)
> -
>
> Key: CASSANDRA-12203
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12203
> Project: Cassandra
>  Issue Type: Bug
>  Components: Core
> Environment: Cassandra 3.7 (upgrade from 2.1.9)
> Java version "1.8.0_91"
> Ubuntu 14.04.4 LTS (GNU/Linux 3.13.0-83-generic x86_64)
>Reporter: Roman S. Borschel
>Assignee: Yuki Morishita
>Priority: Critical
> Fix For: 3.0.11, 3.10
>
>
> After upgrading a Cassandra cluster from 2.1.9 to 3.7, one column family 
> (using SizeTieredCompaction) repeatedly and continuously failed compaction 
> (and thus also repair) across the cluster, with all nodes producing the 
> following errors in the logs:
> {noformat}
> 016-07-14T09:29:47.96855 |srv=cassandra|ERROR: Exception in thread 
> Thread[CompactionExecutor:3,1,main]
> 2016-07-14T09:29:47.96858 |srv=cassandra|java.lang.AssertionError: null
> 2016-07-14T09:29:47.96859 |srv=cassandra|   at 
> org.apache.cassandra.db.UnfilteredDeserializer$OldFormatDeserializer$TombstoneTracker.openNew(UnfilteredDeserializer.java:650)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96860 |srv=cassandra|   at 
> org.apache.cassandra.db.UnfilteredDeserializer$OldFormatDeserializer$UnfilteredIterator.hasNext(UnfilteredDeserializer.java:423)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96860 |srv=cassandra|   at 
> org.apache.cassandra.db.UnfilteredDeserializer$OldFormatDeserializer.hasNext(UnfilteredDeserializer.java:298)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96860 |srv=cassandra|   at 
> org.apache.cassandra.io.sstable.SSTableSimpleIterator$OldFormatIterator.readStaticRow(SSTableSimpleIterator.java:133)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96861 |srv=cassandra|   at 
> org.apache.cassandra.io.sstable.SSTableIdentityIterator.(SSTableIdentityIterator.java:57)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96861 |srv=cassandra|   at 
> org.apache.cassandra.io.sstable.format.big.BigTableScanner$KeyScanningIterator$1.initializeIterator(BigTableScanner.java:334)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96862 |srv=cassandra|   at 
> org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.maybeInit(LazilyInitializedUnfilteredRowIterator.java:48)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96862 |srv=cassandra|   at 
> org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.isReverseOrder(LazilyInitializedUnfilteredRowIterator.java:70)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96863 |srv=cassandra|   at 
> org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$1.reduce(UnfilteredPartitionIterators.java:109)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96863 |srv=cassandra|   at 
> org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$1.reduce(UnfilteredPartitionIterators.java:100)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96864 |srv=cassandra|   at 
> org.apache.cassandra.utils.MergeIterator$Candidate.consume(MergeIterator.java:408)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96864 |srv=cassandra|   at 
> org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:203)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96865 |srv=cassandra|   at 
> org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96865 |srv=cassandra|   at 
> org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) 
> ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96866 |srv=cassandra|   at 
> org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$2.hasNext(UnfilteredPartitionIterators.java:150)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96866 |srv=cassandra|   at 
> org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:72)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96867 |srv=cassandra|   at 
> org.apache.cassandra.db.compaction.CompactionIterator.hasNext(CompactionIterator.java:226)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96867 |srv=cassandra|   at 
> org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:182)
>  ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96867 |srv=cassandra|   at 
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) 
> ~[apache-cassandra-3.7.jar:3.7]
> 2016-07-14T09:29:47.96868 |srv=cassandra

[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13160:
---
Resolution: Fixed
Status: Resolved  (was: Ready to Commit)

Committed to cassandra-3.11 branch and merged up. Thanks!

https://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=commit;h=5e40fd9fa18bd0939450e657b0b6b0b86ad1f4c9

> batch documentation should note the single partition optimization
> -
>
> Key: CASSANDRA-13160
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13160
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>Priority: Minor
> Fix For: 4.0, 3.11
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization

2017-01-31 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847490#comment-15847490
 ] 

Michael Shuler commented on CASSANDRA-13160:


dropping 2.2 and 3.0 - doc doesn't exist in those branches

> batch documentation should note the single partition optimization
> -
>
> Key: CASSANDRA-13160
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13160
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>Priority: Minor
> Fix For: 4.0, 3.11
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13160:
---
Fix Version/s: (was: 3.0.11)
   (was: 2.2.9)

> batch documentation should note the single partition optimization
> -
>
> Key: CASSANDRA-13160
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13160
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>Priority: Minor
> Fix For: 4.0, 3.11
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13160:
---
Fix Version/s: 3.11
   4.0
   3.0.11
   2.2.9

> batch documentation should note the single partition optimization
> -
>
> Key: CASSANDRA-13160
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13160
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>Priority: Minor
> Fix For: 2.2.9, 3.0.11, 4.0, 3.11
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13160:
---
Status: Ready to Commit  (was: Patch Available)

> batch documentation should note the single partition optimization
> -
>
> Key: CASSANDRA-13160
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13160
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>Priority: Minor
> Fix For: 2.2.9, 3.0.11, 4.0, 3.11
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization

2017-01-31 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13160:
---
Reviewer: Michael Shuler

> batch documentation should note the single partition optimization
> -
>
> Key: CASSANDRA-13160
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13160
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization

2017-01-31 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847485#comment-15847485
 ] 

Michael Shuler commented on CASSANDRA-13160:


Looks good to me. Setting to 2.2 and up.

> batch documentation should note the single partition optimization
> -
>
> Key: CASSANDRA-13160
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13160
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Documentation and Website
>Reporter: Jon Haddad
>Assignee: Jon Haddad
>Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (CASSANDRA-13164) eclipse-warnings on CASSANDRA-9425

2017-01-28 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13164:
---
Fix Version/s: (was: 3.x)
   4.0

> eclipse-warnings on CASSANDRA-9425
> --
>
> Key: CASSANDRA-13164
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13164
> Project: Cassandra
>  Issue Type: Sub-task
>Reporter: Michael Shuler
>  Labels: test-failure
> Fix For: 4.0
>
>
> CASSANDRA-9425 commit triggered a few eclipse-warnings on 
> http://cassci.datastax.com/job/trunk_eclipse-warnings/1181/
> cc: [~iamaleksey]
> {noformat}
> 23:50:23 eclipse-warnings:
> 23:50:23 [mkdir] Created dir: 
> /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj
> 23:50:23  [echo] Running Eclipse Code Analysis.  Output logged to 
> /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj/eclipse_compiler_checks.txt
> 23:50:34  [java] --
> 23:50:34  [java] 1. ERROR in 
> /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java
>  (at line 138)
> 23:50:34  [java]  throw new RuntimeException(e);
> 23:50:34  [java]  ^^
> 23:50:34  [java] Potential resource leak: 'dataOutput' may not be closed 
> at this location
> 23:50:34  [java] --
> 23:50:34  [java] 2. ERROR in 
> /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java
>  (at line 159)
> 23:50:34  [java]  throw new RuntimeException(e);
> 23:50:34  [java]  ^^
> 23:50:34  [java] Potential resource leak: 'dataInput' may not be closed 
> at this location
> 23:50:34  [java] --
> 23:50:34  [java] 3. ERROR in 
> /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java
>  (at line 163)
> 23:50:34  [java]  return new RowCacheKey(tableId, indexName, key);
> 23:50:34  [java]  
> 23:50:34  [java] Potential resource leak: 'dataInput' may not be closed 
> at this location
> 23:50:34  [java] --
> 23:50:34  [java] 3 problems (3 errors)
> 23:50:34 
> 23:50:34 BUILD FAILED
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CASSANDRA-13164) eclipse-warnings on CASSANDRA-9425

2017-01-27 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13164:
--

 Summary: eclipse-warnings on CASSANDRA-9425
 Key: CASSANDRA-13164
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13164
 Project: Cassandra
  Issue Type: Sub-task
Reporter: Michael Shuler


CASSANDRA-9425 commit triggered a few eclipse-warnings on 
http://cassci.datastax.com/job/trunk_eclipse-warnings/1181/

cc: [~iamaleksey]

{noformat}
23:50:23 eclipse-warnings:
23:50:23 [mkdir] Created dir: 
/var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj
23:50:23  [echo] Running Eclipse Code Analysis.  Output logged to 
/var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj/eclipse_compiler_checks.txt
23:50:34  [java] --
23:50:34  [java] 1. ERROR in 
/var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java
 (at line 138)
23:50:34  [java]throw new RuntimeException(e);
23:50:34  [java]^^
23:50:34  [java] Potential resource leak: 'dataOutput' may not be closed at 
this location
23:50:34  [java] --
23:50:34  [java] 2. ERROR in 
/var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java
 (at line 159)
23:50:34  [java]throw new RuntimeException(e);
23:50:34  [java]^^
23:50:34  [java] Potential resource leak: 'dataInput' may not be closed at 
this location
23:50:34  [java] --
23:50:34  [java] 3. ERROR in 
/var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java
 (at line 163)
23:50:34  [java]return new RowCacheKey(tableId, indexName, key);
23:50:34  [java]
23:50:34  [java] Potential resource leak: 'dataInput' may not be closed at 
this location
23:50:34  [java] --
23:50:34  [java] 3 problems (3 errors)
23:50:34 
23:50:34 BUILD FAILED
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (CASSANDRA-12981) Refactor ColumnCondition

2017-01-27 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler reopened CASSANDRA-12981:


new test testInMarkerWithUDTs fails with:
{noformat}
Error Message

java.lang.Integer cannot be cast to java.lang.String
Stacktrace

java.lang.ClassCastException: java.lang.Integer cannot be cast to 
java.lang.String
at org.apache.cassandra.cql3.CQLTester.userType(CQLTester.java:1481)
at 
org.apache.cassandra.cql3.validation.operations.InsertUpdateIfConditionTest.testInMarkerWithUDTs(InsertUpdateIfConditionTest.java:1972)
{noformat}

http://cassci.datastax.com/job/cassandra-3.11_utest/71/testReport/org.apache.cassandra.cql3.validation.operations/InsertUpdateIfConditionTest/testInMarkerWithUDTs/

> Refactor ColumnCondition
> 
>
> Key: CASSANDRA-12981
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12981
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL
>Reporter: Benjamin Lerer
>Assignee: Benjamin Lerer
>
> {{ColumnCondition}} has become really difficult to understand and modify. We 
> should separate the logic to make improvements and maintenance easier. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CASSANDRA-13125) Duplicate rows after upgrading from 2.1.16 to 3.0.10/3.9

2017-01-20 Thread Michael Shuler (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832400#comment-15832400
 ] 

Michael Shuler commented on CASSANDRA-13125:


Would this have something to do with it?
{noformat}
(cassandra-3.11)mshuler@hana:~/git/cassandra$ grep -r sigar-bin conf/
conf/cassandra-env.ps1:$env:JVM_OPTS = "$env:JVM_OPTS 
-Djava.library.path=""$env:CASSANDRA_HOME\lib\sigar-bin"""
conf/cassandra-env.sh:JVM_OPTS="$JVM_OPTS 
-Djava.library.path=$CASSANDRA_HOME/lib/sigar-bin"

(cassandra-3.11)mshuler@hana:~/git/cassandra$ grep -r sigar-bin test/conf/
(cassandra-3.11)mshuler@hana:~/git/cassandra$
{noformat}

> Duplicate rows after upgrading from 2.1.16 to 3.0.10/3.9
> 
>
> Key: CASSANDRA-13125
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13125
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Zhongxiang Zheng
>Assignee: Yasuharu Goto
>Priority: Critical
> Attachments: diff-a.patch, diff-b.patch
>
>
> I found that rows are splitting and duplicated after upgrading the cluster 
> from 2.1.x to 3.0.x.
> I found the way to reproduce the problem as below.
> {code}
> $ ccm create test -v 2.1.16 -n 3 -s   
> 
> Current cluster is now: test
> $ ccm node1 cqlsh  -e "CREATE KEYSPACE test WITH replication = 
> {'class':'SimpleStrategy', 'replication_factor':3}"
> $ ccm node1 cqlsh -e "CREATE TABLE test.test (id text PRIMARY KEY, value1 
> set, value2 set);"
> # Upgrade node1
> $ for i in 1; do ccm node${i} stop; ccm node${i} setdir -v3.0.10; ccm 
> node${i} start;ccm node${i} nodetool upgradesstables; done
> # Insert a row through node1(3.0.10)
> $ ccm node1 cqlsh -e "INSERT INTO test.test (id, value1, value2) values 
> ('aaa', {'aaa', 'bbb'}, {'ccc', 'ddd'});"   
> # Insert a row through node2(2.1.16)
> $ ccm node2 cqlsh -e "INSERT INTO test.test (id, value1, value2) values 
> ('bbb', {'aaa', 'bbb'}, {'ccc', 'ddd'});" 
> # The row inserted from node1 is splitting
> $ ccm node1 cqlsh -e "SELECT * FROM test.test ;"
>  id  | value1 | value2
> -++
>  aaa |   null |   null
>  aaa | {'aaa', 'bbb'} | {'ccc', 'ddd'}
>  bbb | {'aaa', 'bbb'} | {'ccc', 'ddd'}
> $ for i in 1 2; do ccm node${i} nodetool flush; done
> # Results of sstable2json of node2. The row inserted from node1(3.0.10) is 
> different from the row inserted from node2(2.1.16).
> $ ccm node2 json -k test -c test
> running
> ['/home/zzheng/.ccm/test/node2/data0/test/test-5406ee80dbdb11e6a175f57c4c7c85f3/test-test-ka-1-Data.db']
> -- test-test-ka-1-Data.db -
> [
> {"key": "aaa",
>  "cells": [["","",1484564624769577],
>["value1","value2:!",1484564624769576,"t",1484564624],
>["value1:616161","",1484564624769577],
>["value1:626262","",1484564624769577],
>["value2:636363","",1484564624769577],
>["value2:646464","",1484564624769577]]},
> {"key": "bbb",
>  "cells": [["","",1484564634508029],
>["value1:_","value1:!",1484564634508028,"t",1484564634],
>["value1:616161","",1484564634508029],
>["value1:626262","",1484564634508029],
>["value2:_","value2:!",1484564634508028,"t",1484564634],
>["value2:636363","",1484564634508029],
>["value2:646464","",1484564634508029]]}
> ]
> # Upgrade node2,3
> $ for i in `seq 2 3`; do ccm node${i} stop; ccm node${i} setdir -v3.0.10; ccm 
> node${i} start;ccm node${i} nodetool upgradesstables; done
> # After upgrade node2,3, the row inserted from node1 is splitting in node2,3
> $ ccm node2 cqlsh -e "SELECT * FROM test.test ;"  
>   
>  id  | value1 | value2
> -++
>  aaa |   null |   null
>  aaa | {'aaa', 'bbb'} | {'ccc', 'ddd'}
>  bbb | {'aaa', 'bbb'} | {'ccc', 'ddd'}
> (3 rows)
> # Results of sstabledump
> # node1
> [
>   {
> "partition" : {
>   "key" : [ "aaa" ],
>   "position" : 0
> },
> "rows" : [
>   {
> "type" : "row",
> "position" : 17,
> "liveness_info" : { "tstamp" : "2017-01-16T11:03:44.769577Z" },
> "cells" : [
>   { "name" : "value1", "deletion_info" : { "marked_deleted" : 
> "2017-01-16T11:03:44.769576Z", "local_delete_time" : "2017-01-16T11:03:44Z" } 
> },
>   { "name" : "value1", "path" : [ "aaa" ], "value" : "" },
>   { "name" : "value1", "path" : [ "bbb" ], "value" : "" },
>   { "name" : "value2", "deletion_info" : { "marked_deleted" : 
> "2017-01-16T11:03:44.769576Z", "local_delete_time" : "2017-01-16T11:03:44Z" } 
> },
>  

[jira] [Updated] (CASSANDRA-12617) dtest failure in offline_tools_test.TestOfflineTools.sstableofflinerelevel_test

2017-01-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-12617:
---
Fix Version/s: (was: 3.10)
   3.x

> dtest failure in 
> offline_tools_test.TestOfflineTools.sstableofflinerelevel_test
> ---
>
> Key: CASSANDRA-12617
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12617
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Sean McCarthy
>Assignee: Carl Yeksigian
>  Labels: dtest, test-failure
> Fix For: 3.x
>
> Attachments: node1_debug.log, node1_gc.log, node1.log
>
>
> example failure:
> http://cassci.datastax.com/job/trunk_offheap_dtest/391/testReport/offline_tools_test/TestOfflineTools/sstableofflinerelevel_test/
> {code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/offline_tools_test.py", line 212, in 
> sstableofflinerelevel_test
> self.assertGreater(max(final_levels), 1)
>   File "/usr/lib/python2.7/unittest/case.py", line 942, in assertGreater
> self.fail(self._formatMessage(msg, standardMsg))
>   File "/usr/lib/python2.7/unittest/case.py", line 410, in fail
> raise self.failureException(msg)
> "1 not greater than 1
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-12617) dtest failure in offline_tools_test.TestOfflineTools.sstableofflinerelevel_test

2017-01-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-12617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-12617:
---
Priority: Major  (was: Blocker)

> dtest failure in 
> offline_tools_test.TestOfflineTools.sstableofflinerelevel_test
> ---
>
> Key: CASSANDRA-12617
> URL: https://issues.apache.org/jira/browse/CASSANDRA-12617
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Sean McCarthy
>Assignee: Carl Yeksigian
>  Labels: dtest, test-failure
> Fix For: 3.x
>
> Attachments: node1_debug.log, node1_gc.log, node1.log
>
>
> example failure:
> http://cassci.datastax.com/job/trunk_offheap_dtest/391/testReport/offline_tools_test/TestOfflineTools/sstableofflinerelevel_test/
> {code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/offline_tools_test.py", line 212, in 
> sstableofflinerelevel_test
> self.assertGreater(max(final_levels), 1)
>   File "/usr/lib/python2.7/unittest/case.py", line 942, in assertGreater
> self.fail(self._formatMessage(msg, standardMsg))
>   File "/usr/lib/python2.7/unittest/case.py", line 410, in fail
> raise self.failureException(msg)
> "1 not greater than 1
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CASSANDRA-13025) dtest failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test

2017-01-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13025:
---
Fix Version/s: (was: 3.0.11)
   (was: 3.10)
   3.x
   3.0.x

> dtest failure in 
> upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test
> 
>
> Key: CASSANDRA-13025
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13025
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Alex Petrov
>  Labels: dtest, test-failure
> Fix For: 3.0.x, 3.x
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/28/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x/static_columns_with_distinct_test
> {code}
> Error Message
> 
> {code}{code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/tools/decorators.py", line 46, in 
> wrapped
> f(obj)
>   File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line 
> 4010, in static_columns_with_distinct_test
> rows = list(cursor.execute("SELECT DISTINCT k, s1 FROM test2"))
>   File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 
> 1998, in execute
> return self.execute_async(query, parameters, trace, custom_payload, 
> timeout, execution_profile, paging_state).result()
>   File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 
> 3784, in result
> raise self._final_exception
> {code}{code}
> Standard Output
> http://git-wip-us.apache.org/repos/asf/cassandra.git 
> git:7eac22dd41cb09e6d64fb5ac48b2cca3c8840cc8
> Unexpected error in node2 log, error: 
> ERROR [Native-Transport-Requests-2] 2016-12-08 03:20:04,861 Message.java:617 
> - Unexpected exception during request; channel = [id: 0xf4c13f2c, 
> L:/127.0.0.2:9042 - R:/127.0.0.1:52112]
> java.io.IOError: java.io.IOException: Corrupt empty row found in unfiltered 
> partition
>   at 
> org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:224)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:212)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:133) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.processPartition(SelectStatement.java:779)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:741)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:408)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:273)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:232)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:219) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:204) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:115)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:513)
>  [apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:407)
>  [apache-cassandra-3.9.jar:3.9]
>   at 
> io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   at 
> io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java

[jira] [Updated] (CASSANDRA-13025) dtest failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test

2017-01-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13025:
---
Priority: Major  (was: Blocker)

> dtest failure in 
> upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test
> 
>
> Key: CASSANDRA-13025
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13025
> Project: Cassandra
>  Issue Type: Bug
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Alex Petrov
>  Labels: dtest, test-failure
> Fix For: 3.0.x, 3.x
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/28/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x/static_columns_with_distinct_test
> {code}
> Error Message
> 
> {code}{code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/tools/decorators.py", line 46, in 
> wrapped
> f(obj)
>   File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line 
> 4010, in static_columns_with_distinct_test
> rows = list(cursor.execute("SELECT DISTINCT k, s1 FROM test2"))
>   File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 
> 1998, in execute
> return self.execute_async(query, parameters, trace, custom_payload, 
> timeout, execution_profile, paging_state).result()
>   File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 
> 3784, in result
> raise self._final_exception
> {code}{code}
> Standard Output
> http://git-wip-us.apache.org/repos/asf/cassandra.git 
> git:7eac22dd41cb09e6d64fb5ac48b2cca3c8840cc8
> Unexpected error in node2 log, error: 
> ERROR [Native-Transport-Requests-2] 2016-12-08 03:20:04,861 Message.java:617 
> - Unexpected exception during request; channel = [id: 0xf4c13f2c, 
> L:/127.0.0.2:9042 - R:/127.0.0.1:52112]
> java.io.IOError: java.io.IOException: Corrupt empty row found in unfiltered 
> partition
>   at 
> org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:224)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:212)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:133) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.processPartition(SelectStatement.java:779)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:741)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:408)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:273)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:232)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:219) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:204) 
> ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:115)
>  ~[apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:513)
>  [apache-cassandra-3.9.jar:3.9]
>   at 
> org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:407)
>  [apache-cassandra-3.9.jar:3.9]
>   at 
> io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   at 
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   at 
> io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35)
>  [netty-all-4.0.39.Final.jar:4.0.39.Final]
>   at 
> io.netty.channel.Abs

[jira] [Updated] (CASSANDRA-13058) dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test

2017-01-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13058:
---
Priority: Major  (was: Blocker)

> dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test
> --
>
> Key: CASSANDRA-13058
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13058
> Project: Cassandra
>  Issue Type: Test
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Stefan Podkowinski
>  Labels: dtest, test-failure
> Fix For: 3.x
>
> Attachments: 13058-3.x.patch, node1_debug.log, node1_gc.log, 
> node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, 
> node3_gc.log, node3.log, node4_debug.log, node4_gc.log, node4.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.X_novnode_dtest/16/testReport/hintedhandoff_test/TestHintedHandoff/hintedhandoff_decom_test/
> {code}
> Error Message
> Subprocess ['nodetool', '-h', 'localhost', '-p', '7100', ['decommission']] 
> exited with non-zero status; exit status: 2; 
> stderr: error: Error while decommissioning node: Failed to transfer all hints 
> to 59f20b4f-0215-4e18-be1b-7e00f2901629
> {code}{code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/hintedhandoff_test.py", line 167, in 
> hintedhandoff_decom_test
> node1.decommission()
>   File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1314, in 
> decommission
> self.nodetool("decommission")
>   File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 783, in 
> nodetool
> return handle_external_tool_process(p, ['nodetool', '-h', 'localhost', 
> '-p', str(self.jmx_port), cmd.split()])
>   File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1993, in 
> handle_external_tool_process
> raise ToolError(cmd_args, rc, out, err)
> {code}{code}
> java.lang.RuntimeException: Error while decommissioning node: Failed to 
> transfer all hints to 59f20b4f-0215-4e18-be1b-7e00f2901629
>   at 
> org.apache.cassandra.service.StorageService.decommission(StorageService.java:3924)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:497)
>   at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:497)
>   at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275)
>   at 
> com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)
>   at 
> com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)
>   at 
> com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)
>   at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138)
>   at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:252)
>   at 
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819)
>   at 
> com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:801)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1466)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1307)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1399)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:828)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:497)
>   at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:323)
>   at sun.rmi.transport.Transport$1.run(Transport.java:200)
>   at sun.rmi.transport.Transport$1.run(Transport.java:197)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at sun.rmi.

[jira] [Updated] (CASSANDRA-13058) dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test

2017-01-13 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler updated CASSANDRA-13058:
---
Fix Version/s: (was: 3.10)
   3.x

> dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test
> --
>
> Key: CASSANDRA-13058
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13058
> Project: Cassandra
>  Issue Type: Test
>  Components: Testing
>Reporter: Sean McCarthy
>Assignee: Stefan Podkowinski
>  Labels: dtest, test-failure
> Fix For: 3.x
>
> Attachments: 13058-3.x.patch, node1_debug.log, node1_gc.log, 
> node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, 
> node3_gc.log, node3.log, node4_debug.log, node4_gc.log, node4.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-3.X_novnode_dtest/16/testReport/hintedhandoff_test/TestHintedHandoff/hintedhandoff_decom_test/
> {code}
> Error Message
> Subprocess ['nodetool', '-h', 'localhost', '-p', '7100', ['decommission']] 
> exited with non-zero status; exit status: 2; 
> stderr: error: Error while decommissioning node: Failed to transfer all hints 
> to 59f20b4f-0215-4e18-be1b-7e00f2901629
> {code}{code}
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
>   File "/home/automaton/cassandra-dtest/hintedhandoff_test.py", line 167, in 
> hintedhandoff_decom_test
> node1.decommission()
>   File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1314, in 
> decommission
> self.nodetool("decommission")
>   File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 783, in 
> nodetool
> return handle_external_tool_process(p, ['nodetool', '-h', 'localhost', 
> '-p', str(self.jmx_port), cmd.split()])
>   File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1993, in 
> handle_external_tool_process
> raise ToolError(cmd_args, rc, out, err)
> {code}{code}
> java.lang.RuntimeException: Error while decommissioning node: Failed to 
> transfer all hints to 59f20b4f-0215-4e18-be1b-7e00f2901629
>   at 
> org.apache.cassandra.service.StorageService.decommission(StorageService.java:3924)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:497)
>   at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:497)
>   at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275)
>   at 
> com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)
>   at 
> com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)
>   at 
> com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)
>   at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138)
>   at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:252)
>   at 
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819)
>   at 
> com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:801)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1466)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1307)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1399)
>   at 
> javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:828)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:497)
>   at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:323)
>   at sun.rmi.transport.Transport$1.run(Transport.java:200)
>   at sun.rmi.transport.Transport$1.run(Transport.java:197)
>   at java.security.AccessController.doPrivileged(Native Metho

[jira] [Created] (CASSANDRA-13102) test failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts

2017-01-05 Thread Michael Shuler (JIRA)
Michael Shuler created CASSANDRA-13102:
--

 Summary: test failure in 
cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts
 Key: CASSANDRA-13102
 URL: https://issues.apache.org/jira/browse/CASSANDRA-13102
 Project: Cassandra
  Issue Type: Bug
Reporter: Michael Shuler


example failure:

http://cassci.datastax.com/job/cassandra-3.0_dtest/875/testReport/cqlsh_tests.cqlsh_copy_tests/CqlshCopyTest/test_bulk_round_trip_blogposts

{noformat}
Error Message

('Unable to connect to any servers', {'127.0.0.1': error(111, "Tried connecting 
to [('127.0.0.1', 9042)]. Last error: Connection refused")})
 >> begin captured logging << 
dtest: DEBUG: cluster ccm directory: /tmp/dtest-1c8hQM
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
dtest: DEBUG: removing ccm cluster test at: /tmp/dtest-1c8hQM
dtest: DEBUG: clearing ssl stores from [/tmp/dtest-1c8hQM] directory
dtest: DEBUG: cluster ccm directory: /tmp/dtest-C2OXmx
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
'num_tokens': '32',
'phi_convict_threshold': 5,
'range_request_timeout_in_ms': 1,
'read_request_timeout_in_ms': 1,
'request_timeout_in_ms': 1,
'truncate_request_timeout_in_ms': 1,
'write_request_timeout_in_ms': 1}
- >> end captured logging << -
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
testMethod()
  File "/home/automaton/cassandra-dtest/dtest.py", line 1079, in wrapped
f(obj)
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 
2553, in test_bulk_round_trip_blogposts
stress_table='stresscql.blogposts')
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 
2456, in _test_bulk_round_trip
self.prepare(nodes=nodes, partitioner=partitioner, 
configuration_options=configuration_options)
  File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 
129, in prepare
self.session = self.patient_cql_connection(self.node1)
  File "/home/automaton/cassandra-dtest/dtest.py", line 508, in 
patient_cql_connection
bypassed_exception=NoHostAvailable
  File "/home/automaton/cassandra-dtest/dtest.py", line 201, in 
retry_till_success
return fun(*args, **kwargs)
  File "/home/automaton/cassandra-dtest/dtest.py", line 441, in cql_connection
protocol_version, port=port, ssl_opts=ssl_opts)
  File "/home/automaton/cassandra-dtest/dtest.py", line 469, in _create_session
session = cluster.connect(wait_for_all_pools=True)
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1180, 
in connect
self.control_connection.connect()
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 2597, 
in connect
self._set_new_connection(self._reconnect_internal())
  File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 2634, 
in _reconnect_internal
raise NoHostAvailable("Unable to connect to any servers", errors)
'(\'Unable to connect to any servers\', {\'127.0.0.1\': error(111, "Tried 
connecting to [(\'127.0.0.1\', 9042)]. Last error: Connection 
refused")})\n >> begin captured logging << 
\ndtest: DEBUG: cluster ccm directory: 
/tmp/dtest-1c8hQM\ndtest: DEBUG: Done setting configuration options:\n{   
\'initial_token\': None,\n\'num_tokens\': \'32\',\n
\'phi_convict_threshold\': 5,\n\'range_request_timeout_in_ms\': 1,\n
\'read_request_timeout_in_ms\': 1,\n\'request_timeout_in_ms\': 1,\n 
   \'truncate_request_timeout_in_ms\': 1,\n
\'write_request_timeout_in_ms\': 1}\ndtest: DEBUG: removing ccm cluster 
test at: /tmp/dtest-1c8hQM\ndtest: DEBUG: clearing ssl stores from 
[/tmp/dtest-1c8hQM] directory\ndtest: DEBUG: cluster ccm directory: 
/tmp/dtest-C2OXmx\ndtest: DEBUG: Done setting configuration options:\n{   
\'initial_token\': None,\n\'num_tokens\': \'32\',\n
\'phi_convict_threshold\': 5,\n\'range_request_timeout_in_ms\': 1,\n
\'read_request_timeout_in_ms\': 1,\n\'request_timeout_in_ms\': 1,\n 
   \'truncate_request_timeout_in_ms\': 1,\n
\'write_request_timeout_in_ms\': 1}\n- >> end captured 
logging << -'
{noformat}

(No node log file from test)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (CASSANDRA-13046) Missing PID file directory when installing from RPM

2017-01-04 Thread Michael Shuler (JIRA)

 [ 
https://issues.apache.org/jira/browse/CASSANDRA-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Shuler resolved CASSANDRA-13046.

Resolution: Fixed

Committed to 2.2 and merged up. Thanks!

https://github.com/apache/cassandra/commit/3d90bb0cc74ca52fc6a9947a746695630ca7fc2a

> Missing PID file directory when installing from RPM
> ---
>
> Key: CASSANDRA-13046
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13046
> Project: Cassandra
>  Issue Type: Bug
>  Components: Packaging
> Environment: CentOS 7.3
>Reporter: Marcel Dopita
>Assignee: Michael Shuler
>Priority: Minor
> Fix For: 2.2.9, 3.0.11, 3.10
>
>
> As already reported in CASSANDRA-10920, changes to /var/run/cassandra folder 
> are not persistent across reboots and therefore saving pid file to that 
> location fails. This causes trouble when managing the status of the cassandra 
> service.
> The linked issue mentions good enough (and working) workaround (compared to 
> writing new service file for systemd). 
> Trunk now contains files necessary to produce RHEL compatible RPM in the 
> /redhat folder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


<    1   2   3   4   5   6   7   8   9   10   >