[jira] [Commented] (CASSANDRA-13413) Run more test targets on CircleCI
[ https://issues.apache.org/jira/browse/CASSANDRA-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957245#comment-15957245 ] Michael Shuler commented on CASSANDRA-13413: I was working on multiple runners and fixing a broken test in CASSANDRA-13414. It looks like we OOM the container with more than one runner, so since y'all are here, can you include this one-liner to fix o.a.c.utils.BitSetTest.compareBitSets? {code} diff --git a/circle.yml b/circle.yml index f0df31265a..66e752f367 100644 --- a/circle.yml +++ b/circle.yml @@ -8,6 +8,7 @@ test: - sudo ifconfig lo:2 127.0.0.3 up - sudo ifconfig lo:3 127.0.0.4 up - sudo ifconfig lo:4 127.0.0.5 up +- sudo apt-get update; sudo apt-get install wamerican - ant build override: {code} Since you're removing the pre: section, I'm not sure how to include that in the parallel bits, yet. Thanks! > Run more test targets on CircleCI > - > > Key: CASSANDRA-13413 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13413 > Project: Cassandra > Issue Type: Bug >Reporter: Marcus Eriksson >Assignee: Marcus Eriksson > > Currently we only run {{ant test}} on circleci, we should use all the (free) > containers we have and run more targets in parallel. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list
[ https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13414: --- Fix Version/s: (was: 4.0) 4.x > circle.yml: parallelize tests and install word list > --- > > Key: CASSANDRA-13414 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13414 > Project: Cassandra > Issue Type: Improvement > Components: Testing >Reporter: Michael Shuler >Assignee: Michael Shuler >Priority: Minor > Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x > > Attachments: > 0001-Parallelize-tests-and-install-word-list-in-circleci.patch > > > - Run 2 test runners, since circleci container has 2 vCPUs. > - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later > branches when test word list is unavailable. > I verified that compareBitSets passes again in a 2.1 run, and I have a trunk > test with 2 runners in progress. Will check run time, when that has completed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13414) circle.yml: parallelize tests and install word list
[ https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957110#comment-15957110 ] Michael Shuler commented on CASSANDRA-13414: My trunk test failed with 2 runners: {noformat} Failing command: ant test -Dtest.runners=2 Exit code: -1 Output: [junit] [junit] Testsuite: org.apache.cassandra.dht.RangeTest [junit] Testsuite: org.apache.cassandra.dht.SplitterTest [junit] Testsuite: org.apache.cassandra.dht.RangeTest Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.559 sec [junit] [junit] Testsuite: org.apache.cassandra.dht.StreamStateStoreTest [junit] Testsuite: org.apache.cassandra.dht.StreamStateStoreTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.841 sec [junit] [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/commitlog:210 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/data:210 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/saved_caches:210 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/hints:210 [junit] Testsuite: org.apache.cassandra.gms.ArrayBackedBoundedStatsTest [junit] Testsuite: org.apache.cassandra.gms.ArrayBackedBoundedStatsTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.351 sec [junit] [junit] Testsuite: org.apache.cassandra.dht.SplitterTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.766 sec [junit] [junit] Testsuite: org.apache.cassandra.gms.ArrivalWindowTest [junit] Testsuite: org.apache.cassandra.gms.ArrivalWindowTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.939 sec [junit] [junit] Testsuite: org.apache.cassandra.gms.EndpointStateTest [junit] Testsuite: org.apache.cassandra.gms.FailureDetectorTest [junit] Testsuite: org.apache.cassandra.gms.FailureDetectorTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.804 sec [junit] [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/commitlog:214 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/data:214 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/saved_caches:214 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/hints:214 [junit] Testsuite: org.apache.cassandra.gms.EndpointStateTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.87 sec [junit] [junit] Testsuite: org.apache.cassandra.gms.GossipDigestTest [junit] Testsuite: org.apache.cassandra.gms.GossipDigestTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.378 sec [junit] [junit] Testsuite: org.apache.cassandra.gms.PendingRangeCalculatorServiceTest [junit] Testsuite: org.apache.cassandra.gms.GossiperTest [junit] Testsuite: org.apache.cassandra.gms.GossiperTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.59 sec [junit] [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/commitlog:216 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/data:216 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/saved_caches:216 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/hints:216 [junit] Testsuite: org.apache.cassandra.gms.SerializationsTest [junit] Testsuite: org.apache.cassandra.gms.SerializationsTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.865 sec [junit] [junit] Testsuite: org.apache.cassandra.gms.PendingRangeCalculatorServiceTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.558 sec [junit] [junit] Testsuite: org.apache.cassandra.gms.ShadowRoundTest [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/commitlog:217 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/data:217 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/saved_caches:217 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/hints:217 [junit] Testsuite: org.apache.cassandra.hints.ChecksummedDataInputTest [junit] Testsuite: org.apache.cassandra.hints.ChecksummedDataInputTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.175 sec [junit] [junit] Testsuite: org.apache.cassandra.hints.HintMessageTest [junit] Testsuite: org.apache.cassandra.gms.ShadowRoundTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.446 sec [junit] [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/commitlog:219 [delete] Deleting directory /home/ubuntu/cassandra/build/test/cassandra/data:219 [delete] Deleting directory /home/ub
[jira] [Comment Edited] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession
[ https://issues.apache.org/jira/browse/CASSANDRA-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957104#comment-15957104 ] Michael Shuler edited comment on CASSANDRA-13416 at 4/5/17 3:59 PM: It looks like this was fixed in https://github.com/apache/cassandra/commit/633babf0f02fac56cad7bff03a4ff415feb38f39 was (Author: mshuler): I looks like this was fixed in https://github.com/apache/cassandra/commit/633babf0f02fac56cad7bff03a4ff415feb38f39 > Multiple test failures with NPE in > org.apache.cassandra.streaming.StreamSession > --- > > Key: CASSANDRA-13416 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13416 > Project: Cassandra > Issue Type: Bug >Reporter: Michael Shuler >Assignee: Michael Shuler >Priority: Critical > Labels: test-failure > Attachments: jenkins-trunk_testall-1491_logs.tar.gz > > > example failures: > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression > one example stack trace: > {code} > Stacktrace > java.lang.NullPointerException > at > org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244) > at > org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196) > at > org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293) > at > org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158) > at > org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94) > at > org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85) > at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75) > at > org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117) > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession
[ https://issues.apache.org/jira/browse/CASSANDRA-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler resolved CASSANDRA-13416. Resolution: Fixed I looks like this was fixed in https://github.com/apache/cassandra/commit/633babf0f02fac56cad7bff03a4ff415feb38f39 > Multiple test failures with NPE in > org.apache.cassandra.streaming.StreamSession > --- > > Key: CASSANDRA-13416 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13416 > Project: Cassandra > Issue Type: Bug >Reporter: Michael Shuler >Assignee: Michael Shuler >Priority: Critical > Labels: test-failure > Attachments: jenkins-trunk_testall-1491_logs.tar.gz > > > example failures: > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression > one example stack trace: > {code} > Stacktrace > java.lang.NullPointerException > at > org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244) > at > org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196) > at > org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293) > at > org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158) > at > org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94) > at > org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85) > at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75) > at > org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117) > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession
[ https://issues.apache.org/jira/browse/CASSANDRA-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler reassigned CASSANDRA-13416: -- Assignee: Michael Shuler > Multiple test failures with NPE in > org.apache.cassandra.streaming.StreamSession > --- > > Key: CASSANDRA-13416 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13416 > Project: Cassandra > Issue Type: Bug >Reporter: Michael Shuler >Assignee: Michael Shuler >Priority: Critical > Labels: test-failure > Attachments: jenkins-trunk_testall-1491_logs.tar.gz > > > example failures: > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression > http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression > one example stack trace: > {code} > Stacktrace > java.lang.NullPointerException > at > org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244) > at > org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196) > at > org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293) > at > org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158) > at > org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94) > at > org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85) > at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75) > at > org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117) > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13416) Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession
Michael Shuler created CASSANDRA-13416: -- Summary: Multiple test failures with NPE in org.apache.cassandra.streaming.StreamSession Key: CASSANDRA-13416 URL: https://issues.apache.org/jira/browse/CASSANDRA-13416 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Priority: Critical Attachments: jenkins-trunk_testall-1491_logs.tar.gz example failures: http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.dht/StreamStateStoreTest/testUpdateAndQueryAvailableRanges_compression http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/LocalSyncTaskTest/testDifference_compression http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/incrementalStreamPlan_compression http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.repair/StreamingRepairTaskTest/fullStreamPlan_compression http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testScheduleTimeout_compression http://cassci.datastax.com/job/trunk_testall/1491/testReport/org.apache.cassandra.streaming/StreamTransferTaskTest/testFailSessionDuringTransferShouldNotReleaseReferences_compression one example stack trace: {code} Stacktrace java.lang.NullPointerException at org.apache.cassandra.streaming.StreamSession.isKeepAliveSupported(StreamSession.java:244) at org.apache.cassandra.streaming.StreamSession.(StreamSession.java:196) at org.apache.cassandra.streaming.StreamCoordinator$HostStreamingData.getOrCreateNextSession(StreamCoordinator.java:293) at org.apache.cassandra.streaming.StreamCoordinator.getOrCreateNextSession(StreamCoordinator.java:158) at org.apache.cassandra.streaming.StreamPlan.requestRanges(StreamPlan.java:94) at org.apache.cassandra.repair.LocalSyncTask.startSync(LocalSyncTask.java:85) at org.apache.cassandra.repair.SyncTask.run(SyncTask.java:75) at org.apache.cassandra.repair.LocalSyncTaskTest.testDifference(LocalSyncTaskTest.java:117) {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13415) test failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.getNextBackgroundTask-compression
Michael Shuler created CASSANDRA-13415: -- Summary: test failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.getNextBackgroundTask-compression Key: CASSANDRA-13415 URL: https://issues.apache.org/jira/browse/CASSANDRA-13415 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: TEST-org.apache.cassandra.db.compaction.PendingRepairManagerTest.log example failure: http://cassci.datastax.com/job/trunk_testall/1490/testReport/org.apache.cassandra.db.compaction/PendingRepairManagerTest/getNextBackgroundTask_compression {code} Stacktrace junit.framework.AssertionFailedError at org.apache.cassandra.db.compaction.PendingRepairManagerTest.getNextBackgroundTask(PendingRepairManagerTest.java:155) Standard Output ERROR [main] 2017-04-03 20:02:09,109 SubstituteLogger.java:250 - SLF4J: stderr INFO [main] 2017-04-03 20:02:09,474 YamlConfigurationLoader.java:89 - Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml DEBUG [main] 2017-04-03 20:02:09,477 YamlConfigurationLoader.java:108 - Loading settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml INFO [main] 2017-04-03 20:02:11,007 Config.java:454 - Node configuration:[allocate_tokens_for_keyspace=null; authentica ...[truncated 84651 chars]... position=21545) DEBUG [MemtableFlushWriter:2] 2017-04-03 20:02:19,371 ColumnFamilyStore.java:1226 - Flushed to [BigTableReader(path='/home/automaton/cassandra/build/test/cassandra/data:165/ks_1491249739206/tbl-7145c66018a811e7b0c3bf9fab0791de/na-1-big-Data.db')] (1 sstables, 4.760KiB), biggest 4.760KiB, smallest 4.760KiB DEBUG [main] 2017-04-03 20:02:19,374 PendingRepairManager.java:101 - Creating ks_1491249739206.tbl compaction strategy for pending repair: 715a11b0-18a8-11e7-b0c3-bf9fab0791de {code} possibly related to CASSANDRA-13224 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list
[ https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13414: --- Component/s: Testing > circle.yml: parallelize tests and install word list > --- > > Key: CASSANDRA-13414 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13414 > Project: Cassandra > Issue Type: Improvement > Components: Testing >Reporter: Michael Shuler >Assignee: Michael Shuler >Priority: Minor > Fix For: 4.0, 2.1.x, 2.2.x, 3.0.x, 3.11.x > > Attachments: > 0001-Parallelize-tests-and-install-word-list-in-circleci.patch > > > - Run 2 test runners, since circleci container has 2 vCPUs. > - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later > branches when test word list is unavailable. > I verified that compareBitSets passes again in a 2.1 run, and I have a trunk > test with 2 runners in progress. Will check run time, when that has completed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list
[ https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13414: --- Fix Version/s: 3.11.x 3.0.x 2.2.x 2.1.x 4.0 > circle.yml: parallelize tests and install word list > --- > > Key: CASSANDRA-13414 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13414 > Project: Cassandra > Issue Type: Improvement >Reporter: Michael Shuler >Assignee: Michael Shuler >Priority: Minor > Fix For: 4.0, 2.1.x, 2.2.x, 3.0.x, 3.11.x > > Attachments: > 0001-Parallelize-tests-and-install-word-list-in-circleci.patch > > > - Run 2 test runners, since circleci container has 2 vCPUs. > - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later > branches when test word list is unavailable. > I verified that compareBitSets passes again in a 2.1 run, and I have a trunk > test with 2 runners in progress. Will check run time, when that has completed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13414) circle.yml: parallelize tests and install word list
[ https://issues.apache.org/jira/browse/CASSANDRA-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13414: --- Attachment: 0001-Parallelize-tests-and-install-word-list-in-circleci.patch > circle.yml: parallelize tests and install word list > --- > > Key: CASSANDRA-13414 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13414 > Project: Cassandra > Issue Type: Improvement >Reporter: Michael Shuler >Assignee: Michael Shuler >Priority: Minor > Attachments: > 0001-Parallelize-tests-and-install-word-list-in-circleci.patch > > > - Run 2 test runners, since circleci container has 2 vCPUs. > - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later > branches when test word list is unavailable. > I verified that compareBitSets passes again in a 2.1 run, and I have a trunk > test with 2 runners in progress. Will check run time, when that has completed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13414) circle.yml: parallelize tests and install word list
Michael Shuler created CASSANDRA-13414: -- Summary: circle.yml: parallelize tests and install word list Key: CASSANDRA-13414 URL: https://issues.apache.org/jira/browse/CASSANDRA-13414 Project: Cassandra Issue Type: Improvement Reporter: Michael Shuler Assignee: Michael Shuler Priority: Minor - Run 2 test runners, since circleci container has 2 vCPUs. - o.a.c.utils.BitSetTest.compareBitSets fails in 2.1 and is skipped in later branches when test word list is unavailable. I verified that compareBitSets passes again in a 2.1 run, and I have a trunk test with 2 runners in progress. Will check run time, when that has completed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13394) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_0_x.bootstrap_multidc_test
Michael Shuler created CASSANDRA-13394: -- Summary: test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_0_x.bootstrap_multidc_test Key: CASSANDRA-13394 URL: https://issues.apache.org/jira/browse/CASSANDRA-13394 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, node3.log, node4_debug.log, node4_gc.log, node4.log example failure: http://cassci.datastax.com/job/cassandra-3.0_large_dtest/60/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_1_x_To_indev_3_0_x/bootstrap_multidc_test {code} Error Message errors={: ReadTimeout('Error from server: code=1200 [Coordinator node timed out waiting for replica nodes\' responses] message="Operation timed out - received only 2 responses." info={\'received_responses\': 2, \'required_responses\': 3, \'consistency\': \'ALL\'}',)}, last_host=127.0.0.2 {code} {code} Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 716, in bootstrap_multidc_test self.upgrade_scenario(populate=False, create_schema=False, after_upgrade_call=(self._bootstrap_new_node_multidc,)) File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 370, in upgrade_scenario self._check_values() File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 508, in _check_values result = session.execute(query) File "/home/automaton/venv/src/cassandra-driver/cassandra/cluster.py", line 2012, in execute return self.execute_async(query, parameters, trace, custom_payload, timeout, execution_profile, paging_state).result() File "/home/automaton/venv/src/cassandra-driver/cassandra/cluster.py", line 3801, in result raise self._final_exception 'errors={: ReadTimeout(\'Error from server: code=1200 [Coordinator node timed out waiting for replica nodes\\\' responses] message="Operation timed out - received only 2 responses." info={\\\'received_responses\\\': 2, \\\'required_responses\\\': 3, \\\'consistency\\\': \\\'ALL\\\'}\',)}, last_host=127.0.0.2 {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13216) testall failure in org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages
[ https://issues.apache.org/jira/browse/CASSANDRA-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13216: --- Attachment: TEST-org.apache.cassandra.net.MessagingServiceTest.log new log from above attached > testall failure in > org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages > > > Key: CASSANDRA-13216 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13216 > Project: Cassandra > Issue Type: Bug > Components: Testing >Reporter: Sean McCarthy >Assignee: Alex Petrov > Labels: test-failure, testall > Fix For: 3.0.13, 3.11.0, 4.0 > > Attachments: TEST-org.apache.cassandra.net.MessagingServiceTest.log, > TEST-org.apache.cassandra.net.MessagingServiceTest.log > > > example failure: > http://cassci.datastax.com/job/cassandra-3.11_testall/81/testReport/org.apache.cassandra.net/MessagingServiceTest/testDroppedMessages > {code} > Error Message > expected:<... dropped latency: 27[30 ms and Mean cross-node dropped latency: > 2731] ms> but was:<... dropped latency: 27[28 ms and Mean cross-node dropped > latency: 2730] ms> > {code}{code} > Stacktrace > junit.framework.AssertionFailedError: expected:<... dropped latency: 27[30 ms > and Mean cross-node dropped latency: 2731] ms> but was:<... dropped latency: > 27[28 ms and Mean cross-node dropped latency: 2730] ms> > at > org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages(MessagingServiceTest.java:83) > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Reopened] (CASSANDRA-13216) testall failure in org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages
[ https://issues.apache.org/jira/browse/CASSANDRA-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler reopened CASSANDRA-13216: Reopening, since this was so recent. Trunk run that just finished recently shows a similar error on http://cassci.datastax.com/job/trunk_testall/1477/testReport/org.apache.cassandra.net/MessagingServiceTest/testDroppedMessages_compression/ {noformat} Error Message expected:<...dropped latency: 227[8] ms> but was:<...dropped latency: 227[7] ms> Stacktrace junit.framework.AssertionFailedError: expected:<...dropped latency: 227[8] ms> but was:<...dropped latency: 227[7] ms> at org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages(MessagingServiceTest.java:114) Standard Output ERROR [main] 2017-03-28 11:07:24,199 SubstituteLogger.java:250 - SLF4J: stderr INFO [main] 2017-03-28 11:07:24,668 YamlConfigurationLoader.java:89 - Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml DEBUG [main] 2017-03-28 11:07:24,669 YamlConfigurationLoader.java:108 - Loading settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml INFO [main] 2017-03-28 11:07:25,547 Config.java:446 - Node configuration:[allocate_tokens_for_keyspace=null; authentica ...[truncated 10545 chars]... close for /127.0.0.250 DEBUG [main] 2017-03-28 11:07:28,551 MessagingService.java:698 - Not resetting pool for /127.0.0.250 because internode authenticator said not to connect DEBUG [main] 2017-03-28 11:07:28,583 OutboundTcpConnection.java:184 - Enqueuing socket close for /127.0.0.2 DEBUG [main] 2017-03-28 11:07:28,583 OutboundTcpConnection.java:184 - Enqueuing socket close for /127.0.0.2 DEBUG [main] 2017-03-28 11:07:28,584 OutboundTcpConnection.java:184 - Enqueuing socket close for /127.0.0.2 {noformat} > testall failure in > org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages > > > Key: CASSANDRA-13216 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13216 > Project: Cassandra > Issue Type: Bug > Components: Testing >Reporter: Sean McCarthy >Assignee: Alex Petrov > Labels: test-failure, testall > Fix For: 3.0.13, 3.11.0, 4.0 > > Attachments: TEST-org.apache.cassandra.net.MessagingServiceTest.log > > > example failure: > http://cassci.datastax.com/job/cassandra-3.11_testall/81/testReport/org.apache.cassandra.net/MessagingServiceTest/testDroppedMessages > {code} > Error Message > expected:<... dropped latency: 27[30 ms and Mean cross-node dropped latency: > 2731] ms> but was:<... dropped latency: 27[28 ms and Mean cross-node dropped > latency: 2730] ms> > {code}{code} > Stacktrace > junit.framework.AssertionFailedError: expected:<... dropped latency: 27[30 ms > and Mean cross-node dropped latency: 2731] ms> but was:<... dropped latency: > 27[28 ms and Mean cross-node dropped latency: 2730] ms> > at > org.apache.cassandra.net.MessagingServiceTest.testDroppedMessages(MessagingServiceTest.java:83) > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13377) test failure in org.apache.cassandra.service.RemoveTest.testLocalHostId-compression
Michael Shuler created CASSANDRA-13377: -- Summary: test failure in org.apache.cassandra.service.RemoveTest.testLocalHostId-compression Key: CASSANDRA-13377 URL: https://issues.apache.org/jira/browse/CASSANDRA-13377 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: jenkins-cassandra-3.11_testall-124_logs.tar.gz example failure: http://cassci.datastax.com/job/cassandra-3.11_testall/124/testReport/org.apache.cassandra.service/RemoveTest/testLocalHostId_compression {noformat} Stacktrace java.lang.NullPointerException at org.apache.cassandra.gms.Gossiper.getHostId(Gossiper.java:881) at org.apache.cassandra.gms.Gossiper.getHostId(Gossiper.java:876) at org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:2275) at org.apache.cassandra.service.StorageService.onChange(StorageService.java:1928) at org.apache.cassandra.Util.createInitialRing(Util.java:222) at org.apache.cassandra.service.RemoveTest.setup(RemoveTest.java:89) Standard Output ERROR [main] 2017-03-23 21:27:05,889 SubstituteLogger.java:250 - SLF4J: stderr INFO [main] 2017-03-23 21:27:06,238 YamlConfigurationLoader.java:89 - Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml DEBUG [main] 2017-03-23 21:27:06,241 YamlConfigurationLoader.java:108 - Loading settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml INFO [main] 2017-03-23 21:27:07,506 Config.java:475 - Node configuration:[allocate_tokens_for_keyspace=null; authentica ...[truncated 176636 chars]... ain] 2017-03-23 21:27:16,054 YamlConfigurationLoader.java:108 - Loading settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml DEBUG [main] 2017-03-23 21:27:16,059 StorageService.java:2171 - Node /127.0.0.5 state bootstrapping, token [31359799266797610263756179790339965311] INFO [main] 2017-03-23 21:27:16,059 StorageService.java:2184 - Node /127.0.0.5 state jump to bootstrap INFO [main] 2017-03-23 21:27:16,059 MessagingService.java:979 - Waiting for messaging service to quiesce {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13376) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test
Michael Shuler created CASSANDRA-13376: -- Summary: test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test Key: CASSANDRA-13376 URL: https://issues.apache.org/jira/browse/CASSANDRA-13376 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, node3.log example failure: http://cassci.datastax.com/job/cassandra-3.11_large_dtest/25/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_3_x_To_indev_3_x/rolling_upgrade_with_internode_ssl_test {noformat} Error Message Ran out of time waiting for queue size (1) to be 'le' to 0. Aborting. Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 291, in rolling_upgrade_with_internode_ssl_test self.upgrade_scenario(rolling=True, internode_ssl=True) File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 356, in upgrade_scenario self._wait_until_queue_condition('writes pending verification', verification_queue, operator.le, 0, max_wait_s=1200) File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 541, in _wait_until_queue_condition raise RuntimeError("Ran out of time waiting for queue size ({}) to be '{}' to {}. Aborting.".format(qsize, opfunc.__name__, required_len)) "Ran out of time waiting for queue size (1) to be 'le' to 0. Aborting. {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932785#comment-15932785 ] Michael Shuler commented on CASSANDRA-13230: Luke, see CASSANDRA-13252 > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0 > > Attachments: 13230.patch > > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-12967) Spec for Cassandra RPM Build
[ https://issues.apache.org/jira/browse/CASSANDRA-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932778#comment-15932778 ] Michael Shuler commented on CASSANDRA-12967: {{cqlsh}} requires python-2.7. If that can be satisfied by a savvy user prior to installation, so the dependency is met, then installation should work. I've tried using "supported" third-party python-2.7 packages from SCL on CentOS-6.something and it can be excruciatingly painful. My suggestion would be to just use RHEL/CentOS-7. > Spec for Cassandra RPM Build > > > Key: CASSANDRA-12967 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12967 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Bhuvan Rawal >Assignee: Michael Shuler > Fix For: 2.1.17, 2.2.9, 3.0.11, 3.10, 4.0 > > > Currently there is no RPM packaging for cassandra community. We tried > creating a RPM build for cassandra 3.0.9 using cassandra spec found in > https://github.com/riptano/cassandra-rpm, but we found some incompatibilities > as the spec was meant for 2.X versions. > It would be great to have a community RPM build for cassandra, with the > recommended cassandra recommendations and tools. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-12748) Cassandra fails to start up if GREP_COLOR is set
[ https://issues.apache.org/jira/browse/CASSANDRA-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932768#comment-15932768 ] Michael Shuler commented on CASSANDRA-12748: Unsetting {{GREP_COLOR}} seems like a reasonable fix. Thanks! > Cassandra fails to start up if GREP_COLOR is set > > > Key: CASSANDRA-12748 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12748 > Project: Cassandra > Issue Type: Bug >Reporter: Benjamin Roth >Priority: Minor > > If env var GREP_COLOR is set, CS fails to start as startup command then > contains ANSI codes. > See cassandra-env.sh when JVM_OPTS_FILE is parsed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-12748) Cassandra fails to start up if GREP_COLOR is set
[ https://issues.apache.org/jira/browse/CASSANDRA-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-12748: --- Summary: Cassandra fails to start up if GREP_COLOR is set (was: CS fails to start up if GREP_COLOR is set) > Cassandra fails to start up if GREP_COLOR is set > > > Key: CASSANDRA-12748 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12748 > Project: Cassandra > Issue Type: Bug >Reporter: Benjamin Roth >Priority: Minor > > If env var GREP_COLOR is set, CS fails to start as startup command then > contains ANSI codes. > See cassandra-env.sh when JVM_OPTS_FILE is parsed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13269) Snapshot support for custom secondary indices
[ https://issues.apache.org/jira/browse/CASSANDRA-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13269: --- Fix Version/s: (was: 3.0.12) (was: 3.11.0) 3.11.x 3.0.x > Snapshot support for custom secondary indices > - > > Key: CASSANDRA-13269 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13269 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: vincent royer >Priority: Trivial > Labels: features > Fix For: 3.0.x, 3.11.x > > Attachments: 0001-CASSANDRA-13269-custom-indices-snapshot.patch > > > Enhance the index API to support snapshot of custom secondary indices. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13270) Add function hooks to deliver Elasticsearch as a Cassandra plugin
[ https://issues.apache.org/jira/browse/CASSANDRA-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13270: --- Fix Version/s: (was: 3.0.12) (was: 3.11.0) 4.x > Add function hooks to deliver Elasticsearch as a Cassandra plugin > - > > Key: CASSANDRA-13270 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13270 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: vincent royer >Priority: Minor > Labels: features > Fix For: 4.x > > Attachments: 0001-CASSANDRA-13270-elasticsearch-as-a-plugin.patch > > Original Estimate: 1h > Remaining Estimate: 1h > > With these basic modifications (see the patch) and the following tickets, the > Elassandra project (see https://github.com/strapdata/elassandra) could be an > Elasticsearch plugin for Cassandra. > * CASSANDRA-12837 Add multi-threaded support to nodetool rebuild_index. > * CASSANDRA-13267 Add CQL functions. > * CASSANDRA-13268 Allow to create custom secondary index on static columns. > * CASSANDRA-13269 Snapshot support for custom secondary indices -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13294) Possible data loss on upgrade 2.1 - 3.0
[ https://issues.apache.org/jira/browse/CASSANDRA-13294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898736#comment-15898736 ] Michael Shuler commented on CASSANDRA-13294: Thanks all! I started all the cassandra-3.0 branch tests on commit {{1ba68a1}} and will check on them in the morning for a look at a release. > Possible data loss on upgrade 2.1 - 3.0 > --- > > Key: CASSANDRA-13294 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13294 > Project: Cassandra > Issue Type: Bug > Components: Local Write-Read Paths >Reporter: Marcus Eriksson >Assignee: Stefania >Priority: Blocker > Fix For: 3.0.12, 3.11.0 > > > After finishing a compaction we delete the compacted away files. This is done > [here|https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/db/lifecycle/LogFile.java#L328-L337] > which uses > [this|https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/db/lifecycle/LogRecord.java#L265-L271] > to get the files - we get all files starting with {{absoluteFilePath}}. > Absolute file path is generated > [here|https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/io/sstable/Descriptor.java#L142-L153]. > For 3.0 version files the filename looks like this: > {{/blabla/keyspace1/standard1-bdb031c0ff7b11e6940fdd0479dd8912/mc-1332-big}} > but for 2.1 version files, they look like this: > {{/blabla/keyspace1/standard1-bdb031c0ff7b11e6940fdd0479dd8912/keyspace1-standard1-ka-2}}. > The problem is then that if we were to finish a compaction including the > legacy file, we would actually delete all legacy files having a generation > starting with '2' -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13090) Coalescing strategy sleeps too much
[ https://issues.apache.org/jira/browse/CASSANDRA-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13090: --- Fix Version/s: (was: 3.0.11) 3.0.12 > Coalescing strategy sleeps too much > --- > > Key: CASSANDRA-13090 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13090 > Project: Cassandra > Issue Type: Bug > Components: Streaming and Messaging >Reporter: Corentin Chary >Assignee: Corentin Chary > Fix For: 2.2.10, 3.0.12, 3.11.0, 4.0 > > Attachments: 0001-Fix-wait-time-coalescing-CASSANDRA-13090-2.patch, > 0001-Fix-wait-time-coalescing-CASSANDRA-13090.patch > > > With the current code maybeSleep is called even if we managed to take > maxItems out of the backlog. In this case we should really avoid sleeping > because it means that backlog is building up. > I'll send a patch shortly. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13296) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_0_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test
Michael Shuler created CASSANDRA-13296: -- Summary: test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_3_0_x_To_indev_3_x.rolling_upgrade_with_internode_ssl_test Key: CASSANDRA-13296 URL: https://issues.apache.org/jira/browse/CASSANDRA-13296 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, node3.log example failure: http://cassci.datastax.com/job/cassandra-3.11_large_dtest/22/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_3_0_x_To_indev_3_x/rolling_upgrade_with_internode_ssl_test {code} Error Message Ran out of time waiting for queue size (1) to be 'le' to 0. Aborting. Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 291, in rolling_upgrade_with_internode_ssl_test self.upgrade_scenario(rolling=True, internode_ssl=True) File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 356, in upgrade_scenario self._wait_until_queue_condition('writes pending verification', verification_queue, operator.le, 0, max_wait_s=1200) File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 541, in _wait_until_queue_condition raise RuntimeError("Ran out of time waiting for queue size ({}) to be '{}' to {}. Aborting.".format(qsize, opfunc.__name__, required_len)) {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13295) test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_x.bootstrap_test
Michael Shuler created CASSANDRA-13295: -- Summary: test failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_1_x_To_indev_3_x.bootstrap_test Key: CASSANDRA-13295 URL: https://issues.apache.org/jira/browse/CASSANDRA-13295 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, node3.log, node4_debug.log, node4_gc.log, node4.log example failure: http://cassci.datastax.com/job/cassandra-3.11_large_dtest/22/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_1_x_To_indev_3_x/bootstrap_test {code} Error Message 03 Mar 2017 12:58:17 [node2] Missing: ['127.0.0.4.* now UP']: INFO [HANDSHAKE-/127.0.0.4] 2017-03-03 12:54:12,1. See system.log for remainder Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 700, in bootstrap_test self.upgrade_scenario(after_upgrade_call=(self._bootstrap_new_node,)) File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 376, in upgrade_scenario call() File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 681, in _bootstrap_new_node nnode.start(use_jna=True, wait_other_notice=240, wait_for_binary_proto=True) File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", line 686, in start node.watch_log_for_alive(self, from_mark=mark, timeout=wait_other_notice) File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", line 503, in watch_log_for_alive self.watch_log_for(tofind, from_mark=from_mark, timeout=timeout, filename=filename) File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", line 471, in watch_log_for raise TimeoutError(time.strftime("%d %b %Y %H:%M:%S", time.gmtime()) + " [" + self.name + "] Missing: " + str([e.pattern for e in tofind]) + ":\n" + reads[:50] + ".\nSee {} for remainder".format(filename)) {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13278) Update build.xml and build.properties.default maven repos
[ https://issues.apache.org/jira/browse/CASSANDRA-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890669#comment-15890669 ] Michael Shuler commented on CASSANDRA-13278: +1 Thanks! > Update build.xml and build.properties.default maven repos > - > > Key: CASSANDRA-13278 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13278 > Project: Cassandra > Issue Type: Bug > Components: Build >Reporter: Michael Shuler >Assignee: Robert Stupp >Priority: Minor > Labels: lhf > Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x > > > Only 2 of the 5 urls in build.properties.default are currently valid. > java.net2, jclouds, and oauth urls all 404. > {noformat} > $ git grep remoteRepository > build.properties.default:artifact.remoteRepository.central: > http://repo1.maven.org/maven2 > build.properties.default:artifact.remoteRepository.java.net2: > http://download.java.net/maven/2 > build.properties.default:artifact.remoteRepository.apache: > https://repository.apache.org/content/repositories/releases > build.properties.default:artifact.remoteRepository.jclouds: > http://jclouds.googlecode.com/svn/repo > build.properties.default:artifact.remoteRepository.oauth: > http://oauth.googlecode.com/svn/code/maven > build.xml: url="${artifact.remoteRepository.central}"/> > build.xml: url="${artifact.remoteRepository.java.net2}"/> > build.xml: url="${artifact.remoteRepository.apache}"/> > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13278) Update build.xml and build.properties.default maven repos
[ https://issues.apache.org/jira/browse/CASSANDRA-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13278: --- Labels: lhf (was: ) > Update build.xml and build.properties.default maven repos > - > > Key: CASSANDRA-13278 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13278 > Project: Cassandra > Issue Type: Bug > Components: Build >Reporter: Michael Shuler >Priority: Minor > Labels: lhf > Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x > > > Only 2 of the 5 urls in build.properties.default are currently valid. > java.net2, jclouds, and oauth urls all 404. > {noformat} > $ git grep remoteRepository > build.properties.default:artifact.remoteRepository.central: > http://repo1.maven.org/maven2 > build.properties.default:artifact.remoteRepository.java.net2: > http://download.java.net/maven/2 > build.properties.default:artifact.remoteRepository.apache: > https://repository.apache.org/content/repositories/releases > build.properties.default:artifact.remoteRepository.jclouds: > http://jclouds.googlecode.com/svn/repo > build.properties.default:artifact.remoteRepository.oauth: > http://oauth.googlecode.com/svn/code/maven > build.xml: url="${artifact.remoteRepository.central}"/> > build.xml: url="${artifact.remoteRepository.java.net2}"/> > build.xml: url="${artifact.remoteRepository.apache}"/> > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > build.xml: > {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13278) Update build.xml and build.properties.default maven repos
Michael Shuler created CASSANDRA-13278: -- Summary: Update build.xml and build.properties.default maven repos Key: CASSANDRA-13278 URL: https://issues.apache.org/jira/browse/CASSANDRA-13278 Project: Cassandra Issue Type: Bug Components: Build Reporter: Michael Shuler Priority: Minor Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x, 4.x Only 2 of the 5 urls in build.properties.default are currently valid. java.net2, jclouds, and oauth urls all 404. {noformat} $ git grep remoteRepository build.properties.default:artifact.remoteRepository.central: http://repo1.maven.org/maven2 build.properties.default:artifact.remoteRepository.java.net2: http://download.java.net/maven/2 build.properties.default:artifact.remoteRepository.apache: https://repository.apache.org/content/repositories/releases build.properties.default:artifact.remoteRepository.jclouds: http://jclouds.googlecode.com/svn/repo build.properties.default:artifact.remoteRepository.oauth: http://oauth.googlecode.com/svn/code/maven build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: build.xml: {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13090) Coalescing strategy sleeps too much
[ https://issues.apache.org/jira/browse/CASSANDRA-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886058#comment-15886058 ] Michael Shuler commented on CASSANDRA-13090: The CHANGE.txt entry for this ticket is under the incorrect releases in the cassandra-2.2, cassandra-3.0, cassandra-3.11, and trunk branches. This was committed during release votes were -tentative tagged. The JIRA fix versions for 2.2.x and 3.0.x should be corrected, as well, since this commit should be listed in CHANGES.txt under: - 2.2.10 (currently under 2.2.9) - 3.0.12 (currently under 3.0.11) - 3.11.0 (currently under 3.10 in both cassandra-3.11 and trunk branches CHANGES.txt) > Coalescing strategy sleeps too much > --- > > Key: CASSANDRA-13090 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13090 > Project: Cassandra > Issue Type: Bug > Components: Streaming and Messaging >Reporter: Corentin Chary >Assignee: Corentin Chary > Fix For: 2.2.9, 3.0.11, 3.11.0, 4.0 > > Attachments: 0001-Fix-wait-time-coalescing-CASSANDRA-13090-2.patch, > 0001-Fix-wait-time-coalescing-CASSANDRA-13090.patch > > > With the current code maybeSleep is called even if we managed to take > maxItems out of the backlog. In this case we should really avoid sleeping > because it means that backlog is building up. > I'll send a patch shortly. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-6246: -- Fix Version/s: (was: 3.11.x) 4.x > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879599#comment-15879599 ] Michael Shuler commented on CASSANDRA-13230: That is an excellent question. I'm not entirely sure, since this is not in the cassandra repo, but in cassandra-builds. Once things are worked out for inclusion, I see no reason we can't build for all the releases 2.1+ that we're still committing to, so I'll add all those current versions. Thanks! > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0 > > Attachments: 13230.patch > > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13230: --- Fix Version/s: 4.0 3.11.0 3.0.12 2.2.10 2.1.18 > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > Fix For: 2.1.18, 2.2.10, 3.0.12, 3.11.0, 4.0 > > Attachments: 13230.patch > > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13230: --- Resolution: Fixed Status: Resolved (was: Ready to Commit) I committed a couple fixes and we have packages! I really appreciate your help. Going to call this ticket done and we can work on CASSANDRA-13252 for inclusion. {code} (master)mshuler@hana:~/git/cassandra-builds$ ls -l dist/ total 324980 -rw-r--r-- 1 mshuler mshuler 27039356 Feb 22 10:49 cassandra-4.0-1.noarch.rpm -rw-r--r-- 1 mshuler mshuler 30471871 Feb 22 10:49 cassandra-4.0-1.src.rpm -rw-r--r-- 1 mshuler mshuler 5268 Feb 22 10:49 cassandra-tools-4.0-1.noarch.rpm -rw-r--r-- 1 mshuler mshuler 4584 Feb 22 10:50 cassandra-tools_4.0_all.deb -rw-r--r-- 1 mshuler mshuler 903 Feb 22 10:50 cassandra_4.0.dsc -rw-r--r-- 1 mshuler mshuler 248183858 Feb 22 10:50 cassandra_4.0.tar.gz -rw-r--r-- 1 mshuler mshuler 27043084 Feb 22 10:50 cassandra_4.0_all.deb -rw-r--r-- 1 mshuler mshuler 1493 Feb 22 10:50 cassandra_4.0_amd64.changes {code} > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > Attachments: 13230.patch > > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13230: --- Status: Ready to Commit (was: Patch Available) > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > Attachments: 13230.patch > > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13252) Include RPM packages in releases
Michael Shuler created CASSANDRA-13252: -- Summary: Include RPM packages in releases Key: CASSANDRA-13252 URL: https://issues.apache.org/jira/browse/CASSANDRA-13252 Project: Cassandra Issue Type: New Feature Components: Packaging Reporter: Michael Shuler Assignee: Michael Shuler CASSANDRA-13230 sets up docker builds for deb and rpm packages out of the {{cassandra-builds}} git repo. We should now be able to do builds in CI, at least for build testing of snapshot packages. In order to include in releases, we may wish to set up bintray for RPMs in a {{redhat/}} dir, similar to the current {{debian/}} dir redirect from cassandra-dist, or start with direct downloads from cassandra-dist and see how it goes. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878418#comment-15878418 ] Michael Shuler commented on CASSANDRA-13230: Great, thanks! Committed to master. I'll do a trial run and then see if we can get builds working right in CI. Much appreciated. > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > Attachments: 13230.patch > > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872023#comment-15872023 ] Michael Shuler commented on CASSANDRA-13230: Historical precedent :) I'm not sure of the possible differences between Oracle and OpenJDK javac bytecode, but will ask around. Using OpenJDK does make build dependency install much simpler and maintainable in the long run, so I'm happy to give it a shot. > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15871937#comment-15871937 ] Michael Shuler commented on CASSANDRA-13230: Sounds great! Those scripts were only a start on what dependencies needed to be installed to get through a build successfully and I never got back to them to work out a shared volume to drop the packages in when complete. Your suggestion is exactly what I was thinking. > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler >Assignee: Stefan Podkowinski > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13230) Build RPM packages for release
[ https://issues.apache.org/jira/browse/CASSANDRA-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13230: --- Description: Currently, releases are built locally on Debian/Ubuntu based machines, without native support for building RPM packages. This can be done with a docker image. The current cassandra-release scripts are here (please, do not randomly run and push tags..): https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release A couple incomplete docker run scripts are here: https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip {code} git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git {code} Patches for build infra improvements are welcome! /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to review :) was: Currently, releases are built locally on Debian/Ubuntu based machines, without native support for building RPM packages. This can be done with a docker image. The current cassandra-release scripts are here (please, do not randomly run and push tags..): https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release A couple incomplete docker run scripts are here: https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip Patches for build infra improvements are welcome! /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to review :) > Build RPM packages for release > -- > > Key: CASSANDRA-13230 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 > Project: Cassandra > Issue Type: New Feature > Components: Packaging >Reporter: Michael Shuler > > Currently, releases are built locally on Debian/Ubuntu based machines, > without native support for building RPM packages. This can be done with a > docker image. > The current cassandra-release scripts are here (please, do not randomly run > and push tags..): > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release > A couple incomplete docker run scripts are here: > https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip > {code} > git clone https://git-wip-us.apache.org/repos/asf/cassandra-builds.git > {code} > Patches for build infra improvements are welcome! > /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to > review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13230) Build RPM packages for release
Michael Shuler created CASSANDRA-13230: -- Summary: Build RPM packages for release Key: CASSANDRA-13230 URL: https://issues.apache.org/jira/browse/CASSANDRA-13230 Project: Cassandra Issue Type: New Feature Components: Packaging Reporter: Michael Shuler Currently, releases are built locally on Debian/Ubuntu based machines, without native support for building RPM packages. This can be done with a docker image. The current cassandra-release scripts are here (please, do not randomly run and push tags..): https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=cassandra-release A couple incomplete docker run scripts are here: https://git-wip-us.apache.org/repos/asf?p=cassandra-builds.git;a=tree;f=docker-wip Patches for build infra improvements are welcome! /cc [~spo...@gmail.com] if you want to assign to yourself, I'd be happy to review :) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13211: --- Resolution: Fixed Status: Resolved (was: Patch Available) Commit {{cb090791c3d16011665f0f56afd66bbce2a0e40f}} pushed to cassandra-2.1 and up. Thanks! > Use portable stderr for java error in startup > - > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher >Assignee: Michael Shuler > Fix For: 2.1.17, 2.2.9, 3.0.11, 3.11.0, 4.0 > > Attachments: 13211_use-portable-stderr.patch > > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13211: --- Fix Version/s: (was: 2.1.x) 4.0 3.11.0 3.0.11 2.2.9 2.1.17 > Use portable stderr for java error in startup > - > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher >Assignee: Michael Shuler > Fix For: 2.1.17, 2.2.9, 3.0.11, 3.11.0, 4.0 > > Attachments: 13211_use-portable-stderr.patch > > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-12837) Add multi-threaded support to nodetool rebuild_index
[ https://issues.apache.org/jira/browse/CASSANDRA-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-12837: --- Fix Version/s: (was: 2.2.9) 4.x > Add multi-threaded support to nodetool rebuild_index > > > Key: CASSANDRA-12837 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12837 > Project: Cassandra > Issue Type: Improvement > Components: Core >Reporter: vincent royer >Priority: Minor > Labels: patch > Fix For: 4.x > > Attachments: CASSANDRA-12837-2.2.9.txt > > > Add multi-thread nodetool rebuild_index to improve performances. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13220) test failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_2_0_x_To_indev_2_1_x.ticket_5230_test
Michael Shuler created CASSANDRA-13220: -- Summary: test failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_2_0_x_To_indev_2_1_x.ticket_5230_test Key: CASSANDRA-13220 URL: https://issues.apache.org/jira/browse/CASSANDRA-13220 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1.log, node2.log, node3.log example failure: http://cassci.datastax.com/job/cassandra-2.1_dtest_upgrade/21/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_2_0_x_To_indev_2_1_x/ticket_5230_test {noformat} Error Message Unexpected error in log, see stdout >> begin captured logging << dtest: DEBUG: Upgrade test beginning, setting CASSANDRA_VERSION to 2.0.17, and jdk to 7. (Prior values will be restored after test). dtest: DEBUG: Switching jdk to version 7 (JAVA_HOME is changing from /usr/lib/jvm/jdk1.8.0_51 to /usr/lib/jvm/jdk1.7.0_80) dtest: DEBUG: cluster ccm directory: /tmp/dtest-NvCzEj dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} cassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered dtest: DEBUG: upgrading node1 to github:apache/a6237bf65a95d654b7e702e81fd0d353460d0c89 dtest: DEBUG: Switching jdk to version 8 (JAVA_HOME is changing from /usr/lib/jvm/jdk1.7.0_80 to /usr/lib/jvm/jdk1.8.0_51) ccm: INFO: Fetching Cassandra updates... cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered dtest: DEBUG: Querying upgraded node dtest: DEBUG: Querying old node dtest: DEBUG: removing ccm cluster test at: /tmp/dtest-NvCzEj dtest: DEBUG: clearing ssl stores from [/tmp/dtest-NvCzEj] directory - >> end captured logging << - {noformat} {noformat} Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 358, in run self.tearDown() File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_base.py", line 219, in tearDown super(UpgradeTester, self).tearDown() File "/home/automaton/cassandra-dtest/dtest.py", line 593, in tearDown raise AssertionError('Unexpected error in log, see stdout') {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13219) Cassandra.yaml now unicode instead of ascii after 13090
[ https://issues.apache.org/jira/browse/CASSANDRA-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13219: --- Attachment: utf8-to-ascii_yaml.patch > Cassandra.yaml now unicode instead of ascii after 13090 > --- > > Key: CASSANDRA-13219 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13219 > Project: Cassandra > Issue Type: Bug > Components: Configuration >Reporter: Philip Thompson >Assignee: Ariel Weisberg >Priority: Minor > Fix For: 2.2.9, 3.0.11, 3.11.0, 4.0 > > Attachments: utf8-to-ascii_yaml.patch > > > After CASSANDRA-13090, which was commit > 5725e2c422d21d8efe5ae3bc4389842939553650, cassandra.yaml now has unicode > characters, specifically > [0xe2|http://utf8-chartable.de/unicode-utf8-table.pl?start=8320&number=128&names=2&utf8=0x]. > Previously, it was only ascii. > This is an admittedly minor change, but it is breaking. It affects (at least) > a subset of python yaml parsing tools (which is a large number of tools that > use C*). -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13211: --- Status: Patch Available (was: Open) > Use portable stderr for java error in startup > - > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher >Assignee: Michael Shuler > Fix For: 2.1.x > > Attachments: 13211_use-portable-stderr.patch > > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13211) Use portable stderr for java error in startup
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13211: --- Summary: Use portable stderr for java error in startup (was: cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed user since logging in) > Use portable stderr for java error in startup > - > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher >Assignee: Michael Shuler > Fix For: 2.1.x > > Attachments: 13211_use-portable-stderr.patch > > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed us
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13211: --- Fix Version/s: 2.1.x > cassandra shell script uses bad approach to write "Unable to find java" error > to stderr, causing real issue to be masked by a permission error if user has > changed user since logging in > > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher >Assignee: Michael Shuler > Fix For: 2.1.x > > Attachments: 13211_use-portable-stderr.patch > > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed us
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13211: --- Attachment: 13211_use-portable-stderr.patch cassandra-2.1-based patch attached. A test job will never hit this, since we set up java properly on test servers before doing any testing. > cassandra shell script uses bad approach to write "Unable to find java" error > to stderr, causing real issue to be masked by a permission error if user has > changed user since logging in > > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher >Assignee: Michael Shuler > Attachments: 13211_use-portable-stderr.patch > > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed u
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler reassigned CASSANDRA-13211: -- Assignee: Michael Shuler > cassandra shell script uses bad approach to write "Unable to find java" error > to stderr, causing real issue to be masked by a permission error if user has > changed user since logging in > > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher >Assignee: Michael Shuler > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Comment Edited] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has cha
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864167#comment-15864167 ] Michael Shuler edited comment on CASSANDRA-13211 at 2/13/17 6:36 PM: - I think this change to {{echo ... >&2}} would be fine and accomplishes the same. (When I move my /usr/bin/java out of the way, I get trapped earlier in the version check in cassandra-env.sh, since no java can be found) was (Author: mshuler): I think this change to {{ echo ... >&2}} would be fine and accomplishes the same. (When I move my /usr/bin/java out of the way, I get trapped earlier in the version check in cassandra-env.sh, since no java can be found) > cassandra shell script uses bad approach to write "Unable to find java" error > to stderr, causing real issue to be masked by a permission error if user has > changed user since logging in > > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13211) cassandra shell script uses bad approach to write "Unable to find java" error to stderr, causing real issue to be masked by a permission error if user has changed
[ https://issues.apache.org/jira/browse/CASSANDRA-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864167#comment-15864167 ] Michael Shuler commented on CASSANDRA-13211: I think this change to {{ echo ... >&2}} would be fine and accomplishes the same. (When I move my /usr/bin/java out of the way, I get trapped earlier in the version check in cassandra-env.sh, since no java can be found) > cassandra shell script uses bad approach to write "Unable to find java" error > to stderr, causing real issue to be masked by a permission error if user has > changed user since logging in > > > Key: CASSANDRA-13211 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13211 > Project: Cassandra > Issue Type: Bug >Reporter: Max Bowsher > > The cassandra startup shell script contains this line: > echo Unable to find java executable. Check JAVA_HOME and PATH environment > variables. > /dev/stderr > The problem here is the construct "> /dev/stderr". If the user invoking > Cassandra has changed user (for example, by SSHing in as a personal user, and > then sudo-ing to an application user responsible for executing the Cassandra > daemon), then the attempt to open /dev/stderr will fail, because it will > point to a PTY node under /dev/pts/ owned by the original user. > Ultimately this leads to the real problem being masked by the confusing error > message "bash: /dev/stderr: Permission denied". > The correct technique is to replace "> /dev/stderr" with ">&2" which will > write to the already open stderr file descriptor, instead of resolving the > chain of symlinks starting at /dev/stderr, and attempting to reopen the > target by name. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13210) test failure in repair_tests.incremental_repair_test.TestIncRepair.sstable_marking_test_not_intersecting_all_ranges
Michael Shuler created CASSANDRA-13210: -- Summary: test failure in repair_tests.incremental_repair_test.TestIncRepair.sstable_marking_test_not_intersecting_all_ranges Key: CASSANDRA-13210 URL: https://issues.apache.org/jira/browse/CASSANDRA-13210 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, node3.log, node4_debug.log, node4_gc.log, node4.log example failure: http://cassci.datastax.com/job/trunk_large_dtest/53/testReport/repair_tests.incremental_repair_test/TestIncRepair/sstable_marking_test_not_intersecting_all_ranges {noformat} Error Message 'Repaired at: 0' unexpectedly found in 'SSTable: /tmp/dtest-N7zjo6/test/node1/data0/keyspace1/standard1-a79a0c50efa211e6bf211330662f36ef/md-6-big\nPartitioner: org.apache.cassandra.dht.Murmur3Partitioner\nBloom Filter FP chance: 0.01\nMinimum timestamp: 148673926323\nMaximum timestamp: 148673926323\nSSTable min local deletion time: 2147483647\nSSTable max local deletion time: 2147483647\nCompressor: -\nTTL min: 0\nTTL max: 0\nFirst token: 296988783704308703 (key=30503337373039503231)\nLast token: 296988783704308703 (key=30503337373039503231)\nEstimated droppable tombstones: 0.0\nSSTable Level: 0\nRepaired at: 0\nPending repair: b099d1f0-efa2-11e6-89ec-d14624f1e47e\nReplay positions covered: {CommitLogPosition(segmentId=1486739234777, position=46796)=CommitLogPosition(segmentId=1486739234777, position=50819)}\ntotalColumnsSet: 5\ntotalRows: 1\nEstimated tombstone drop times:\nCount Row SizeCell Count\n1 0 0\n2 0 0\n3 0 0\n4 0 0\n5 0 2\n6 0 0\n7 0 0\n8 0 0\n10 0 0\n12 0 0\n14 0 0\n17 0 0\n20 0 0\n24 0 0\n29 0 0\n35 0 0\n42 0 0\n50 0 0\n60 0 0\n72 0 0\n86 0 0\n1030 0\n124 0 0\n1490 0\n1790 0\n215 1 0\n2580 0\n310 0 0\n3720 0\n4460 0\n535 0 0\n6420 0\n770 0 0\n9240 0\n1109 0 0\n1331 0 0\n1597 0 0\n1916 0 0\n2299 0 0\n2759 0 0\n3311 0 0\n3973 0 0\n4768 0 0\n5722 0 0\n6866 0 0\n8239 0 0\n9887 0 0\n11864 0 0\n14237 0 0\n17084 0 0\n20501 0 0\n24601 0 0\n29521 0 0\n35425 0 0\n42510 0 0\n51012 0 0\n61214 0 0\n73457 0 0\n88148 0 0\n105778 0 0\n126934 0 0\n152321 0 0\n182785 0 0\n219342 0 0\n263210 0 0\n315852 0 0
[jira] [Created] (CASSANDRA-13209) test failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts_with_max_connections
Michael Shuler created CASSANDRA-13209: -- Summary: test failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts_with_max_connections Key: CASSANDRA-13209 URL: https://issues.apache.org/jira/browse/CASSANDRA-13209 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1.log, node2.log, node3.log, node4.log, node5.log example failure: http://cassci.datastax.com/job/cassandra-2.1_dtest/528/testReport/cqlsh_tests.cqlsh_copy_tests/CqlshCopyTest/test_bulk_round_trip_blogposts_with_max_connections {noformat} Error Message errors={'127.0.0.4': 'Client request timeout. See Session.execute[_async](timeout)'}, last_host=127.0.0.4 >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-792s6j dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} dtest: DEBUG: removing ccm cluster test at: /tmp/dtest-792s6j dtest: DEBUG: clearing ssl stores from [/tmp/dtest-792s6j] directory dtest: DEBUG: cluster ccm directory: /tmp/dtest-uNMsuW dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} cassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered dtest: DEBUG: Running stress with user profile /home/automaton/cassandra-dtest/cqlsh_tests/blogposts.yaml - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/dtest.py", line 1090, in wrapped f(obj) File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 2571, in test_bulk_round_trip_blogposts_with_max_connections copy_from_options={'NUMPROCESSES': 2}) File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 2500, in _test_bulk_round_trip num_records = create_records() File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 2473, in create_records ret = rows_to_list(self.session.execute(count_statement))[0][0] File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, in execute return self.execute_async(query, parameters, trace, custom_payload, timeout, execution_profile, paging_state).result() File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, in result raise self._final_exception "errors={'127.0.0.4': 'Client request timeout. See Session.execute[_async](timeout)'}, last_host=127.0.0.4\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-792s6j\ndtest: DEBUG: Done setting configuration options:\n{ 'initial_token': None,\n'num_tokens': '32',\n 'phi_convict_threshold': 5,\n'range_request_timeout_in_ms': 1,\n 'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 1}\ndtest: DEBUG: removing ccm cluster test at: /tmp/dtest-792s6j\ndtest: DEBUG: clearing ssl stores from [/tmp/dtest-792s6j] directory\ndtest: DEBUG: cluster ccm directory: /tmp/dtest-uNMsuW\ndtest: DEBUG: Done setting configuration options:\n{ 'initial_token': None,\n'num_tokens': '32',\n 'phi_convict_threshold': 5,\n'range_request_timeout_in_ms': 1,\n 'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes\ncassandra.cluster: INFO: New Cassandra host discovered\ncassandra.cluster: INFO: New Cassandra host discovered\ncassandra.cluster: INFO: New Cassandra host discovered\ncassandra.cluster: INFO:
[jira] [Created] (CASSANDRA-13208) test failure in paging_test.TestPagingWithDeletions.test_failure_threshold_deletions
Michael Shuler created CASSANDRA-13208: -- Summary: test failure in paging_test.TestPagingWithDeletions.test_failure_threshold_deletions Key: CASSANDRA-13208 URL: https://issues.apache.org/jira/browse/CASSANDRA-13208 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1.log, node2.log, node3.log example failure: http://cassci.datastax.com/job/cassandra-2.1_dtest/528/testReport/paging_test/TestPagingWithDeletions/test_failure_threshold_deletions {noformat} Error Message errors={'127.0.0.2': 'Client request timeout. See Session.execute[_async](timeout)'}, last_host=127.0.0.2 >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-iXUhoT dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} cassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/paging_test.py", line 3404, in test_failure_threshold_deletions self.session.execute(SimpleStatement("select * from paging_test", fetch_size=1000, consistency_level=CL.ALL, retry_policy=FallthroughRetryPolicy())) File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, in execute return self.execute_async(query, parameters, trace, custom_payload, timeout, execution_profile, paging_state).result() File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, in result raise self._final_exception "errors={'127.0.0.2': 'Client request timeout. See Session.execute[_async](timeout)'}, last_host=127.0.0.2\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-iXUhoT\ndtest: DEBUG: Done setting configuration options:\n{ 'initial_token': None,\n'num_tokens': '32',\n 'phi_convict_threshold': 5,\n'range_request_timeout_in_ms': 1,\n 'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes\ncassandra.cluster: INFO: New Cassandra host discovered\ncassandra.cluster: INFO: New Cassandra host discovered\n- >> end captured logging << -" {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13207) test failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.maximalTaskNeedsCleanup
Michael Shuler created CASSANDRA-13207: -- Summary: test failure in org.apache.cassandra.db.compaction.PendingRepairManagerTest.maximalTaskNeedsCleanup Key: CASSANDRA-13207 URL: https://issues.apache.org/jira/browse/CASSANDRA-13207 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler example failure: http://cassci.datastax.com/job/trunk_testall/1396/testReport/org.apache.cassandra.db.compaction/PendingRepairManagerTest/maximalTaskNeedsCleanup {noformat} Stacktrace java.lang.NullPointerException at org.apache.cassandra.db.compaction.PendingRepairManagerTest.maximalTaskNeedsCleanup(PendingRepairManagerTest.java:182) Standard Output ERROR [main] 2017-02-09 23:00:16,661 ?:? - SLF4J: stderr INFO [main] 2017-02-09 23:00:16,881 ?:? - Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml DEBUG [main] 2017-02-09 23:00:16,884 ?:? - Loading settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml INFO [main] 2017-02-09 23:00:17,550 ?:? - Node configuration:[allocate_tokens_for_keyspace=null; authenticator=null; authorizer=null; auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; back_pressure_strategy=null; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=null; broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=build/test/cassandra/cdc_raw:165; cdc_total_space_in_mb=0; client_encryption_options=; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=4; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=build/test/cassandra/commitlog:165; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=5; commitlog_sync=batch; commitlog_sync_batch_window_in_ms=1.0; commitlog_sync_period_in_ms=0; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=0; concurrent_compactors=4; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@1757cd72; disk_access_mode=mmap; disk_failure_policy=ignore; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=60; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=true; enable_user_defined_functions=true; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=org.apache.cassandra.locator.SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=0; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=build/test/cassandra/hints:165; hints_flush_period_in_ms=1; incremental_backups=true; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=true; internode_authenticator=null; internode_compression=none; internode_recv_buff_size_in_bytes=0; internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=127.0.0.1; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=1080; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=offheap_objects; memtable_cleanup_threshold=null; memtable_flush_writers=0; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9207; native_transport_port_ssl=null; num_tokens=1; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.ByteOrderedPartitioner; permissions_cache_max_entries=1000; permissions_upda
[jira] [Created] (CASSANDRA-13206) test failure in org.apache.cassandra.db.compaction.CompactionStrategyManagerPendingRepairTest.cleanupCompactionFinalized-compression
Michael Shuler created CASSANDRA-13206: -- Summary: test failure in org.apache.cassandra.db.compaction.CompactionStrategyManagerPendingRepairTest.cleanupCompactionFinalized-compression Key: CASSANDRA-13206 URL: https://issues.apache.org/jira/browse/CASSANDRA-13206 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler example failure: http://cassci.datastax.com/job/trunk_testall/1396/testReport/org.apache.cassandra.db.compaction/CompactionStrategyManagerPendingRepairTest/cleanupCompactionFinalized_compression {noformat} Error Message Index: 0, Size: 0 Stacktrace java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(ArrayList.java:653) at java.util.ArrayList.get(ArrayList.java:429) at org.apache.cassandra.db.compaction.PendingRepairManager.getNextBackgroundTask(PendingRepairManager.java:285) at org.apache.cassandra.db.compaction.CompactionStrategyManager.lambda$getNextBackgroundTask$175(CompactionStrategyManager.java:152) at org.apache.cassandra.db.compaction.CompactionStrategyManager$$Lambda$171/1299262669.get(Unknown Source) at org.apache.cassandra.db.compaction.CompactionStrategyManager.getNextBackgroundTask(CompactionStrategyManager.java:163) at org.apache.cassandra.db.compaction.CompactionStrategyManagerPendingRepairTest.cleanupCompactionFinalized(CompactionStrategyManagerPendingRepairTest.java:238) Standard Output ERROR [main] 2017-02-09 22:59:29,222 ?:? - SLF4J: stderr INFO [main] 2017-02-09 22:59:29,469 ?:? - Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml DEBUG [main] 2017-02-09 22:59:29,472 ?:? - Loading settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml INFO [main] 2017-02-09 22:59:30,552 ?:? - Node configuration:[allocate_tokens_for_keyspace=null; authenticator=null; authorizer=null; auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=f ...[truncated 58459 chars]... 7324.tbl compaction strategy for pending repair: 6e3dd400-ef1b-11e6-a349-8bda75118b8f DEBUG [main] 2017-02-09 22:59:37,470 ?:? - Setting repairedAt to 0 on BigTableReader(path='/home/automaton/cassandra/build/test/cassandra/data:157/ks_1486681177324/tbl-6e3129d0ef1b11e6a3498bda75118b8f/md-1-big-Data.db') for 6e3dd400-ef1b-11e6-a349-8bda75118b8f DEBUG [main] 2017-02-09 22:59:37,472 ?:? - Removing compaction strategy for pending repair 6e3dd400-ef1b-11e6-a349-8bda75118b8f on ks_1486681177324.tbl {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13159) Coalescing strategy can enter infinite loop
[ https://issues.apache.org/jira/browse/CASSANDRA-13159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13159: --- Fix Version/s: 3.11.x 2.2.x 2.1.x 3.0.11 > Coalescing strategy can enter infinite loop > --- > > Key: CASSANDRA-13159 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13159 > Project: Cassandra > Issue Type: Bug > Components: Streaming and Messaging >Reporter: Corentin Chary >Assignee: Corentin Chary > Fix For: 3.0.11, 2.1.x, 2.2.x, 3.11.x > > > {code}boolean maybeSleep(int messages, long averageGap, long > maxCoalesceWindow, Parker parker){code} > maybeSleep() can enter an infinite loop if messages or averageGap ends up > being 0 because sleep will be 0 and the while loop will never exit. I've > noticed that on one of my clusters twice this week. > This can happen if in averageGap() sum is bigger than MEASURED_INTERVAL, > which should be pretty rare but apparently happen to me. > Even if the diagnostic is wrong (and I'm pretty sure that this thread was > using 100% CPU doing nothing), the fix seems pretty safe to apply. > {code} > diff --git a/src/java/org/apache/cassandra/utils/CoalescingStrategies.java > b/src/java/org/apache/cassandra/utils/CoalescingStrategies.java > index 0aa980f..982d4a6 100644 > --- a/src/java/org/apache/cassandra/utils/CoalescingStrategies.java > +++ b/src/java/org/apache/cassandra/utils/CoalescingStrategies.java > @@ -100,7 +100,7 @@ public class CoalescingStrategies > { > // only sleep if we can expect to double the number of messages > we're sending in the time interval > long sleep = messages * averageGap; > -if (sleep > maxCoalesceWindow) > +if (!sleep || sleep > maxCoalesceWindow) > return false; > > // assume we receive as many messages as we expect; apply the same > logic to the future batch: > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13204) Thread Leak in OutboundTcpConnection
[ https://issues.apache.org/jira/browse/CASSANDRA-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13204: --- Fix Version/s: 3.11.x 2.2.x 2.1.x 3.0.11 > Thread Leak in OutboundTcpConnection > > > Key: CASSANDRA-13204 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13204 > Project: Cassandra > Issue Type: Bug >Reporter: sankalp kohli >Assignee: Jason Brown > Fix For: 3.0.11, 2.1.x, 2.2.x, 3.11.x > > > We found threads leaking from OutboundTcpConnection to machines which are not > part of the cluster and still in Gossip for some reason. There are two issues > here, this JIRA will cover the second one which is most important. > 1) First issue is that Gossip has information about machines not in the ring > which has been replaced out. It causes Cassandra to connect to those machines > but due to internode auth, it wont be able to connect to them at the socket > level. > 2) Second issue is a race between creating a connection and closing a > connections which is triggered by the gossip bug explained above. Let me try > to explain it using the code > In OutboundTcpConnection, we are calling closeSocket(true) which will set > isStopped=true and also put a close sentinel into the queue to exit the > thread. On the ack connection, Gossip tries to send a message which calls > connect() which will block for 10 seconds which is RPC timeout. The reason we > will block is because Cassandra might not be running there or internode auth > will not let it connect. During this 10 seconds, if Gossip calls closeSocket, > it will put close sentinel into the queue. When we return from the connect > method after 10 seconds, we will clear the backlog queue causing this thread > to leak. > Proofs from the heap dump of the affected machine which is leaking threads > 1. Only ack connection is leaking and not the command connection which is not > used by Gossip. > 2. We see thread blocked on the backlog queue, isStopped=true and backlog > queue is empty. This is happening on the threads which have already leaked. > 3. A running thread was blocked on the connect waiting for timeout(10 > seconds) and we see backlog queue to contain the close sentinel. Once the > connect will return false, we will clear the backlog and this thread will > have leaked. > Interesting bits from j stack > 1282 number of threads for "MessagingService-Outgoing-/" > Thread which is about to leak: > "MessagingService-Outgoing-/" >java.lang.Thread.State: RUNNABLE > at sun.nio.ch.Net.connect0(Native Method) > at sun.nio.ch.Net.connect(Net.java:454) > at sun.nio.ch.Net.connect(Net.java:446) > at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:648) > - locked <> (a java.lang.Object) > - locked <> (a java.lang.Object) > - locked <> (a java.lang.Object) > at > org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:137) > at > org.apache.cassandra.net.OutboundTcpConnectionPool.newSocket(OutboundTcpConnectionPool.java:119) > at > org.apache.cassandra.net.OutboundTcpConnection.connect(OutboundTcpConnection.java:381) > at > org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:217) > Thread already leaked: > "MessagingService-Outgoing-/" >java.lang.Thread.State: WAITING (parking) > at sun.misc.Unsafe.park(Native Method) > - parking to wait for <> (a > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) > at > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) > at > java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) > at > org.apache.cassandra.utils.CoalescingStrategies$DisabledCoalescingStrategy.coalesceInternal(CoalescingStrategies.java:482) > at > org.apache.cassandra.utils.CoalescingStrategies$CoalescingStrategy.coalesce(CoalescingStrategies.java:213) > at > org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:190) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13114) 3.0.x: update netty
[ https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13114: --- Priority: Blocker (was: Major) > 3.0.x: update netty > --- > > Key: CASSANDRA-13114 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13114 > Project: Cassandra > Issue Type: Bug >Reporter: Tom van der Woerdt >Assignee: Stefan Podkowinski >Priority: Blocker > Fix For: 3.0.11 > > Attachments: 13114_netty-4.0.44_2.x-3.0.patch, > 13114_netty-4.0.44_3.11.patch > > > https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for > Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with > Cassandra 3.0.x, has some serious bugs around memory handling for SSL > connections. > It would be nice if both were updated to 4.0.42, a version released this year. > 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory > every ~30 minutes. This was fixed in 4.0.27. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13114) 3.0.x: update netty
[ https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859746#comment-15859746 ] Michael Shuler commented on CASSANDRA-13114: I set this ticket as a blocker for 3.0.11. Is there any additional testing required to merge this to the cassandra-3.0 branch, so we can release 3.0.11? Thanks! > 3.0.x: update netty > --- > > Key: CASSANDRA-13114 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13114 > Project: Cassandra > Issue Type: Bug >Reporter: Tom van der Woerdt >Assignee: Stefan Podkowinski >Priority: Blocker > Fix For: 3.0.11 > > Attachments: 13114_netty-4.0.44_2.x-3.0.patch, > 13114_netty-4.0.44_3.11.patch > > > https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for > Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with > Cassandra 3.0.x, has some serious bugs around memory handling for SSL > connections. > It would be nice if both were updated to 4.0.42, a version released this year. > 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory > every ~30 minutes. This was fixed in 4.0.27. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13114) 3.0.x: update netty
[ https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13114: --- Fix Version/s: 3.0.11 > 3.0.x: update netty > --- > > Key: CASSANDRA-13114 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13114 > Project: Cassandra > Issue Type: Bug >Reporter: Tom van der Woerdt >Assignee: Stefan Podkowinski >Priority: Blocker > Fix For: 3.0.11 > > Attachments: 13114_netty-4.0.44_2.x-3.0.patch, > 13114_netty-4.0.44_3.11.patch > > > https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for > Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with > Cassandra 3.0.x, has some serious bugs around memory handling for SSL > connections. > It would be nice if both were updated to 4.0.42, a version released this year. > 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory > every ~30 minutes. This was fixed in 4.0.27. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13196) test failure in snitch_test.TestGossipingPropertyFileSnitch.test_prefer_local_reconnect_on_listen_address
Michael Shuler created CASSANDRA-13196: -- Summary: test failure in snitch_test.TestGossipingPropertyFileSnitch.test_prefer_local_reconnect_on_listen_address Key: CASSANDRA-13196 URL: https://issues.apache.org/jira/browse/CASSANDRA-13196 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, node2.log example failure: http://cassci.datastax.com/job/trunk_dtest/1487/testReport/snitch_test/TestGossipingPropertyFileSnitch/test_prefer_local_reconnect_on_listen_address {novnode} Error Message Error from server: code=2200 [Invalid query] message="keyspace keyspace1 does not exist" >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-k6b0iF dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} cassandra.policies: INFO: Using datacenter 'dc1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes cassandra.cluster: INFO: New Cassandra host discovered - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/snitch_test.py", line 87, in test_prefer_local_reconnect_on_listen_address new_rows = list(session.execute("SELECT * FROM {}".format(stress_table))) File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, in execute return self.execute_async(query, parameters, trace, custom_payload, timeout, execution_profile, paging_state).result() File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, in result raise self._final_exception 'Error from server: code=2200 [Invalid query] message="keyspace keyspace1 does not exist"\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-k6b0iF\ndtest: DEBUG: Done setting configuration options:\n{ \'initial_token\': None,\n\'num_tokens\': \'32\',\n \'phi_convict_threshold\': 5,\n\'range_request_timeout_in_ms\': 1,\n \'read_request_timeout_in_ms\': 1,\n\'request_timeout_in_ms\': 1,\n \'truncate_request_timeout_in_ms\': 1,\n \'write_request_timeout_in_ms\': 1}\ncassandra.policies: INFO: Using datacenter \'dc1\' for DCAwareRoundRobinPolicy (via host \'127.0.0.1\'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes\ncassandra.cluster: INFO: New Cassandra host discovered\n- >> end captured logging << -' {novnode} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (CASSANDRA-13183) test failure in compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test
[ https://issues.apache.org/jira/browse/CASSANDRA-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler resolved CASSANDRA-13183. Resolution: Duplicate Thanks. It does look like the last few runs have passed. > test failure in > compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test > -- > > Key: CASSANDRA-13183 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13183 > Project: Cassandra > Issue Type: Bug >Reporter: Michael Shuler > Labels: dtest, test-failure > Attachments: logs.tar.gz > > > This test failed on both Leveled and DateTiered. > example failures: > http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_LeveledCompactionStrategy/compaction_throughput_test > http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_DateTieredCompactionStrategy/compaction_throughput_test/ > Leveled: > {noformat} > Error Message > 5.5 not greater than or equal to 6.316 > >> begin captured logging << > dtest: DEBUG: cluster ccm directory: /tmp/dtest-lhjy7D > dtest: DEBUG: Done setting configuration options: > { 'num_tokens': None, > 'phi_convict_threshold': 5, > 'range_request_timeout_in_ms': 1, > 'read_request_timeout_in_ms': 1, > 'request_timeout_in_ms': 1, > 'truncate_request_timeout_in_ms': 1, > 'write_request_timeout_in_ms': 1} > parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> > '(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s' > dtest: DEBUG: 6.316 > - >> end captured logging << - > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in > compaction_throughput_test > self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput)) > File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual > self.fail(self._formatMessage(msg, standardMsg)) > File "/usr/lib/python2.7/unittest/case.py", line 410, in fail > raise self.failureException(msg) > "5.5 not greater than or equal to 6.316\n >> begin > captured logging << \ndtest: DEBUG: cluster ccm > directory: /tmp/dtest-lhjy7D\ndtest: DEBUG: Done setting configuration > options:\n{ 'num_tokens': None,\n'phi_convict_threshold': 5,\n > 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': > 1,\n'request_timeout_in_ms': 1,\n > 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': > 1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> > '(.+?)=(?P[-+ ]?d+.d+)(?P.+?)/s'\ndtest: > DEBUG: 6.316\n- >> end captured logging << > -" > {noformat} > DateTiered: > {noformat} > Error Message > 5.5 not greater than or equal to 5.681 > >> begin captured logging << > dtest: DEBUG: cluster ccm directory: /tmp/dtest-FXOwMR > dtest: DEBUG: Done setting configuration options: > { 'num_tokens': None, > 'phi_convict_threshold': 5, > 'range_request_timeout_in_ms': 1, > 'read_request_timeout_in_ms': 1, > 'request_timeout_in_ms': 1, > 'truncate_request_timeout_in_ms': 1, > 'write_request_timeout_in_ms': 1} > parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> > '(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s' > dtest: DEBUG: 5.681 > - >> end captured logging << - > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in > compaction_throughput_test > self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput)) > File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual > self.fail(self._formatMessage(msg, standardMsg)) > File "/usr/lib/python2.7/unittest/case.py", line 410, in fail > raise self.failureException(msg) > "5.5 not greater than or equal to 5.681\n >> begin > captured logging << \ndtest: DEBUG: cluster ccm > directory: /tmp/dtest-FXOwMR\ndtest: DEBUG: Done setting configuration > options:\n{ 'num_tokens': None,\n'phi_convict_threshold': 5,\n > 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': > 1,\n'request_timeout_in_ms': 1,\n > 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': > 1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' ->
[jira] [Created] (CASSANDRA-13194) test failure in repair_tests.incremental_repair_test.TestIncRepair.compaction_test
Michael Shuler created CASSANDRA-13194: -- Summary: test failure in repair_tests.incremental_repair_test.TestIncRepair.compaction_test Key: CASSANDRA-13194 URL: https://issues.apache.org/jira/browse/CASSANDRA-13194 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, node3_gc.log, node3.log example failure: http://cassci.datastax.com/job/cassandra-3.0_novnode_dtest/333/testReport/repair_tests.incremental_repair_test/TestIncRepair/compaction_test {noformat} Error Message errors={'127.0.0.3': 'Client request timeout. See Session.execute[_async](timeout)'}, last_host=127.0.0.3 >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-2JszEQ dtest: DEBUG: Done setting configuration options: { 'num_tokens': None, 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} cassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/repair_tests/incremental_repair_test.py", line 225, in compaction_test create_ks(session, 'ks', 3) File "/home/automaton/cassandra-dtest/dtest.py", line 725, in create_ks session.execute(query % (name, "'class':'SimpleStrategy', 'replication_factor':%d" % rf)) File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1998, in execute return self.execute_async(query, parameters, trace, custom_payload, timeout, execution_profile, paging_state).result() File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 3784, in result raise self._final_exception "errors={'127.0.0.3': 'Client request timeout. See Session.execute[_async](timeout)'}, last_host=127.0.0.3\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-2JszEQ\ndtest: DEBUG: Done setting configuration options:\n{ 'num_tokens': None,\n'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes\ncassandra.cluster: INFO: New Cassandra host discovered\ncassandra.cluster: INFO: New Cassandra host discovered\n- >> end captured logging << -" {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13191) test failure in org.apache.cassandra.hints.HintsBufferPoolTest.testBackpressure
Michael Shuler created CASSANDRA-13191: -- Summary: test failure in org.apache.cassandra.hints.HintsBufferPoolTest.testBackpressure Key: CASSANDRA-13191 URL: https://issues.apache.org/jira/browse/CASSANDRA-13191 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler example failure: http://cassci.datastax.com/job/trunk_testall/1392/testReport/org.apache.cassandra.hints/HintsBufferPoolTest/testBackpressure {noformat} Error Message Connection reset Stacktrace java.net.SocketException: Connection reset at java.net.SocketInputStream.read(SocketInputStream.java:209) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) at java.io.InputStreamReader.read(InputStreamReader.java:184) at java.io.BufferedReader.fill(BufferedReader.java:161) at java.io.BufferedReader.readLine(BufferedReader.java:324) at java.io.BufferedReader.readLine(BufferedReader.java:389) at org.jboss.byteman.agent.submit.Submit$Comm.readResponse(Submit.java:941) at org.jboss.byteman.agent.submit.Submit.submitRequest(Submit.java:790) at org.jboss.byteman.agent.submit.Submit.addScripts(Submit.java:603) at org.jboss.byteman.contrib.bmunit.BMUnit.loadScriptText(BMUnit.java:268) at org.jboss.byteman.contrib.bmunit.BMUnitRunner$10.evaluate(BMUnitRunner.java:369) at org.jboss.byteman.contrib.bmunit.BMUnitRunner$6.evaluate(BMUnitRunner.java:241) at org.jboss.byteman.contrib.bmunit.BMUnitRunner$1.evaluate(BMUnitRunner.java:75) Standard Output ERROR [main] 2017-02-07 11:03:07,465 ?:? - SLF4J: stderr INFO [main] 2017-02-07 11:03:07,650 ?:? - Configuration location: file:/home/automaton/cassandra/test/conf/cassandra.yaml DEBUG [main] 2017-02-07 11:03:07,651 ?:? - Loading settings from file:/home/automaton/cassandra/test/conf/cassandra.yaml INFO [main] 2017-02-07 11:03:08,225 ?:? - Node configuration:[allocate_tokens_for_keyspace=null; authenticator=null; authorizer=null; auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; back_pressure_strategy=null; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=null; broadcast_rpc_address=null; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=build/test/cassandra/cdc_raw:222; cdc_total_space_in_mb=0; client_encryption_options=; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=4; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=build/test/cassandra/commitlog:222; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=5; commitlog_sync=batch; commitlog_sync_batch_window_in_ms=1.0; commitlog_sync_period_in_ms=0; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=0; concurrent_compactors=4; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@e7edb54; disk_access_mode=mmap; disk_failure_policy=ignore; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=60; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=true; enable_user_defined_functions=true; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=org.apache.cassandra.locator.SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=0; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=build/test/cassandra/hints:222; hints_flush_period_in_ms=1; incremental_backups=true; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=true; internode_authenticator=null; internode_compression=none; internode_recv_buff_siz
[jira] [Created] (CASSANDRA-13190) Fix eclipse-warnings from CASSANDRA-9143
Michael Shuler created CASSANDRA-13190: -- Summary: Fix eclipse-warnings from CASSANDRA-9143 Key: CASSANDRA-13190 URL: https://issues.apache.org/jira/browse/CASSANDRA-13190 Project: Cassandra Issue Type: Sub-task Components: Testing Reporter: Michael Shuler Assignee: Blake Eggleston Fix For: 4.x CASSANDRA-9143 introduced an error from eclipse-warnings: {noformat} # 2/7/17 5:50:30 AM UTC # Eclipse Compiler for Java(TM) v20150120-1634, 3.10.2, Copyright IBM Corp 2000, 2013. All rights reserved. -- 1. ERROR in /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/repair/consistent/PendingAntiCompaction.java (at line 103) return new AcquireResult(cfs, Refs.ref(sstables), txn); ^^^ Potential resource leak: 'txn' may not be closed at this location -- -- 2. ERROR in /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/db/compaction/PendingRepairManager.java (at line 236) return txn == null ? null : new RepairFinishedCompactionTask(cfs, txn, sessionID, repairedAt); ^^ Potential resource leak: 'txn' may not be closed at this location -- 2 problems (2 errors) {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-10872) Debian Package does not prompt the user to review the config files; it just replaces them causing trouble (since the daemon starts by default)
[ https://issues.apache.org/jira/browse/CASSANDRA-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-10872: --- Fix Version/s: (was: 3.0.x) (was: 2.2.x) (was: 2.1.x) (was: 3.x) > Debian Package does not prompt the user to review the config files; it just > replaces them causing trouble (since the daemon starts by default) > -- > > Key: CASSANDRA-10872 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10872 > Project: Cassandra > Issue Type: Bug > Components: Packaging > Environment: Ubuntu 12.04, Cassandra 2.0.16 -> 2.0.17 >Reporter: Vasilis >Assignee: Michael Shuler >Priority: Critical > Labels: debian, packaging > > We run Cassandra 2.0.16 on Ubuntu 12.04 and were trying to upgrade to 2.0.17 > due to CASSANDRA-9662. The problem is that during the upgrade the we were not > prompted how to handle cassandra-env.sh and cassandra-rackdc.properties. > The output from the upgrade: > {panel} > ... > Setting up cassandra (2.0.17) ... > Installing new version of config file /etc/cassandra/cassandra-env.sh ... > Installing new version of config file > /etc/cassandra/cassandra-rackdc.properties ... > vm.max_map_count = 1048575 > net.ipv4.tcp_keepalive_time = 300 > ... > {panel} > This meant that the nodes started automatically after the install with the > wrong DC name. > I don't think that these config files should have been replaced without the > admin being asked; this doesn't appear to comply with standard Debian > packages. > Secondly if CASSANDRA-2356 was implemented the problem would not be as > severe; i.e. it would be possible to workaround this issue. Whereas > currently, there is no way to prevent the node when upgraded from starting in > the wrong DC. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-9320) test-burn target should be run occasionally
[ https://issues.apache.org/jira/browse/CASSANDRA-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-9320: -- Fix Version/s: (was: 3.x) > test-burn target should be run occasionally > --- > > Key: CASSANDRA-9320 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9320 > Project: Cassandra > Issue Type: Test >Reporter: Ariel Weisberg >Assignee: Michael Shuler >Priority: Minor > > The tests are all concurrency tests right now so they need to run on the > largest # of cores we have available. The tests are not configured to run > very long right now, but the intent is that they run for longer periods (days > even). > They aren't described as high value right now because the code under test > hasn't change since first introduced so we can defer setting this job up > until higher priority things are done. > I think we should still run them at some low frequency so they don't rot or > some change doesn't sneak in that effects them. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-8204) Configure multi-JDK8 build/test jenkins matrix job
[ https://issues.apache.org/jira/browse/CASSANDRA-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-8204: -- Fix Version/s: (was: 3.x) > Configure multi-JDK8 build/test jenkins matrix job > -- > > Key: CASSANDRA-8204 > URL: https://issues.apache.org/jira/browse/CASSANDRA-8204 > Project: Cassandra > Issue Type: Sub-task > Components: Testing >Reporter: Michael Shuler >Assignee: Michael Shuler > > Set up Oracle JDK-8 and OpenJDK-8 build/test matrix job in Jenkins. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13183) test failure in compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test
Michael Shuler created CASSANDRA-13183: -- Summary: test failure in compaction_test.TestCompaction_with_*CompactionStrategy.compaction_throughput_test Key: CASSANDRA-13183 URL: https://issues.apache.org/jira/browse/CASSANDRA-13183 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: logs.tar.gz This test failed on both Leveled and DateTiered. example failures: http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_LeveledCompactionStrategy/compaction_throughput_test http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/compaction_test/TestCompaction_with_DateTieredCompactionStrategy/compaction_throughput_test/ Leveled: {noformat} Error Message 5.5 not greater than or equal to 6.316 >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-lhjy7D dtest: DEBUG: Done setting configuration options: { 'num_tokens': None, 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> '(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s' dtest: DEBUG: 6.316 - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in compaction_throughput_test self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput)) File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual self.fail(self._formatMessage(msg, standardMsg)) File "/usr/lib/python2.7/unittest/case.py", line 410, in fail raise self.failureException(msg) "5.5 not greater than or equal to 6.316\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-lhjy7D\ndtest: DEBUG: Done setting configuration options:\n{ 'num_tokens': None,\n'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> '(.+?)=(?P[-+ ]?d+.d+)(?P.+?)/s'\ndtest: DEBUG: 6.316\n- >> end captured logging << -" {noformat} DateTiered: {noformat} Error Message 5.5 not greater than or equal to 5.681 >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-FXOwMR dtest: DEBUG: Done setting configuration options: { 'num_tokens': None, 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} parse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> '(.+?)=(?P[-+ ]?\\d+\\.\\d+)(?P.+?)/s' dtest: DEBUG: 5.681 - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/compaction_test.py", line 280, in compaction_throughput_test self.assertGreaterEqual(float(threshold) + 0.5, float(avgthroughput)) File "/usr/lib/python2.7/unittest/case.py", line 948, in assertGreaterEqual self.fail(self._formatMessage(msg, standardMsg)) File "/usr/lib/python2.7/unittest/case.py", line 410, in fail raise self.failureException(msg) "5.5 not greater than or equal to 5.681\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-FXOwMR\ndtest: DEBUG: Done setting configuration options:\n{ 'num_tokens': None,\n'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 1}\nparse: DEBUG: format '{}={avgthroughput:f}{units}/s' -> '(.+?)=(?P[-+ ]?d+.d+)(?P.+?)/s'\ndtest: DEBUG: 5.681\n- >> end captured logging << -" {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13182) test failure in sstableutil_test.SSTableUtilTest.compaction_test
Michael Shuler created CASSANDRA-13182: -- Summary: test failure in sstableutil_test.SSTableUtilTest.compaction_test Key: CASSANDRA-13182 URL: https://issues.apache.org/jira/browse/CASSANDRA-13182 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler Attachments: node1_debug.log, node1_gc.log, node1.log example failure: http://cassci.datastax.com/job/trunk_novnode_dtest/506/testReport/sstableutil_test/SSTableUtilTest/compaction_test {noformat} Error Message Lists differ: ['/tmp/dtest-Rk_3Cs/test/node1... != ['/tmp/dtest-Rk_3Cs/test/node1... First differing element 8: '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-CRC.db' '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-CRC.db' First list contains 7 additional elements. First extra element 24: '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Data.db' ['/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-CRC.db', '/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Data.db', '/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Digest.crc32', '/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Filter.db', '/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Index.db', '/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Statistics.db', '/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-Summary.db', '/tmp/dtest-Rk_3Cs/test/node1/data0/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-4-big-TOC.txt', - '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-CRC.db', - '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Digest.crc32', - '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Filter.db', - '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Index.db', - '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Statistics.db', - '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-Summary.db', - '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-2-big-TOC.txt', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-CRC.db', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Data.db', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Digest.crc32', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Filter.db', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Index.db', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Statistics.db', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-Summary.db', '/tmp/dtest-Rk_3Cs/test/node1/data1/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-6-big-TOC.txt', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-CRC.db', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Data.db', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Digest.crc32', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Filter.db', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Index.db', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Statistics.db', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-Summary.db', '/tmp/dtest-Rk_3Cs/test/node1/data2/keyspace1/standard1-11ee2450e8ab11e6b5a68de39eb517c4/mc-5-big-TOC.txt'] >> begin captured logging << {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CASSANDRA-13181) test failure in paging_test.TestPagingData.test_select_in_clause_with_duplicate_keys
Michael Shuler created CASSANDRA-13181: -- Summary: test failure in paging_test.TestPagingData.test_select_in_clause_with_duplicate_keys Key: CASSANDRA-13181 URL: https://issues.apache.org/jira/browse/CASSANDRA-13181 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler example failure: http://cassci.datastax.com/job/cassandra-2.2_novnode_dtest/352/testReport/paging_test/TestPagingData/test_select_in_clause_with_duplicate_keys {noformat} Error Message 'TestPagingData' object has no attribute 'create_ks' >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-I7zCAw dtest: DEBUG: Done setting configuration options: { 'num_tokens': None, 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} cassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes cassandra.cluster: INFO: New Cassandra host discovered cassandra.cluster: INFO: New Cassandra host discovered - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/paging_test.py", line 1721, in test_select_in_clause_with_duplicate_keys self.create_ks(session, 'test_paging_static_cols', 2) "'TestPagingData' object has no attribute 'create_ks'\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-I7zCAw\ndtest: DEBUG: Done setting configuration options:\n{ 'num_tokens': None,\n'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 1,\n'read_request_timeout_in_ms': 1,\n'request_timeout_in_ms': 1,\n 'truncate_request_timeout_in_ms': 1,\n'write_request_timeout_in_ms': 1}\ncassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit contact points to local cluster nodes\ncassandra.cluster: INFO: New Cassandra host discovered\ncassandra.cluster: INFO: New Cassandra host discovered\n- >> end captured logging << -" {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13114) 3.0.x: update netty
[ https://issues.apache.org/jira/browse/CASSANDRA-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850427#comment-15850427 ] Michael Shuler commented on CASSANDRA-13114: I built SNAPSHOT artifacts on top of current {{cassandra-3.0}} for Tom to test: http://people.apache.org/~mshuler/13114_netty-4.0.44_3.0/ {noformat} commit cd9a6590dd950d456278461919d7e6a079531ee4 (HEAD -> 13114_netty-4.0.44_3.0, github/13114_netty-4.0.44_3.0) Author: Stefan Podkowinski Date: Wed Jan 25 15:16:25 2017 +0100 Upgrade to netty 4.0.44 patch by Stefan Podkowinski; reviewed by X for CASSANDRA-13114 CHANGES.txt | 1 + build.xml | 2 +- lib/licenses/{netty-all-4.0.23.Final.txt => netty-all-4.0.44.Final.txt} | 0 lib/netty-all-4.0.23.Final.jar | Bin 1779991 -> 0 bytes lib/netty-all-4.0.44.Final.jar | Bin 0 -> 2342652 bytes src/java/org/apache/cassandra/transport/Message.java| 12 6 files changed, 10 insertions(+), 5 deletions(-) commit 6caf3c4f13bb29e3fd732365210be6b3c954f04a (origin/cassandra-3.0, cassandra-3.0) Author: Michael Shuler Date: Wed Feb 1 14:39:35 2017 -0600 Remove 'no upgrades' note from NEWS.txt {noformat} > 3.0.x: update netty > --- > > Key: CASSANDRA-13114 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13114 > Project: Cassandra > Issue Type: Bug >Reporter: Tom van der Woerdt >Assignee: Stefan Podkowinski > Attachments: 13114_netty-4.0.44_2.x-3.0.patch, > 13114_netty-4.0.44_3.11.patch > > > https://issues.apache.org/jira/browse/CASSANDRA-12032 updated netty for > Cassandra 3.8, but this wasn't backported. Netty 4.0.23, which ships with > Cassandra 3.0.x, has some serious bugs around memory handling for SSL > connections. > It would be nice if both were updated to 4.0.42, a version released this year. > 4.0.23 makes it impossible for me to run SSL, because nodes run out of memory > every ~30 minutes. This was fixed in 4.0.27. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13115) Read repair is not blocking repair to finish in foreground repair
[ https://issues.apache.org/jira/browse/CASSANDRA-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13115: --- Fix Version/s: (was: 3.11) 3.10 > Read repair is not blocking repair to finish in foreground repair > - > > Key: CASSANDRA-13115 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13115 > Project: Cassandra > Issue Type: Bug > Environment: ccm on OSX >Reporter: Xiaolong Jiang >Assignee: Sylvain Lebresne > Fix For: 3.0.11, 3.10 > > > The code trying to wait(block) for repair result to come back in 3.X is below: > {code:title= DataResolver.java|borderStyle=solid} > public void close() > { > try > { > FBUtilities.waitOnFutures(repairResults, > DatabaseDescriptor.getWriteRpcTimeout()); > } > catch (TimeoutException ex) > { > // We got all responses, but timed out while repairing > int blockFor = consistency.blockFor(keyspace); > if (Tracing.isTracing()) > Tracing.trace("Timed out while read-repairing after > receiving all {} data and digest responses", blockFor); > else > logger.debug("Timeout while read-repairing after > receiving all {} data and digest responses", blockFor); > throw new ReadTimeoutException(consistency, blockFor-1, > blockFor, true); > } > } > {code} > in DataResolver class, but this close method is never called and it's also > not auto close(RepairMergeListener is not extending from > AutoCloseable/CloseableIterator) which means we never wait for repair to > finish before returning final result. > The steps to reproduce: > 1. create some keyspace/table with RF = 2 > 2. start 2 nodes using ccm > 3. stop node2 > 4. disable node1 hinted hand off > 5. write some data to node1 with consistency level one > 6. start node2 > 7. query some data from node1 > This should trigger read repair. I put some log in above close method, and > can not see log print put. > So this bug will basically violate "monotonic quorum reads " guarantee. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13075) Indexer is not correctly invoked when building indexes over sstables
[ https://issues.apache.org/jira/browse/CASSANDRA-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13075: --- Fix Version/s: (was: 3.11) 3.10 > Indexer is not correctly invoked when building indexes over sstables > > > Key: CASSANDRA-13075 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13075 > Project: Cassandra > Issue Type: Bug >Reporter: Sergio Bossa >Assignee: Alex Petrov >Priority: Critical > Fix For: 3.0.11, 3.10, 4.0 > > Attachments: CustomIndexTest.java > > > Following CASSANDRA-12796, {{SecondaryIndexManager#indexPartition()}} calls > each {{Indexer}} {{begin}} and {{finish}} methods multiple times per > partition (depending on the page size), as > {{PartitionIterators#getOnlyElement()}} returns an empty partition even when > the iterator is exhausted. > This leads to bugs for {{Indexer}} implementations doing actual work in those > methods, but even worse, it provides the {{Indexer}} the same input of an > empty partition containing only a non-live partition deletion, as the > {{Indexer#partitionDelete()}} method is *not* actually called. > My proposed solution: > 1) Stop the iteration before the empty partition is returned and ingested > into the {{Indexer}}. > 2) Actually call the {{Indexer#partitionDelete()}} method inside > {{SecondaryIndexManager#indexPartition()}} (which requires to use a filtered > iterator so it actually contains the deletion info). -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13025) dtest failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test
[ https://issues.apache.org/jira/browse/CASSANDRA-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13025: --- Fix Version/s: (was: 3.11) > dtest failure in > upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test > > > Key: CASSANDRA-13025 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13025 > Project: Cassandra > Issue Type: Bug > Components: Testing >Reporter: Sean McCarthy >Assignee: Sylvain Lebresne >Priority: Critical > Labels: dtest, test-failure > Fix For: 3.10 > > > example failure: > http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/28/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x/static_columns_with_distinct_test > {code} > Error Message > > {code}{code} > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/tools/decorators.py", line 46, in > wrapped > f(obj) > File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line > 4010, in static_columns_with_distinct_test > rows = list(cursor.execute("SELECT DISTINCT k, s1 FROM test2")) > File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line > 1998, in execute > return self.execute_async(query, parameters, trace, custom_payload, > timeout, execution_profile, paging_state).result() > File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line > 3784, in result > raise self._final_exception > {code}{code} > Standard Output > http://git-wip-us.apache.org/repos/asf/cassandra.git > git:7eac22dd41cb09e6d64fb5ac48b2cca3c8840cc8 > Unexpected error in node2 log, error: > ERROR [Native-Transport-Requests-2] 2016-12-08 03:20:04,861 Message.java:617 > - Unexpected exception during request; channel = [id: 0xf4c13f2c, > L:/127.0.0.2:9042 - R:/127.0.0.1:52112] > java.io.IOError: java.io.IOException: Corrupt empty row found in unfiltered > partition > at > org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:224) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:212) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:133) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.processPartition(SelectStatement.java:779) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:741) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:408) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:273) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:232) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:219) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:204) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:115) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:513) > [apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:407) > [apache-cassandra-3.9.jar:3.9] > at > io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) > [netty-all-4.0.39.Final.jar:4.0.39.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366) > [netty-all-4.0.39.Final.jar:4.0.39.Final] > at > io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35) > [netty-all-4.0.39.Final.jar:4.0.39.Final] >
[jira] (CASSANDRA-12563) Stress daemon help is incorrect
[ https://issues.apache.org/jira/browse/CASSANDRA-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-12563: --- Fix Version/s: (was: 3.11) 3.10 > Stress daemon help is incorrect > --- > > Key: CASSANDRA-12563 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12563 > Project: Cassandra > Issue Type: Bug > Components: Tools >Reporter: Christopher Batey >Assignee: Christopher Batey >Priority: Trivial > Labels: stress > Fix For: 3.0.11, 3.10, 4.0 > > > It says provide the option -sendToDaemon where as only -send-to and -sendto > work > Fix here: > https://github.com/chbatey/cassandra-1/tree/stress-daemon -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-12203) AssertionError on compaction after upgrade (2.1.9 -> 3.7)
[ https://issues.apache.org/jira/browse/CASSANDRA-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-12203: --- Fix Version/s: (was: 3.11) 3.10 > AssertionError on compaction after upgrade (2.1.9 -> 3.7) > - > > Key: CASSANDRA-12203 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12203 > Project: Cassandra > Issue Type: Bug > Components: Core > Environment: Cassandra 3.7 (upgrade from 2.1.9) > Java version "1.8.0_91" > Ubuntu 14.04.4 LTS (GNU/Linux 3.13.0-83-generic x86_64) >Reporter: Roman S. Borschel >Assignee: Yuki Morishita >Priority: Critical > Fix For: 3.0.11, 3.10 > > > After upgrading a Cassandra cluster from 2.1.9 to 3.7, one column family > (using SizeTieredCompaction) repeatedly and continuously failed compaction > (and thus also repair) across the cluster, with all nodes producing the > following errors in the logs: > {noformat} > 016-07-14T09:29:47.96855 |srv=cassandra|ERROR: Exception in thread > Thread[CompactionExecutor:3,1,main] > 2016-07-14T09:29:47.96858 |srv=cassandra|java.lang.AssertionError: null > 2016-07-14T09:29:47.96859 |srv=cassandra| at > org.apache.cassandra.db.UnfilteredDeserializer$OldFormatDeserializer$TombstoneTracker.openNew(UnfilteredDeserializer.java:650) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96860 |srv=cassandra| at > org.apache.cassandra.db.UnfilteredDeserializer$OldFormatDeserializer$UnfilteredIterator.hasNext(UnfilteredDeserializer.java:423) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96860 |srv=cassandra| at > org.apache.cassandra.db.UnfilteredDeserializer$OldFormatDeserializer.hasNext(UnfilteredDeserializer.java:298) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96860 |srv=cassandra| at > org.apache.cassandra.io.sstable.SSTableSimpleIterator$OldFormatIterator.readStaticRow(SSTableSimpleIterator.java:133) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96861 |srv=cassandra| at > org.apache.cassandra.io.sstable.SSTableIdentityIterator.(SSTableIdentityIterator.java:57) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96861 |srv=cassandra| at > org.apache.cassandra.io.sstable.format.big.BigTableScanner$KeyScanningIterator$1.initializeIterator(BigTableScanner.java:334) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96862 |srv=cassandra| at > org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.maybeInit(LazilyInitializedUnfilteredRowIterator.java:48) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96862 |srv=cassandra| at > org.apache.cassandra.db.rows.LazilyInitializedUnfilteredRowIterator.isReverseOrder(LazilyInitializedUnfilteredRowIterator.java:70) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96863 |srv=cassandra| at > org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$1.reduce(UnfilteredPartitionIterators.java:109) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96863 |srv=cassandra| at > org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$1.reduce(UnfilteredPartitionIterators.java:100) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96864 |srv=cassandra| at > org.apache.cassandra.utils.MergeIterator$Candidate.consume(MergeIterator.java:408) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96864 |srv=cassandra| at > org.apache.cassandra.utils.MergeIterator$ManyToOne.consume(MergeIterator.java:203) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96865 |srv=cassandra| at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:156) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96865 |srv=cassandra| at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96866 |srv=cassandra| at > org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$2.hasNext(UnfilteredPartitionIterators.java:150) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96866 |srv=cassandra| at > org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:72) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96867 |srv=cassandra| at > org.apache.cassandra.db.compaction.CompactionIterator.hasNext(CompactionIterator.java:226) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96867 |srv=cassandra| at > org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:182) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96867 |srv=cassandra| at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) > ~[apache-cassandra-3.7.jar:3.7] > 2016-07-14T09:29:47.96868 |srv=cassandra
[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization
[ https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13160: --- Resolution: Fixed Status: Resolved (was: Ready to Commit) Committed to cassandra-3.11 branch and merged up. Thanks! https://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=commit;h=5e40fd9fa18bd0939450e657b0b6b0b86ad1f4c9 > batch documentation should note the single partition optimization > - > > Key: CASSANDRA-13160 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13160 > Project: Cassandra > Issue Type: Improvement > Components: Documentation and Website >Reporter: Jon Haddad >Assignee: Jon Haddad >Priority: Minor > Fix For: 4.0, 3.11 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization
[ https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847490#comment-15847490 ] Michael Shuler commented on CASSANDRA-13160: dropping 2.2 and 3.0 - doc doesn't exist in those branches > batch documentation should note the single partition optimization > - > > Key: CASSANDRA-13160 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13160 > Project: Cassandra > Issue Type: Improvement > Components: Documentation and Website >Reporter: Jon Haddad >Assignee: Jon Haddad >Priority: Minor > Fix For: 4.0, 3.11 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization
[ https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13160: --- Fix Version/s: (was: 3.0.11) (was: 2.2.9) > batch documentation should note the single partition optimization > - > > Key: CASSANDRA-13160 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13160 > Project: Cassandra > Issue Type: Improvement > Components: Documentation and Website >Reporter: Jon Haddad >Assignee: Jon Haddad >Priority: Minor > Fix For: 4.0, 3.11 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization
[ https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13160: --- Fix Version/s: 3.11 4.0 3.0.11 2.2.9 > batch documentation should note the single partition optimization > - > > Key: CASSANDRA-13160 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13160 > Project: Cassandra > Issue Type: Improvement > Components: Documentation and Website >Reporter: Jon Haddad >Assignee: Jon Haddad >Priority: Minor > Fix For: 2.2.9, 3.0.11, 4.0, 3.11 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization
[ https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13160: --- Status: Ready to Commit (was: Patch Available) > batch documentation should note the single partition optimization > - > > Key: CASSANDRA-13160 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13160 > Project: Cassandra > Issue Type: Improvement > Components: Documentation and Website >Reporter: Jon Haddad >Assignee: Jon Haddad >Priority: Minor > Fix For: 2.2.9, 3.0.11, 4.0, 3.11 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization
[ https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13160: --- Reviewer: Michael Shuler > batch documentation should note the single partition optimization > - > > Key: CASSANDRA-13160 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13160 > Project: Cassandra > Issue Type: Improvement > Components: Documentation and Website >Reporter: Jon Haddad >Assignee: Jon Haddad >Priority: Minor > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (CASSANDRA-13160) batch documentation should note the single partition optimization
[ https://issues.apache.org/jira/browse/CASSANDRA-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847485#comment-15847485 ] Michael Shuler commented on CASSANDRA-13160: Looks good to me. Setting to 2.2 and up. > batch documentation should note the single partition optimization > - > > Key: CASSANDRA-13160 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13160 > Project: Cassandra > Issue Type: Improvement > Components: Documentation and Website >Reporter: Jon Haddad >Assignee: Jon Haddad >Priority: Minor > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13164) eclipse-warnings on CASSANDRA-9425
[ https://issues.apache.org/jira/browse/CASSANDRA-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13164: --- Fix Version/s: (was: 3.x) 4.0 > eclipse-warnings on CASSANDRA-9425 > -- > > Key: CASSANDRA-13164 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13164 > Project: Cassandra > Issue Type: Sub-task >Reporter: Michael Shuler > Labels: test-failure > Fix For: 4.0 > > > CASSANDRA-9425 commit triggered a few eclipse-warnings on > http://cassci.datastax.com/job/trunk_eclipse-warnings/1181/ > cc: [~iamaleksey] > {noformat} > 23:50:23 eclipse-warnings: > 23:50:23 [mkdir] Created dir: > /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj > 23:50:23 [echo] Running Eclipse Code Analysis. Output logged to > /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj/eclipse_compiler_checks.txt > 23:50:34 [java] -- > 23:50:34 [java] 1. ERROR in > /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java > (at line 138) > 23:50:34 [java] throw new RuntimeException(e); > 23:50:34 [java] ^^ > 23:50:34 [java] Potential resource leak: 'dataOutput' may not be closed > at this location > 23:50:34 [java] -- > 23:50:34 [java] 2. ERROR in > /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java > (at line 159) > 23:50:34 [java] throw new RuntimeException(e); > 23:50:34 [java] ^^ > 23:50:34 [java] Potential resource leak: 'dataInput' may not be closed > at this location > 23:50:34 [java] -- > 23:50:34 [java] 3. ERROR in > /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java > (at line 163) > 23:50:34 [java] return new RowCacheKey(tableId, indexName, key); > 23:50:34 [java] > 23:50:34 [java] Potential resource leak: 'dataInput' may not be closed > at this location > 23:50:34 [java] -- > 23:50:34 [java] 3 problems (3 errors) > 23:50:34 > 23:50:34 BUILD FAILED > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CASSANDRA-13164) eclipse-warnings on CASSANDRA-9425
Michael Shuler created CASSANDRA-13164: -- Summary: eclipse-warnings on CASSANDRA-9425 Key: CASSANDRA-13164 URL: https://issues.apache.org/jira/browse/CASSANDRA-13164 Project: Cassandra Issue Type: Sub-task Reporter: Michael Shuler CASSANDRA-9425 commit triggered a few eclipse-warnings on http://cassci.datastax.com/job/trunk_eclipse-warnings/1181/ cc: [~iamaleksey] {noformat} 23:50:23 eclipse-warnings: 23:50:23 [mkdir] Created dir: /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj 23:50:23 [echo] Running Eclipse Code Analysis. Output logged to /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/build/ecj/eclipse_compiler_checks.txt 23:50:34 [java] -- 23:50:34 [java] 1. ERROR in /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java (at line 138) 23:50:34 [java]throw new RuntimeException(e); 23:50:34 [java]^^ 23:50:34 [java] Potential resource leak: 'dataOutput' may not be closed at this location 23:50:34 [java] -- 23:50:34 [java] 2. ERROR in /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java (at line 159) 23:50:34 [java]throw new RuntimeException(e); 23:50:34 [java]^^ 23:50:34 [java] Potential resource leak: 'dataInput' may not be closed at this location 23:50:34 [java] -- 23:50:34 [java] 3. ERROR in /var/lib/jenkins/jobs/trunk_eclipse-warnings/workspace/src/java/org/apache/cassandra/cache/OHCProvider.java (at line 163) 23:50:34 [java]return new RowCacheKey(tableId, indexName, key); 23:50:34 [java] 23:50:34 [java] Potential resource leak: 'dataInput' may not be closed at this location 23:50:34 [java] -- 23:50:34 [java] 3 problems (3 errors) 23:50:34 23:50:34 BUILD FAILED {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (CASSANDRA-12981) Refactor ColumnCondition
[ https://issues.apache.org/jira/browse/CASSANDRA-12981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler reopened CASSANDRA-12981: new test testInMarkerWithUDTs fails with: {noformat} Error Message java.lang.Integer cannot be cast to java.lang.String Stacktrace java.lang.ClassCastException: java.lang.Integer cannot be cast to java.lang.String at org.apache.cassandra.cql3.CQLTester.userType(CQLTester.java:1481) at org.apache.cassandra.cql3.validation.operations.InsertUpdateIfConditionTest.testInMarkerWithUDTs(InsertUpdateIfConditionTest.java:1972) {noformat} http://cassci.datastax.com/job/cassandra-3.11_utest/71/testReport/org.apache.cassandra.cql3.validation.operations/InsertUpdateIfConditionTest/testInMarkerWithUDTs/ > Refactor ColumnCondition > > > Key: CASSANDRA-12981 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12981 > Project: Cassandra > Issue Type: Improvement > Components: CQL >Reporter: Benjamin Lerer >Assignee: Benjamin Lerer > > {{ColumnCondition}} has become really difficult to understand and modify. We > should separate the logic to make improvements and maintenance easier. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CASSANDRA-13125) Duplicate rows after upgrading from 2.1.16 to 3.0.10/3.9
[ https://issues.apache.org/jira/browse/CASSANDRA-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832400#comment-15832400 ] Michael Shuler commented on CASSANDRA-13125: Would this have something to do with it? {noformat} (cassandra-3.11)mshuler@hana:~/git/cassandra$ grep -r sigar-bin conf/ conf/cassandra-env.ps1:$env:JVM_OPTS = "$env:JVM_OPTS -Djava.library.path=""$env:CASSANDRA_HOME\lib\sigar-bin""" conf/cassandra-env.sh:JVM_OPTS="$JVM_OPTS -Djava.library.path=$CASSANDRA_HOME/lib/sigar-bin" (cassandra-3.11)mshuler@hana:~/git/cassandra$ grep -r sigar-bin test/conf/ (cassandra-3.11)mshuler@hana:~/git/cassandra$ {noformat} > Duplicate rows after upgrading from 2.1.16 to 3.0.10/3.9 > > > Key: CASSANDRA-13125 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13125 > Project: Cassandra > Issue Type: Bug >Reporter: Zhongxiang Zheng >Assignee: Yasuharu Goto >Priority: Critical > Attachments: diff-a.patch, diff-b.patch > > > I found that rows are splitting and duplicated after upgrading the cluster > from 2.1.x to 3.0.x. > I found the way to reproduce the problem as below. > {code} > $ ccm create test -v 2.1.16 -n 3 -s > > Current cluster is now: test > $ ccm node1 cqlsh -e "CREATE KEYSPACE test WITH replication = > {'class':'SimpleStrategy', 'replication_factor':3}" > $ ccm node1 cqlsh -e "CREATE TABLE test.test (id text PRIMARY KEY, value1 > set, value2 set);" > # Upgrade node1 > $ for i in 1; do ccm node${i} stop; ccm node${i} setdir -v3.0.10; ccm > node${i} start;ccm node${i} nodetool upgradesstables; done > # Insert a row through node1(3.0.10) > $ ccm node1 cqlsh -e "INSERT INTO test.test (id, value1, value2) values > ('aaa', {'aaa', 'bbb'}, {'ccc', 'ddd'});" > # Insert a row through node2(2.1.16) > $ ccm node2 cqlsh -e "INSERT INTO test.test (id, value1, value2) values > ('bbb', {'aaa', 'bbb'}, {'ccc', 'ddd'});" > # The row inserted from node1 is splitting > $ ccm node1 cqlsh -e "SELECT * FROM test.test ;" > id | value1 | value2 > -++ > aaa | null | null > aaa | {'aaa', 'bbb'} | {'ccc', 'ddd'} > bbb | {'aaa', 'bbb'} | {'ccc', 'ddd'} > $ for i in 1 2; do ccm node${i} nodetool flush; done > # Results of sstable2json of node2. The row inserted from node1(3.0.10) is > different from the row inserted from node2(2.1.16). > $ ccm node2 json -k test -c test > running > ['/home/zzheng/.ccm/test/node2/data0/test/test-5406ee80dbdb11e6a175f57c4c7c85f3/test-test-ka-1-Data.db'] > -- test-test-ka-1-Data.db - > [ > {"key": "aaa", > "cells": [["","",1484564624769577], >["value1","value2:!",1484564624769576,"t",1484564624], >["value1:616161","",1484564624769577], >["value1:626262","",1484564624769577], >["value2:636363","",1484564624769577], >["value2:646464","",1484564624769577]]}, > {"key": "bbb", > "cells": [["","",1484564634508029], >["value1:_","value1:!",1484564634508028,"t",1484564634], >["value1:616161","",1484564634508029], >["value1:626262","",1484564634508029], >["value2:_","value2:!",1484564634508028,"t",1484564634], >["value2:636363","",1484564634508029], >["value2:646464","",1484564634508029]]} > ] > # Upgrade node2,3 > $ for i in `seq 2 3`; do ccm node${i} stop; ccm node${i} setdir -v3.0.10; ccm > node${i} start;ccm node${i} nodetool upgradesstables; done > # After upgrade node2,3, the row inserted from node1 is splitting in node2,3 > $ ccm node2 cqlsh -e "SELECT * FROM test.test ;" > > id | value1 | value2 > -++ > aaa | null | null > aaa | {'aaa', 'bbb'} | {'ccc', 'ddd'} > bbb | {'aaa', 'bbb'} | {'ccc', 'ddd'} > (3 rows) > # Results of sstabledump > # node1 > [ > { > "partition" : { > "key" : [ "aaa" ], > "position" : 0 > }, > "rows" : [ > { > "type" : "row", > "position" : 17, > "liveness_info" : { "tstamp" : "2017-01-16T11:03:44.769577Z" }, > "cells" : [ > { "name" : "value1", "deletion_info" : { "marked_deleted" : > "2017-01-16T11:03:44.769576Z", "local_delete_time" : "2017-01-16T11:03:44Z" } > }, > { "name" : "value1", "path" : [ "aaa" ], "value" : "" }, > { "name" : "value1", "path" : [ "bbb" ], "value" : "" }, > { "name" : "value2", "deletion_info" : { "marked_deleted" : > "2017-01-16T11:03:44.769576Z", "local_delete_time" : "2017-01-16T11:03:44Z" } > }, >
[jira] [Updated] (CASSANDRA-12617) dtest failure in offline_tools_test.TestOfflineTools.sstableofflinerelevel_test
[ https://issues.apache.org/jira/browse/CASSANDRA-12617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-12617: --- Fix Version/s: (was: 3.10) 3.x > dtest failure in > offline_tools_test.TestOfflineTools.sstableofflinerelevel_test > --- > > Key: CASSANDRA-12617 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12617 > Project: Cassandra > Issue Type: Bug >Reporter: Sean McCarthy >Assignee: Carl Yeksigian > Labels: dtest, test-failure > Fix For: 3.x > > Attachments: node1_debug.log, node1_gc.log, node1.log > > > example failure: > http://cassci.datastax.com/job/trunk_offheap_dtest/391/testReport/offline_tools_test/TestOfflineTools/sstableofflinerelevel_test/ > {code} > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/offline_tools_test.py", line 212, in > sstableofflinerelevel_test > self.assertGreater(max(final_levels), 1) > File "/usr/lib/python2.7/unittest/case.py", line 942, in assertGreater > self.fail(self._formatMessage(msg, standardMsg)) > File "/usr/lib/python2.7/unittest/case.py", line 410, in fail > raise self.failureException(msg) > "1 not greater than 1 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-12617) dtest failure in offline_tools_test.TestOfflineTools.sstableofflinerelevel_test
[ https://issues.apache.org/jira/browse/CASSANDRA-12617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-12617: --- Priority: Major (was: Blocker) > dtest failure in > offline_tools_test.TestOfflineTools.sstableofflinerelevel_test > --- > > Key: CASSANDRA-12617 > URL: https://issues.apache.org/jira/browse/CASSANDRA-12617 > Project: Cassandra > Issue Type: Bug >Reporter: Sean McCarthy >Assignee: Carl Yeksigian > Labels: dtest, test-failure > Fix For: 3.x > > Attachments: node1_debug.log, node1_gc.log, node1.log > > > example failure: > http://cassci.datastax.com/job/trunk_offheap_dtest/391/testReport/offline_tools_test/TestOfflineTools/sstableofflinerelevel_test/ > {code} > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/offline_tools_test.py", line 212, in > sstableofflinerelevel_test > self.assertGreater(max(final_levels), 1) > File "/usr/lib/python2.7/unittest/case.py", line 942, in assertGreater > self.fail(self._formatMessage(msg, standardMsg)) > File "/usr/lib/python2.7/unittest/case.py", line 410, in fail > raise self.failureException(msg) > "1 not greater than 1 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CASSANDRA-13025) dtest failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test
[ https://issues.apache.org/jira/browse/CASSANDRA-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13025: --- Fix Version/s: (was: 3.0.11) (was: 3.10) 3.x 3.0.x > dtest failure in > upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test > > > Key: CASSANDRA-13025 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13025 > Project: Cassandra > Issue Type: Bug > Components: Testing >Reporter: Sean McCarthy >Assignee: Alex Petrov > Labels: dtest, test-failure > Fix For: 3.0.x, 3.x > > > example failure: > http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/28/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x/static_columns_with_distinct_test > {code} > Error Message > > {code}{code} > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/tools/decorators.py", line 46, in > wrapped > f(obj) > File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line > 4010, in static_columns_with_distinct_test > rows = list(cursor.execute("SELECT DISTINCT k, s1 FROM test2")) > File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line > 1998, in execute > return self.execute_async(query, parameters, trace, custom_payload, > timeout, execution_profile, paging_state).result() > File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line > 3784, in result > raise self._final_exception > {code}{code} > Standard Output > http://git-wip-us.apache.org/repos/asf/cassandra.git > git:7eac22dd41cb09e6d64fb5ac48b2cca3c8840cc8 > Unexpected error in node2 log, error: > ERROR [Native-Transport-Requests-2] 2016-12-08 03:20:04,861 Message.java:617 > - Unexpected exception during request; channel = [id: 0xf4c13f2c, > L:/127.0.0.2:9042 - R:/127.0.0.1:52112] > java.io.IOError: java.io.IOException: Corrupt empty row found in unfiltered > partition > at > org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:224) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:212) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:133) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.processPartition(SelectStatement.java:779) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:741) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:408) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:273) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:232) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:219) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:204) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:115) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:513) > [apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:407) > [apache-cassandra-3.9.jar:3.9] > at > io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) > [netty-all-4.0.39.Final.jar:4.0.39.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366) > [netty-all-4.0.39.Final.jar:4.0.39.Final] > at > io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java
[jira] [Updated] (CASSANDRA-13025) dtest failure in upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test
[ https://issues.apache.org/jira/browse/CASSANDRA-13025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13025: --- Priority: Major (was: Blocker) > dtest failure in > upgrade_tests.cql_tests.TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x.static_columns_with_distinct_test > > > Key: CASSANDRA-13025 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13025 > Project: Cassandra > Issue Type: Bug > Components: Testing >Reporter: Sean McCarthy >Assignee: Alex Petrov > Labels: dtest, test-failure > Fix For: 3.0.x, 3.x > > > example failure: > http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/28/testReport/upgrade_tests.cql_tests/TestCQLNodes3RF3_Upgrade_current_3_x_To_indev_3_x/static_columns_with_distinct_test > {code} > Error Message > > {code}{code} > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/tools/decorators.py", line 46, in > wrapped > f(obj) > File "/home/automaton/cassandra-dtest/upgrade_tests/cql_tests.py", line > 4010, in static_columns_with_distinct_test > rows = list(cursor.execute("SELECT DISTINCT k, s1 FROM test2")) > File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line > 1998, in execute > return self.execute_async(query, parameters, trace, custom_payload, > timeout, execution_profile, paging_state).result() > File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line > 3784, in result > raise self._final_exception > {code}{code} > Standard Output > http://git-wip-us.apache.org/repos/asf/cassandra.git > git:7eac22dd41cb09e6d64fb5ac48b2cca3c8840cc8 > Unexpected error in node2 log, error: > ERROR [Native-Transport-Requests-2] 2016-12-08 03:20:04,861 Message.java:617 > - Unexpected exception during request; channel = [id: 0xf4c13f2c, > L:/127.0.0.2:9042 - R:/127.0.0.1:52112] > java.io.IOError: java.io.IOException: Corrupt empty row found in unfiltered > partition > at > org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:224) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.db.rows.UnfilteredRowIteratorSerializer$1.computeNext(UnfilteredRowIteratorSerializer.java:212) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.db.transform.BaseRows.hasNext(BaseRows.java:133) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.processPartition(SelectStatement.java:779) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.process(SelectStatement.java:741) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.processResults(SelectStatement.java:408) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:273) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:232) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:219) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:204) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:115) > ~[apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:513) > [apache-cassandra-3.9.jar:3.9] > at > org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:407) > [apache-cassandra-3.9.jar:3.9] > at > io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) > [netty-all-4.0.39.Final.jar:4.0.39.Final] > at > io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:366) > [netty-all-4.0.39.Final.jar:4.0.39.Final] > at > io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:35) > [netty-all-4.0.39.Final.jar:4.0.39.Final] > at > io.netty.channel.Abs
[jira] [Updated] (CASSANDRA-13058) dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test
[ https://issues.apache.org/jira/browse/CASSANDRA-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13058: --- Priority: Major (was: Blocker) > dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test > -- > > Key: CASSANDRA-13058 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13058 > Project: Cassandra > Issue Type: Test > Components: Testing >Reporter: Sean McCarthy >Assignee: Stefan Podkowinski > Labels: dtest, test-failure > Fix For: 3.x > > Attachments: 13058-3.x.patch, node1_debug.log, node1_gc.log, > node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, > node3_gc.log, node3.log, node4_debug.log, node4_gc.log, node4.log > > > example failure: > http://cassci.datastax.com/job/cassandra-3.X_novnode_dtest/16/testReport/hintedhandoff_test/TestHintedHandoff/hintedhandoff_decom_test/ > {code} > Error Message > Subprocess ['nodetool', '-h', 'localhost', '-p', '7100', ['decommission']] > exited with non-zero status; exit status: 2; > stderr: error: Error while decommissioning node: Failed to transfer all hints > to 59f20b4f-0215-4e18-be1b-7e00f2901629 > {code}{code} > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/hintedhandoff_test.py", line 167, in > hintedhandoff_decom_test > node1.decommission() > File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1314, in > decommission > self.nodetool("decommission") > File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 783, in > nodetool > return handle_external_tool_process(p, ['nodetool', '-h', 'localhost', > '-p', str(self.jmx_port), cmd.split()]) > File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1993, in > handle_external_tool_process > raise ToolError(cmd_args, rc, out, err) > {code}{code} > java.lang.RuntimeException: Error while decommissioning node: Failed to > transfer all hints to 59f20b4f-0215-4e18-be1b-7e00f2901629 > at > org.apache.cassandra.service.StorageService.decommission(StorageService.java:3924) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275) > at > com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112) > at > com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46) > at > com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237) > at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138) > at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:252) > at > com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819) > at > com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:801) > at > javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1466) > at > javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76) > at > javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1307) > at > javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1399) > at > javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:828) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:323) > at sun.rmi.transport.Transport$1.run(Transport.java:200) > at sun.rmi.transport.Transport$1.run(Transport.java:197) > at java.security.AccessController.doPrivileged(Native Method) > at sun.rmi.
[jira] [Updated] (CASSANDRA-13058) dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test
[ https://issues.apache.org/jira/browse/CASSANDRA-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler updated CASSANDRA-13058: --- Fix Version/s: (was: 3.10) 3.x > dtest failure in hintedhandoff_test.TestHintedHandoff.hintedhandoff_decom_test > -- > > Key: CASSANDRA-13058 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13058 > Project: Cassandra > Issue Type: Test > Components: Testing >Reporter: Sean McCarthy >Assignee: Stefan Podkowinski > Labels: dtest, test-failure > Fix For: 3.x > > Attachments: 13058-3.x.patch, node1_debug.log, node1_gc.log, > node1.log, node2_debug.log, node2_gc.log, node2.log, node3_debug.log, > node3_gc.log, node3.log, node4_debug.log, node4_gc.log, node4.log > > > example failure: > http://cassci.datastax.com/job/cassandra-3.X_novnode_dtest/16/testReport/hintedhandoff_test/TestHintedHandoff/hintedhandoff_decom_test/ > {code} > Error Message > Subprocess ['nodetool', '-h', 'localhost', '-p', '7100', ['decommission']] > exited with non-zero status; exit status: 2; > stderr: error: Error while decommissioning node: Failed to transfer all hints > to 59f20b4f-0215-4e18-be1b-7e00f2901629 > {code}{code} > Stacktrace > File "/usr/lib/python2.7/unittest/case.py", line 329, in run > testMethod() > File "/home/automaton/cassandra-dtest/hintedhandoff_test.py", line 167, in > hintedhandoff_decom_test > node1.decommission() > File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1314, in > decommission > self.nodetool("decommission") > File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 783, in > nodetool > return handle_external_tool_process(p, ['nodetool', '-h', 'localhost', > '-p', str(self.jmx_port), cmd.split()]) > File "/usr/local/lib/python2.7/dist-packages/ccmlib/node.py", line 1993, in > handle_external_tool_process > raise ToolError(cmd_args, rc, out, err) > {code}{code} > java.lang.RuntimeException: Error while decommissioning node: Failed to > transfer all hints to 59f20b4f-0215-4e18-be1b-7e00f2901629 > at > org.apache.cassandra.service.StorageService.decommission(StorageService.java:3924) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275) > at > com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112) > at > com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46) > at > com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237) > at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138) > at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:252) > at > com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819) > at > com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:801) > at > javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1466) > at > javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76) > at > javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1307) > at > javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1399) > at > javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:828) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:323) > at sun.rmi.transport.Transport$1.run(Transport.java:200) > at sun.rmi.transport.Transport$1.run(Transport.java:197) > at java.security.AccessController.doPrivileged(Native Metho
[jira] [Created] (CASSANDRA-13102) test failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts
Michael Shuler created CASSANDRA-13102: -- Summary: test failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_bulk_round_trip_blogposts Key: CASSANDRA-13102 URL: https://issues.apache.org/jira/browse/CASSANDRA-13102 Project: Cassandra Issue Type: Bug Reporter: Michael Shuler example failure: http://cassci.datastax.com/job/cassandra-3.0_dtest/875/testReport/cqlsh_tests.cqlsh_copy_tests/CqlshCopyTest/test_bulk_round_trip_blogposts {noformat} Error Message ('Unable to connect to any servers', {'127.0.0.1': error(111, "Tried connecting to [('127.0.0.1', 9042)]. Last error: Connection refused")}) >> begin captured logging << dtest: DEBUG: cluster ccm directory: /tmp/dtest-1c8hQM dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} dtest: DEBUG: removing ccm cluster test at: /tmp/dtest-1c8hQM dtest: DEBUG: clearing ssl stores from [/tmp/dtest-1c8hQM] directory dtest: DEBUG: cluster ccm directory: /tmp/dtest-C2OXmx dtest: DEBUG: Done setting configuration options: { 'initial_token': None, 'num_tokens': '32', 'phi_convict_threshold': 5, 'range_request_timeout_in_ms': 1, 'read_request_timeout_in_ms': 1, 'request_timeout_in_ms': 1, 'truncate_request_timeout_in_ms': 1, 'write_request_timeout_in_ms': 1} - >> end captured logging << - Stacktrace File "/usr/lib/python2.7/unittest/case.py", line 329, in run testMethod() File "/home/automaton/cassandra-dtest/dtest.py", line 1079, in wrapped f(obj) File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 2553, in test_bulk_round_trip_blogposts stress_table='stresscql.blogposts') File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 2456, in _test_bulk_round_trip self.prepare(nodes=nodes, partitioner=partitioner, configuration_options=configuration_options) File "/home/automaton/cassandra-dtest/cqlsh_tests/cqlsh_copy_tests.py", line 129, in prepare self.session = self.patient_cql_connection(self.node1) File "/home/automaton/cassandra-dtest/dtest.py", line 508, in patient_cql_connection bypassed_exception=NoHostAvailable File "/home/automaton/cassandra-dtest/dtest.py", line 201, in retry_till_success return fun(*args, **kwargs) File "/home/automaton/cassandra-dtest/dtest.py", line 441, in cql_connection protocol_version, port=port, ssl_opts=ssl_opts) File "/home/automaton/cassandra-dtest/dtest.py", line 469, in _create_session session = cluster.connect(wait_for_all_pools=True) File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 1180, in connect self.control_connection.connect() File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 2597, in connect self._set_new_connection(self._reconnect_internal()) File "/home/automaton/src/cassandra-driver/cassandra/cluster.py", line 2634, in _reconnect_internal raise NoHostAvailable("Unable to connect to any servers", errors) '(\'Unable to connect to any servers\', {\'127.0.0.1\': error(111, "Tried connecting to [(\'127.0.0.1\', 9042)]. Last error: Connection refused")})\n >> begin captured logging << \ndtest: DEBUG: cluster ccm directory: /tmp/dtest-1c8hQM\ndtest: DEBUG: Done setting configuration options:\n{ \'initial_token\': None,\n\'num_tokens\': \'32\',\n \'phi_convict_threshold\': 5,\n\'range_request_timeout_in_ms\': 1,\n \'read_request_timeout_in_ms\': 1,\n\'request_timeout_in_ms\': 1,\n \'truncate_request_timeout_in_ms\': 1,\n \'write_request_timeout_in_ms\': 1}\ndtest: DEBUG: removing ccm cluster test at: /tmp/dtest-1c8hQM\ndtest: DEBUG: clearing ssl stores from [/tmp/dtest-1c8hQM] directory\ndtest: DEBUG: cluster ccm directory: /tmp/dtest-C2OXmx\ndtest: DEBUG: Done setting configuration options:\n{ \'initial_token\': None,\n\'num_tokens\': \'32\',\n \'phi_convict_threshold\': 5,\n\'range_request_timeout_in_ms\': 1,\n \'read_request_timeout_in_ms\': 1,\n\'request_timeout_in_ms\': 1,\n \'truncate_request_timeout_in_ms\': 1,\n \'write_request_timeout_in_ms\': 1}\n- >> end captured logging << -' {noformat} (No node log file from test) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (CASSANDRA-13046) Missing PID file directory when installing from RPM
[ https://issues.apache.org/jira/browse/CASSANDRA-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Shuler resolved CASSANDRA-13046. Resolution: Fixed Committed to 2.2 and merged up. Thanks! https://github.com/apache/cassandra/commit/3d90bb0cc74ca52fc6a9947a746695630ca7fc2a > Missing PID file directory when installing from RPM > --- > > Key: CASSANDRA-13046 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13046 > Project: Cassandra > Issue Type: Bug > Components: Packaging > Environment: CentOS 7.3 >Reporter: Marcel Dopita >Assignee: Michael Shuler >Priority: Minor > Fix For: 2.2.9, 3.0.11, 3.10 > > > As already reported in CASSANDRA-10920, changes to /var/run/cassandra folder > are not persistent across reboots and therefore saving pid file to that > location fails. This causes trouble when managing the status of the cassandra > service. > The linked issue mentions good enough (and working) workaround (compared to > writing new service file for systemd). > Trunk now contains files necessary to produce RHEL compatible RPM in the > /redhat folder. -- This message was sent by Atlassian JIRA (v6.3.4#6332)