[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-25 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436896#comment-15436896 ] n0rad commented on CASSANDRA-11594: --- actually, it's the repair command that was stuck at 4% the

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-25 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436867#comment-15436867 ] n0rad commented on CASSANDRA-11594: --- I have repaired 3 nodes without going over 600 openfiles. But

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-25 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436471#comment-15436471 ] n0rad commented on CASSANDRA-11594: --- I'm on 3.0.8. A jar is welcome > Too many open files on

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-25 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436405#comment-15436405 ] n0rad commented on CASSANDRA-11594: --- I have a prometheus exporter that go through everything

[jira] [Comment Edited] (CASSANDRA-11594) Too many open files on directories

2016-08-23 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432661#comment-15432661 ] n0rad edited comment on CASSANDRA-11594 at 8/23/16 12:20 PM: - So

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-23 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432669#comment-15432669 ] n0rad commented on CASSANDRA-11594: --- dump is here :

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-23 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432661#comment-15432661 ] n0rad commented on CASSANDRA-11594: --- So yesterday, I worked on getting a dump :

[jira] [Updated] (CASSANDRA-11594) Too many open files on directories

2016-08-23 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad updated CASSANDRA-11594: -- Attachment: Grafana Cassandra Cluster.png > Too many open files on directories >

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-16 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422580#comment-15422580 ] n0rad commented on CASSANDRA-11594: --- Sorry It's actually 2 keyspaces : {code} CREATE KEYSPACE

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-16 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422453#comment-15422453 ] n0rad commented on CASSANDRA-11594: --- Normal activity make it grow slowly. Repair make it grow

[jira] [Commented] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-08-15 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421832#comment-15421832 ] n0rad commented on CASSANDRA-11595: --- I disagree, It's up to you, but the thing that an empty

[jira] [Commented] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-08-15 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421432#comment-15421432 ] n0rad commented on CASSANDRA-11595: --- I also forgot to tell that the following CASSANDRA-11594, I

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-08-11 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416715#comment-15416715 ] n0rad commented on CASSANDRA-11594: --- A comment to let you know that it still occur on 3.0.7, the

[jira] [Commented] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-08-11 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416712#comment-15416712 ] n0rad commented on CASSANDRA-11595: --- I forgot to tell that to be able to restart, I moved

[jira] [Comment Edited] (CASSANDRA-11594) Too many open files on directories

2016-04-22 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253573#comment-15253573 ] n0rad edited comment on CASSANDRA-11594 at 4/22/16 9:02 AM:

[jira] [Comment Edited] (CASSANDRA-11594) Too many open files on directories

2016-04-22 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253573#comment-15253573 ] n0rad edited comment on CASSANDRA-11594 at 4/22/16 9:01 AM:

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-04-22 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253573#comment-15253573 ] n0rad commented on CASSANDRA-11594: --- emails_by_user_id is is a MV. email_logs_query is the

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-04-20 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249446#comment-15249446 ] n0rad commented on CASSANDRA-11594: --- Probably not in the repair process itself. the first crash was

[jira] [Updated] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad updated CASSANDRA-11594: -- Attachment: openfiles.zip I've just attached the list of open files on cassandra process on node 1

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246402#comment-15246402 ] n0rad commented on CASSANDRA-11594: --- on the 15 at start, a little bit more activity than usual with

[jira] [Comment Edited] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246363#comment-15246363 ] n0rad edited comment on CASSANDRA-11594 at 4/18/16 7:19 PM: here is the

[jira] [Updated] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad updated CASSANDRA-11594: -- Attachment: screenshot.png here is the evolution of openfiles on 4 days on all servers. I don't

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245826#comment-15245826 ] n0rad commented on CASSANDRA-11594: --- I have restarted all down nodes and run a full repair on 1

[jira] [Commented] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245751#comment-15245751 ] n0rad commented on CASSANDRA-11595: --- It happens on 4 out of 6 nodes of the cluster. the 2 others

[jira] [Commented] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245584#comment-15245584 ] n0rad commented on CASSANDRA-11595: --- it's mixed up with gc but here is the final logs of the

[jira] [Commented] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245520#comment-15245520 ] n0rad commented on CASSANDRA-11595: --- I think the 2 problems are linked. I have found :

[jira] [Commented] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245495#comment-15245495 ] n0rad commented on CASSANDRA-11594: --- no, default conf on this part > Too many open files on

[jira] [Updated] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad updated CASSANDRA-11595: -- Description: After the crash of CASSANDRA-11594. Cassandra try to restart and fail because of

[jira] [Created] (CASSANDRA-11595) Cassandra cannot start because of empty commitlog

2016-04-18 Thread n0rad (JIRA)
n0rad created CASSANDRA-11595: - Summary: Cassandra cannot start because of empty commitlog Key: CASSANDRA-11595 URL: https://issues.apache.org/jira/browse/CASSANDRA-11595 Project: Cassandra

[jira] [Updated] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad updated CASSANDRA-11594: -- Description: I have a 6 nodes cluster in prod in 3 racks. each node : - 4Gb commitlogs on 343

[jira] [Updated] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad updated CASSANDRA-11594: -- Description: I have a 6 nodes cluster in prod in 3 racks. each node : - 4Gb commitlogs on 343

[jira] [Updated] (CASSANDRA-11594) Too many open files on directories

2016-04-18 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad updated CASSANDRA-11594: -- Summary: Too many open files on directories (was: Too many open files on directory) > Too many

[jira] [Created] (CASSANDRA-11594) Too many open files on directory

2016-04-18 Thread n0rad (JIRA)
n0rad created CASSANDRA-11594: - Summary: Too many open files on directory Key: CASSANDRA-11594 URL: https://issues.apache.org/jira/browse/CASSANDRA-11594 Project: Cassandra Issue Type: Bug

[jira] [Reopened] (CASSANDRA-11107) rpc_address is required for native protocol

2016-02-03 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] n0rad reopened CASSANDRA-11107: --- Reproduced In: 3.0.2, 2.2.4 (was: 2.2.4, 3.0.2) The problem is that I want to start the native

[jira] [Created] (CASSANDRA-11107) rpc_address is required for native protocol

2016-02-02 Thread n0rad (JIRA)
n0rad created CASSANDRA-11107: - Summary: rpc_address is required for native protocol Key: CASSANDRA-11107 URL: https://issues.apache.org/jira/browse/CASSANDRA-11107 Project: Cassandra Issue

[jira] [Commented] (CASSANDRA-9734) Assertion error on resultset after upgrading from 2.1.6 to 2.1.7

2015-07-06 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614763#comment-14614763 ] n0rad commented on CASSANDRA-9734: -- I downgraded to 2.1.6 and it get back to normal

[jira] [Created] (CASSANDRA-9734) Assertion error on resultset after upgrading from 2.1.6 to 2.1.7

2015-07-06 Thread n0rad (JIRA)
n0rad created CASSANDRA-9734: Summary: Assertion error on resultset after upgrading from 2.1.6 to 2.1.7 Key: CASSANDRA-9734 URL: https://issues.apache.org/jira/browse/CASSANDRA-9734 Project: Cassandra

[jira] [Commented] (CASSANDRA-9734) Assertion error on resultset after upgrading from 2.1.6 to 2.1.7

2015-07-06 Thread n0rad (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615035#comment-14615035 ] n0rad commented on CASSANDRA-9734: -- Sorry, I didn't see it. Assertion error on