[jira] [Commented] (CASSANDRA-11039) SegFault in Cassandra
[
https://issues.apache.org/jira/browse/CASSANDRA-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657865#comment-15657865
]
Michael Shuler commented on CASSANDRA-11039:
+1
The dtest run looks like known issues, too.
> SegFault in Cassandra
> -
>
> Key: CASSANDRA-11039
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11039
> Project: Cassandra
> Issue Type: Bug
> Components: Configuration
> Environment: Kernel: Linux cass6 3.13.0-44-generic
> #73~precise1-Ubuntu SMP Wed Dec 17 00:39:15 UTC 2014 x86_64 x86_64 x86_64
> GNU/Linux
> OS: Ubuntu 12.04.5 LTS (GNU/Linux 3.13.0-44-generic x86_64)
> JVM:
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
>Reporter: Nimi Wariboko Jr.
>Assignee: T Jake Luciani
>Priority: Blocker
> Fix For: 3.0.10
>
>
> This occurred under quite heavy load.
> Attached is the dump that was spit out by Cassandra, and my cassandra.yaml
> hs_err_1453233896.log:
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/hs_err_1453233896.log
> cassandra.yaml
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/cassandra.yaml
> Process Options:
> {code}
> java -ea -Xms16G -Xmx16G -Xss256k -XX:+UseG1GC
> -XX:G1RSetUpdatingPauseTimePercent=5 -XX:MaxGCPauseMillis=500
> -XX:InitiatingHeapOccupancyPercent=70 -XX:+AlwaysPreTouch
> -XX:-UseBiasedLocking -XX:StringTableSize=103 -XX:+UseTLAB
> -XX:+ResizeTLAB -XX:+PerfDisableSharedMem
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+UseThreadPriorities
> -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError
> -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199
> -XX:+DisableExplicitGC -Djava.library.path=/usr/share/cassandra/lib/sigar-bin
> -Dcassandra.metricsReporterConfigFile=/etc/cassandra-metrics-graphite.yaml
> -Dcassandra.libjemalloc=- -Dlogback.configurationFile=logback.xml
> -Dcassandra.logdir=/var/log/cassandra
> -Dcassandra.storagedir=/var/lib/cassandra
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp
> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.0-beta1-bb1bce4-SNAPSHOT-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jna-4.0.0.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.2.jar:/usr/share/cassandra/lib/metrics-graphite-2.2.0.jar:/usr/share/cassandra/lib/metrics-graphite-3.1.2.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.23.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.2.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.2.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.0.jar:/usr/share/cassandra/lib/reporter-config3-3.0.0.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.2.jar:/usr/share/cassandra/apache-cassandra-thrift-3.2.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar:
> -XX:HeapDumpPath=/var/lib/cassandra/java_1453248542.hprof
> -XX:ErrorFile=/var/lib/cassandra/hs_err_1453248542.log
> org.apache.cassandra.service.CassandraDaemon
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-11039) SegFault in Cassandra
[
https://issues.apache.org/jira/browse/CASSANDRA-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657760#comment-15657760
]
Michael Shuler commented on CASSANDRA-11039:
`git grep` says we don't use offheap_buffers anywhere in dtest.
The testall run looks good (1 error: CASSANDRA-12818 is a known timeout).
Waiting on dtest run to complete.
> SegFault in Cassandra
> -
>
> Key: CASSANDRA-11039
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11039
> Project: Cassandra
> Issue Type: Bug
> Components: Configuration
> Environment: Kernel: Linux cass6 3.13.0-44-generic
> #73~precise1-Ubuntu SMP Wed Dec 17 00:39:15 UTC 2014 x86_64 x86_64 x86_64
> GNU/Linux
> OS: Ubuntu 12.04.5 LTS (GNU/Linux 3.13.0-44-generic x86_64)
> JVM:
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
>Reporter: Nimi Wariboko Jr.
>Assignee: T Jake Luciani
>Priority: Blocker
> Fix For: 3.0.10
>
>
> This occurred under quite heavy load.
> Attached is the dump that was spit out by Cassandra, and my cassandra.yaml
> hs_err_1453233896.log:
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/hs_err_1453233896.log
> cassandra.yaml
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/cassandra.yaml
> Process Options:
> {code}
> java -ea -Xms16G -Xmx16G -Xss256k -XX:+UseG1GC
> -XX:G1RSetUpdatingPauseTimePercent=5 -XX:MaxGCPauseMillis=500
> -XX:InitiatingHeapOccupancyPercent=70 -XX:+AlwaysPreTouch
> -XX:-UseBiasedLocking -XX:StringTableSize=103 -XX:+UseTLAB
> -XX:+ResizeTLAB -XX:+PerfDisableSharedMem
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+UseThreadPriorities
> -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError
> -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199
> -XX:+DisableExplicitGC -Djava.library.path=/usr/share/cassandra/lib/sigar-bin
> -Dcassandra.metricsReporterConfigFile=/etc/cassandra-metrics-graphite.yaml
> -Dcassandra.libjemalloc=- -Dlogback.configurationFile=logback.xml
> -Dcassandra.logdir=/var/log/cassandra
> -Dcassandra.storagedir=/var/lib/cassandra
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp
> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.0-beta1-bb1bce4-SNAPSHOT-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jna-4.0.0.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.2.jar:/usr/share/cassandra/lib/metrics-graphite-2.2.0.jar:/usr/share/cassandra/lib/metrics-graphite-3.1.2.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.23.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.2.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.2.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.0.jar:/usr/share/cassandra/lib/reporter-config3-3.0.0.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.2.jar:/usr/share/cassandra/apache-cassandra-thrift-3.2.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar:
> -XX:HeapDumpPath=/var/lib/cassandra/java_1453248542.hprof
> -XX:ErrorFile=/var/lib/cassandra/hs_err_1453248542.log
> org.apache.cassandra.service.CassandraDaemon
> {code}
--
This message was
[jira] [Commented] (CASSANDRA-11039) SegFault in Cassandra
[
https://issues.apache.org/jira/browse/CASSANDRA-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657497#comment-15657497
]
T Jake Luciani commented on CASSANDRA-11039:
[branch|https://github.com/tjake/cassandra/tree/CASSANDRA-11039]
[testall|http://cassci.datastax.com/job/tjake-CASSANDRA-11039-dtest]
[dtest|http://cassci.datastax.com/job/tjake-CASSANDRA-11039-testall]
Tiny patch. running through the tests to verify no tests try offheap_buffers
> SegFault in Cassandra
> -
>
> Key: CASSANDRA-11039
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11039
> Project: Cassandra
> Issue Type: Bug
> Components: Configuration
> Environment: Kernel: Linux cass6 3.13.0-44-generic
> #73~precise1-Ubuntu SMP Wed Dec 17 00:39:15 UTC 2014 x86_64 x86_64 x86_64
> GNU/Linux
> OS: Ubuntu 12.04.5 LTS (GNU/Linux 3.13.0-44-generic x86_64)
> JVM:
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
>Reporter: Nimi Wariboko Jr.
>Assignee: T Jake Luciani
>Priority: Blocker
> Fix For: 3.0.x
>
>
> This occurred under quite heavy load.
> Attached is the dump that was spit out by Cassandra, and my cassandra.yaml
> hs_err_1453233896.log:
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/hs_err_1453233896.log
> cassandra.yaml
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/cassandra.yaml
> Process Options:
> {code}
> java -ea -Xms16G -Xmx16G -Xss256k -XX:+UseG1GC
> -XX:G1RSetUpdatingPauseTimePercent=5 -XX:MaxGCPauseMillis=500
> -XX:InitiatingHeapOccupancyPercent=70 -XX:+AlwaysPreTouch
> -XX:-UseBiasedLocking -XX:StringTableSize=103 -XX:+UseTLAB
> -XX:+ResizeTLAB -XX:+PerfDisableSharedMem
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+UseThreadPriorities
> -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError
> -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199
> -XX:+DisableExplicitGC -Djava.library.path=/usr/share/cassandra/lib/sigar-bin
> -Dcassandra.metricsReporterConfigFile=/etc/cassandra-metrics-graphite.yaml
> -Dcassandra.libjemalloc=- -Dlogback.configurationFile=logback.xml
> -Dcassandra.logdir=/var/log/cassandra
> -Dcassandra.storagedir=/var/lib/cassandra
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp
> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.0-beta1-bb1bce4-SNAPSHOT-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jna-4.0.0.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.2.jar:/usr/share/cassandra/lib/metrics-graphite-2.2.0.jar:/usr/share/cassandra/lib/metrics-graphite-3.1.2.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.23.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.2.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.2.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.0.jar:/usr/share/cassandra/lib/reporter-config3-3.0.0.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.2.jar:/usr/share/cassandra/apache-cassandra-thrift-3.2.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar:
> -XX:HeapDumpPath=/var/lib/cassandra/java_1453248542.hprof
>
[jira] [Commented] (CASSANDRA-11039) SegFault in Cassandra
[
https://issues.apache.org/jira/browse/CASSANDRA-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118946#comment-15118946
]
Benedict commented on CASSANDRA-11039:
--
Well, that was a mistake/oversight with either CASSANDRA-10437 (for not
disabling them) or CASSANDRA-8099 (for not ensuring they worked); either way I
suggest you don't use them until CASSANDRA-9472
> SegFault in Cassandra
> -
>
> Key: CASSANDRA-11039
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11039
> Project: Cassandra
> Issue Type: Bug
> Environment: Kernel: Linux cass6 3.13.0-44-generic
> #73~precise1-Ubuntu SMP Wed Dec 17 00:39:15 UTC 2014 x86_64 x86_64 x86_64
> GNU/Linux
> OS: Ubuntu 12.04.5 LTS (GNU/Linux 3.13.0-44-generic x86_64)
> JVM:
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
>Reporter: Nimi Wariboko Jr.
> Fix For: 3.2
>
>
> This occurred under quite heavy load.
> Attached is the dump that was spit out by Cassandra, and my cassandra.yaml
> hs_err_1453233896.log:
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/hs_err_1453233896.log
> cassandra.yaml
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/cassandra.yaml
> Process Options:
> {code}
> java -ea -Xms16G -Xmx16G -Xss256k -XX:+UseG1GC
> -XX:G1RSetUpdatingPauseTimePercent=5 -XX:MaxGCPauseMillis=500
> -XX:InitiatingHeapOccupancyPercent=70 -XX:+AlwaysPreTouch
> -XX:-UseBiasedLocking -XX:StringTableSize=103 -XX:+UseTLAB
> -XX:+ResizeTLAB -XX:+PerfDisableSharedMem
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+UseThreadPriorities
> -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError
> -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199
> -XX:+DisableExplicitGC -Djava.library.path=/usr/share/cassandra/lib/sigar-bin
> -Dcassandra.metricsReporterConfigFile=/etc/cassandra-metrics-graphite.yaml
> -Dcassandra.libjemalloc=- -Dlogback.configurationFile=logback.xml
> -Dcassandra.logdir=/var/log/cassandra
> -Dcassandra.storagedir=/var/lib/cassandra
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp
> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.0-beta1-bb1bce4-SNAPSHOT-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jna-4.0.0.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.2.jar:/usr/share/cassandra/lib/metrics-graphite-2.2.0.jar:/usr/share/cassandra/lib/metrics-graphite-3.1.2.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.23.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.2.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.2.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.0.jar:/usr/share/cassandra/lib/reporter-config3-3.0.0.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.2.jar:/usr/share/cassandra/apache-cassandra-thrift-3.2.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar:
> -XX:HeapDumpPath=/var/lib/cassandra/java_1453248542.hprof
> -XX:ErrorFile=/var/lib/cassandra/hs_err_1453248542.log
> org.apache.cassandra.service.CassandraDaemon
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-11039) SegFault in Cassandra
[
https://issues.apache.org/jira/browse/CASSANDRA-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117871#comment-15117871
]
Nimi Wariboko Jr. commented on CASSANDRA-11039:
---
I can confirm offheap_objects is disabled (Cassandra won't start with this
option), but offheap_buffers is still usable (and Cassandra will start and run)
with the offheap_buffers in 3.2.
> SegFault in Cassandra
> -
>
> Key: CASSANDRA-11039
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11039
> Project: Cassandra
> Issue Type: Bug
> Environment: Kernel: Linux cass6 3.13.0-44-generic
> #73~precise1-Ubuntu SMP Wed Dec 17 00:39:15 UTC 2014 x86_64 x86_64 x86_64
> GNU/Linux
> OS: Ubuntu 12.04.5 LTS (GNU/Linux 3.13.0-44-generic x86_64)
> JVM:
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
>Reporter: Nimi Wariboko Jr.
> Fix For: 3.2
>
>
> This occurred under quite heavy load.
> Attached is the dump that was spit out by Cassandra, and my cassandra.yaml
> hs_err_1453233896.log:
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/hs_err_1453233896.log
> cassandra.yaml
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/cassandra.yaml
> Process Options:
> {code}
> java -ea -Xms16G -Xmx16G -Xss256k -XX:+UseG1GC
> -XX:G1RSetUpdatingPauseTimePercent=5 -XX:MaxGCPauseMillis=500
> -XX:InitiatingHeapOccupancyPercent=70 -XX:+AlwaysPreTouch
> -XX:-UseBiasedLocking -XX:StringTableSize=103 -XX:+UseTLAB
> -XX:+ResizeTLAB -XX:+PerfDisableSharedMem
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+UseThreadPriorities
> -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError
> -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199
> -XX:+DisableExplicitGC -Djava.library.path=/usr/share/cassandra/lib/sigar-bin
> -Dcassandra.metricsReporterConfigFile=/etc/cassandra-metrics-graphite.yaml
> -Dcassandra.libjemalloc=- -Dlogback.configurationFile=logback.xml
> -Dcassandra.logdir=/var/log/cassandra
> -Dcassandra.storagedir=/var/lib/cassandra
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp
> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.0-beta1-bb1bce4-SNAPSHOT-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jna-4.0.0.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.2.jar:/usr/share/cassandra/lib/metrics-graphite-2.2.0.jar:/usr/share/cassandra/lib/metrics-graphite-3.1.2.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.23.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.2.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.2.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.0.jar:/usr/share/cassandra/lib/reporter-config3-3.0.0.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.2.jar:/usr/share/cassandra/apache-cassandra-thrift-3.2.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar:
> -XX:HeapDumpPath=/var/lib/cassandra/java_1453248542.hprof
> -XX:ErrorFile=/var/lib/cassandra/hs_err_1453248542.log
> org.apache.cassandra.service.CassandraDaemon
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-11039) SegFault in Cassandra
[
https://issues.apache.org/jira/browse/CASSANDRA-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118303#comment-15118303
]
Nimi Wariboko Jr. commented on CASSANDRA-11039:
---
According to CASSANDRA-10437, only offheap_objects. offheap_buffers remains
supported.
> SegFault in Cassandra
> -
>
> Key: CASSANDRA-11039
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11039
> Project: Cassandra
> Issue Type: Bug
> Environment: Kernel: Linux cass6 3.13.0-44-generic
> #73~precise1-Ubuntu SMP Wed Dec 17 00:39:15 UTC 2014 x86_64 x86_64 x86_64
> GNU/Linux
> OS: Ubuntu 12.04.5 LTS (GNU/Linux 3.13.0-44-generic x86_64)
> JVM:
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
>Reporter: Nimi Wariboko Jr.
> Fix For: 3.2
>
>
> This occurred under quite heavy load.
> Attached is the dump that was spit out by Cassandra, and my cassandra.yaml
> hs_err_1453233896.log:
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/hs_err_1453233896.log
> cassandra.yaml
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/cassandra.yaml
> Process Options:
> {code}
> java -ea -Xms16G -Xmx16G -Xss256k -XX:+UseG1GC
> -XX:G1RSetUpdatingPauseTimePercent=5 -XX:MaxGCPauseMillis=500
> -XX:InitiatingHeapOccupancyPercent=70 -XX:+AlwaysPreTouch
> -XX:-UseBiasedLocking -XX:StringTableSize=103 -XX:+UseTLAB
> -XX:+ResizeTLAB -XX:+PerfDisableSharedMem
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+UseThreadPriorities
> -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError
> -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199
> -XX:+DisableExplicitGC -Djava.library.path=/usr/share/cassandra/lib/sigar-bin
> -Dcassandra.metricsReporterConfigFile=/etc/cassandra-metrics-graphite.yaml
> -Dcassandra.libjemalloc=- -Dlogback.configurationFile=logback.xml
> -Dcassandra.logdir=/var/log/cassandra
> -Dcassandra.storagedir=/var/lib/cassandra
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp
> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.0-beta1-bb1bce4-SNAPSHOT-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jna-4.0.0.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.2.jar:/usr/share/cassandra/lib/metrics-graphite-2.2.0.jar:/usr/share/cassandra/lib/metrics-graphite-3.1.2.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.23.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.2.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.2.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.0.jar:/usr/share/cassandra/lib/reporter-config3-3.0.0.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.2.jar:/usr/share/cassandra/apache-cassandra-thrift-3.2.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar:
> -XX:HeapDumpPath=/var/lib/cassandra/java_1453248542.hprof
> -XX:ErrorFile=/var/lib/cassandra/hs_err_1453248542.log
> org.apache.cassandra.service.CassandraDaemon
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (CASSANDRA-11039) SegFault in Cassandra
[
https://issues.apache.org/jira/browse/CASSANDRA-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117493#comment-15117493
]
Benedict commented on CASSANDRA-11039:
--
It looks like you're running with offheap_buffers, which aren't supposed to be
permitted I don't think for 3.x yet - it's a bug that the process doesn't fail
on startup (or, if they are supposed to be supported, that was itself a
mistake).
3.4 should hopefully be reintroducing support for this along with
offheap_objects
> SegFault in Cassandra
> -
>
> Key: CASSANDRA-11039
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11039
> Project: Cassandra
> Issue Type: Bug
> Environment: Kernel: Linux cass6 3.13.0-44-generic
> #73~precise1-Ubuntu SMP Wed Dec 17 00:39:15 UTC 2014 x86_64 x86_64 x86_64
> GNU/Linux
> OS: Ubuntu 12.04.5 LTS (GNU/Linux 3.13.0-44-generic x86_64)
> JVM:
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Java HotSpot(TM) 64-Bit Server VM (build 25.66-b17, mixed mode)
>Reporter: Nimi Wariboko Jr.
> Fix For: 3.2
>
>
> This occurred under quite heavy load.
> Attached is the dump that was spit out by Cassandra, and my cassandra.yaml
> hs_err_1453233896.log:
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/hs_err_1453233896.log
> cassandra.yaml
> https://s3-us-west-1.amazonaws.com/channelmeter-misc/cassandra.yaml
> Process Options:
> {code}
> java -ea -Xms16G -Xmx16G -Xss256k -XX:+UseG1GC
> -XX:G1RSetUpdatingPauseTimePercent=5 -XX:MaxGCPauseMillis=500
> -XX:InitiatingHeapOccupancyPercent=70 -XX:+AlwaysPreTouch
> -XX:-UseBiasedLocking -XX:StringTableSize=103 -XX:+UseTLAB
> -XX:+ResizeTLAB -XX:+PerfDisableSharedMem
> -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler
> -javaagent:/usr/share/cassandra/lib/jamm-0.3.0.jar -XX:+UseThreadPriorities
> -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError
> -Djava.net.preferIPv4Stack=true -Dcassandra.jmx.local.port=7199
> -XX:+DisableExplicitGC -Djava.library.path=/usr/share/cassandra/lib/sigar-bin
> -Dcassandra.metricsReporterConfigFile=/etc/cassandra-metrics-graphite.yaml
> -Dcassandra.libjemalloc=- -Dlogback.configurationFile=logback.xml
> -Dcassandra.logdir=/var/log/cassandra
> -Dcassandra.storagedir=/var/lib/cassandra
> -Dcassandra-pidfile=/var/run/cassandra/cassandra.pid -cp
> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandra/lib/antlr-runtime-3.5.2.jar:/usr/share/cassandra/lib/asm-5.0.4.jar:/usr/share/cassandra/lib/cassandra-driver-core-3.0.0-beta1-bb1bce4-SNAPSHOT-shaded.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang3-3.1.jar:/usr/share/cassandra/lib/commons-math3-3.2.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/share/cassandra/lib/disruptor-3.0.1.jar:/usr/share/cassandra/lib/ecj-4.4.2.jar:/usr/share/cassandra/lib/guava-18.0.jar:/usr/share/cassandra/lib/high-scale-lib-1.0.6.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.3.0.jar:/usr/share/cassandra/lib/javax.inject.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jcl-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/jna-4.0.0.jar:/usr/share/cassandra/lib/joda-time-2.4.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.9.2.jar:/usr/share/cassandra/lib/log4j-over-slf4j-1.7.7.jar:/usr/share/cassandra/lib/logback-classic-1.1.3.jar:/usr/share/cassandra/lib/logback-core-1.1.3.jar:/usr/share/cassandra/lib/lz4-1.3.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.0.jar:/usr/share/cassandra/lib/metrics-core-3.1.2.jar:/usr/share/cassandra/lib/metrics-graphite-2.2.0.jar:/usr/share/cassandra/lib/metrics-graphite-3.1.2.jar:/usr/share/cassandra/lib/metrics-logback-3.1.0.jar:/usr/share/cassandra/lib/netty-all-4.0.23.Final.jar:/usr/share/cassandra/lib/ohc-core-0.4.2.jar:/usr/share/cassandra/lib/ohc-core-j8-0.4.2.jar:/usr/share/cassandra/lib/reporter-config-base-3.0.0.jar:/usr/share/cassandra/lib/reporter-config3-3.0.0.jar:/usr/share/cassandra/lib/sigar-1.6.4.jar:/usr/share/cassandra/lib/slf4j-api-1.7.7.jar:/usr/share/cassandra/lib/snakeyaml-1.11.jar:/usr/share/cassandra/lib/snappy-java-1.1.1.7.jar:/usr/share/cassandra/lib/stream-2.5.2.jar:/usr/share/cassandra/lib/thrift-server-0.3.7.jar:/usr/share/cassandra/apache-cassandra-3.2.jar:/usr/share/cassandra/apache-cassandra-thrift-3.2.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/cassandra/stress.jar:
> -XX:HeapDumpPath=/var/lib/cassandra/java_1453248542.hprof
> -XX:ErrorFile=/var/lib/cassandra/hs_err_1453248542.log
>
