You probably have a broken config.yaml file for the agent. Try to go through these steps https://www.robustperception.io/monitoring-cassandra-with-prometheus with your version of agent and config file. Start cassandra in the foreground.
пятница, 29 декабря 2017 г., 9:34:00 UTC+3 пользователь kkm...@gmail.com написал: > > Hi, same issue. Who had solved the problem, share the solution plz > > понедельник, 16 октября 2017 г., 21:15:30 UTC+6 пользователь > lax.c...@gmail.com написал: >> >> Hi, >> >> I'm having issues with jmx exporter (connection with cassandra).. I was >> wondering how I could debug this further. >> >> Basically, cassandra stalls on start (i.e., I see nothing in logs and I >> do not see it start). >> But systemctl shows it as running: >> ---------------------------------------------------- >> >> ● cassandra.service - LSB: distributed storage system for structured data >> Loaded: loaded (/etc/init.d/cassandra; bad; vendor preset: enabled) >> Active: active (running) since Mon 2017-10-16 14:39:50 UTC; 5min ago >> Docs: man:systemd-sysv-generator(8) >> Process: 1683 ExecStart=/etc/init.d/cassandra start (code=exited, >> status=0/SUCCESS) >> Tasks: 26 >> Memory: 4.1G >> CPU: 4.028s >> CGroup: /system.slice/cassandra.service >> ├─1757 /bin/sh /usr/sbin/cassandra -p >> /var/run/cassandra/cassandra.pid -H >> /var/lib/cassandra/java_1508164790.hprof -E /var/lib/cas >> ├─1996 java -cp >> /etc/cassandra:/usr/share/cassandra/lib/ST4-4.0.8.jar:/usr/share/cassandra/lib/airline-0.6.jar:/usr/share/cassandr >> └─1997 grep -q Error: Exception thrown by the agent : >> java.lang.NullPointerException >> Oct 16 14:39:50 cassandra-1 systemd[1]: Starting LSB: distributed storage >> system for structured data... >> Oct 16 14:39:50 cassandra-1 systemd[1]: Started LSB: distributed storage >> system for structured data. >> lines 1-15/15 (END) >> . >> . >> >> As you can see, only the agent has started: >> --------------------------------------------------------- >> > sudo netstat -tulpn | grep java >> tcp 0 0 0.0.0.0:7070 0.0.0.0:* >> LISTEN 2055/java >> >> Here is my agent config: >> ---------------------------------- >> > pwd >> /etc/cassandra >> > tail -2 cassandra-env.sh >> >> JVM_OPTS="$JVM_OPTS >> -javaagent:/usr/local/bin/jmx_exporter/jmx_prometheus_javaagent-0.10.jar=7070:/usr/local/bin/jmx_exporter/config.yaml" >> > >> > cat /usr/local/bin/jmx_exporter/config.yaml >> --- >> lowercaseOutputLabelNames: true >> lowercaseOutputName: true >> rules: >> - pattern: org.apache.cassandra.metrics<type=(Connection|Streaming), >> scope=(\S*), name=(\S*)><>(Count|Value) >> name: cassandra_$1_$3 >> labels: >> address: "$2" >> - pattern: org.apache.cassandra.metrics<type=(\S*)(?:, >> ((?!scope)\S*)=(\S*))?(?:, scope=(\S*))?, >> name=(\S*)><>(Count|Value) >> name: cassandra_$1_$5 >> labels: >> "$1": "$4" >> "$2": "$3" >> >> >> But... if I kill -9 the running agent, then cassandra is able to boot and >> a new agent runs fine (prometheus shows it connected): >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> > sudo kill -9 2055 >> > sudo netstat -tulpn | grep java >> tcp 0 0 127.0.0.1:37979 0.0.0.0:* >> LISTEN 3131/java >> tcp 0 0 0.0.0.0:7070 0.0.0.0:* >> LISTEN 3131/java >> tcp 0 0 127.0.0.1:7199 0.0.0.0:* >> LISTEN 3131/java >> >> >> ##### Is there a way I can debug this further? Cassandra logs show nothing >> >> >> >> >> >> -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/45515cf9-8521-43aa-bdcf-41dbec6d7249%40googlegroups.com.
