Hi, Jerry said "I'm guessing", so maybe the thing to try is to check if his guess is correct.
What about running sudo lsof | grep metrics.properties ? I imagine you should be able to see it if the file was found and read. If Jerry is right, then I think you will NOT see it. Next, how about trying some bogus value in metrics.properties, like *.sink. jmx.class=org.apache.spark.metrics.sink.*BUGUSSink*? If the file is being read then specifying such bogus value should make something log an error or throw exception at start, I assume. If you don't see this then maybe this file is not being read at all. Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On Thu, Sep 11, 2014 at 9:18 AM, Shao, Saisai <saisai.s...@intel.com> wrote: > Hi， > > > > I’m guessing the problem is that driver or executor cannot get the > metrics.properties configuration file in the yarn container, so metrics > system cannot load the right sinks. > > > > Thanks > > Jerry > > > > *From:* Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com] > *Sent:* Thursday, September 11, 2014 7:30 PM > *To:* user@spark.apache.org > *Subject:* JMXSink for YARN deployment > > > > Hello, we are in Sematext (https://apps.sematext.com/) are writing > Monitoring tool for Spark and we came across one question: > > > > How to enable JMX metrics for YARN deployment? > > > > We put "*.sink.jmx.class=org.apache.spark.metrics.sink.JmxSink" > > to file $SPARK_HOME/conf/metrics.properties but it doesn't work. > > > > Everything works in Standalone mode, but not in YARN mode. > > > > Can somebody help? > > > > Thx! > > > > PS: I've found also > https://stackoverflow.com/questions/23529404/spark-on-yarn-how-to-send-metrics-to-graphite-sink/25786112 > without answer. >
