Hi,
Should the gmond be installed in all the Spark nodes? What should the host
and port be? Should it be the host and port of gmetad?
Enable GangliaSink for all instances
*.sink.ganglia.class=org.apache.spark.metrics.sink.GangliaSink
*.sink.ganglia.name=hadoop_cluster1
Hi,
Where does *.sink.csv.directory directory get created? I cannot see nay
metrics in logs. How did you verify consoleSink and csvSink?
Thanks!
--
View this message in context:
Hi,
I cannot see any metrics as well. How did you verify ConsoleSink and
CSVSink works OK? Where does *.sink.csv.directory get created?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p25644.html
Sent
I used the command below because I'm using Spark 1.0.2 built with SBT and it
worked.
SPARK_HADOOP_VERSION=2.2.0 SPARK_YARN=true SPARK_GANGLIA_LGPL=true sbt/sbt
assembly
--
View this message in context:
Hi tsingfu,
I want to see metrics in ganglia too.
But I don't understand this step:
./make-distribution.sh --tgz --skip-java-test -Phadoop-2.3 -Pyarn -Phive
-Pspark-ganglia-lgpl
Are you installing the hadoop, yarn, hive AND ganglia??
If I want to install just ganglia?
Can you suggest me
Hi,
I am sure you can use the -Pspark-ganglia-lgpl switch to enable Ganglia.
This step only adds the support for Hadoop,Yarn,Hive et al in the spark
executable.No need to run if one is not using them.
Cheers
k/
On Thu, Oct 2, 2014 at 12:29 PM, danilopds danilob...@gmail.com wrote:
Hi
Ok Krishna Sankar,
In relation to this information on Spark monitoring webpage,
For sbt users, set the SPARK_GANGLIA_LGPL environment variable before
building. For Maven users, enable the -Pspark-ganglia-lgpl profile
Do you know what I need to do to install with sbt?
Thanks.
--
View this
Hi, I found the problem.
By default, gmond is monitoring the multicast ip:239.2.11.71, while I set
*.sink.ganglia.host=localhost.
the correct configuration in metrics.properties:
# Enable GangliaSink for all instances
*.sink.ganglia.class=org.apache.spark.metrics.sink.GangliaSink
