I built Apache Spark on Ubuntu 14.04 LTS with the following command:
mvn -Pspark-ganglia-lgpl -Pyarn -Phadoop-2.4 -Dhadoop.version=2.5.0
-DskipTests clean package
Build was successful. Then, following modifications were made.
1. Included "SPARK_LOCAL_IP=127.0.0.1" to the file
=localhost
*.sink.ganglia.port=8653
*.sink.ganglia.period=10
*.sink.ganglia.unit=seconds
*.sink.ganglia.ttl=1
*.sink.ganglia.mode=multicast
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p25636.html
Sent
Hi,
Where does *.sink.csv.directory directory get created? I cannot see nay
metrics in logs. How did you verify consoleSink and csvSink?
Thanks!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p25643
en,
> I have the following error now.
> ERROR metrics.MetricsSystem: Sink class
> org.apache.spark.metrics.sink.GangliaSink cannot be instantialized
> java.lang.ClassNotFoundException: org.apache.spark.metrics.sink.GangliaSink
>
>
>
>
>
> --
> View this message in context:
&
Hi,
I cannot see any metrics as well. How did you verify ConsoleSink and
CSVSink works OK? Where does *.sink.csv.directory get created?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p25644.html
Sent
Did you get past this issue? I¹m trying to get this to work as well. You
have to compile in the spark-ganglia-lgpl artifact into your application.
dependency
groupIdorg.apache.spark/groupId
artifactIdspark-ganglia-lgpl_2.10/artifactId
this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-metrics-for-ganglia-tp14335p20690.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
I used the command below because I'm using Spark 1.0.2 built with SBT and it
worked.
SPARK_HADOOP_VERSION=2.2.0 SPARK_YARN=true SPARK_GANGLIA_LGPL=true sbt/sbt
assembly
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics
Hello Samudrala,
Did you solve this issue about view metrics in Ganglia??
Because I have the same problem.
Thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-metrics-for-ganglia-tp14335p20385.html
Sent from the Apache Spark User List mailing
something?
Thanks!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p15631.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
?
Thanks!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p15631.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p15636.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail
#*.sink.ganglia.host=localhost
*.sink.ganglia.host=239.2.11.71
*.sink.ganglia.port=8653
*.sink.ganglia.period=10
*.sink.ganglia.unit=seconds
*.sink.ganglia.ttl=1
*.sink.ganglia.mode=multicast
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics
anything useful.Any one could give me a help or some proposal?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
14 matches
Mail list logo