Re: Custom metrics sink

2018-03-16 Thread Silvio Fiorito
/apache/spark/metrics/sink/ConsoleSink.scala#L28 From: Christopher Piggott <cpigg...@gmail.com> Date: Friday, March 16, 2018 at 4:09 PM To: "user@spark.apache.org" <user@spark.apache.org> Subject: Custom metrics sink Just for fun, i want to make a stupid program that mak

Re: Custom metrics sink

2018-03-16 Thread Felix Cheung
There is a proposal to expose them. See SPARK-14151 From: Christopher Piggott <cpigg...@gmail.com> Sent: Friday, March 16, 2018 1:09:38 PM To: user@spark.apache.org Subject: Custom metrics sink Just for fun, i want to make a stupid program that makes dif

Custom metrics sink

2018-03-16 Thread Christopher Piggott
Just for fun, i want to make a stupid program that makes different frequency chimes as each worker becomes active. That way you can 'hear' what the cluster is doing and how it's distributing work. I thought to do this I would make a custom Sink, but the Sink and everything else in

Re: Custom Metrics Sink

2015-06-22 Thread dgoldenberg
Hi, I was wondering if there've been any responses to this? Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Custom-Metrics-Sink-tp10068p23425.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Custom Metrics Sink

2014-07-17 Thread jjaffe
What is the preferred way of adding a custom metrics sink to Spark? I noticed that the Sink Trait has been private since April, so I cannot simply extend Sink in an outside package, but I would like to avoid having to create a custom build of Spark. Is this possible? -- View this message