Re: Spark Metrics Framework?

2016-04-01 Thread Yiannis Gkoufas
>> Thanks, >> Silvio >> >> From: Mike Sukmanowsky <mike.sukmanow...@gmail.com> >> Date: Friday, March 25, 2016 at 10:48 AM >> >> To: Silvio Fiorito <silvio.fior...@granturing.com>, " >> user@spark.apache.org" <user@

Re: Spark Metrics Framework?

2016-04-01 Thread Mike Sukmanowsky
equest if there isn’t > one already. > > Thanks, > Silvio > > From: Mike Sukmanowsky <mike.sukmanow...@gmail.com> > Date: Friday, March 25, 2016 at 10:48 AM > > To: Silvio Fiorito <silvio.fior...@granturing.com>, "user@spark.apache.org" > <user@spa

Re: Spark Metrics Framework?

2016-03-25 Thread Silvio Fiorito
ior...@granturing.com<mailto:silvio.fior...@granturing.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Re: Spark Metrics Framework? Pinging again - any thoughts? On Wed, 23 Mar 2016 at 09:17 Mike Suk

Re: Spark Metrics Framework?

2016-03-25 Thread Mike Sukmanowsky
;> Silvio >> >> From: Mike Sukmanowsky <mike.sukmanow...@gmail.com> >> Date: Tuesday, March 22, 2016 at 3:13 PM >> To: Silvio Fiorito <silvio.fior...@granturing.com>, " >> user@spark.apache.org" <user@spark.apache.org> >> Subject: Re: Spar

Re: Spark Metrics Framework?

2016-03-23 Thread Mike Sukmanowsky
gt; > Date: Tuesday, March 22, 2016 at 3:13 PM > To: Silvio Fiorito <silvio.fior...@granturing.com>, "user@spark.apache.org" > <user@spark.apache.org> > Subject: Re: Spark Metrics Framework? > > The Source class is private > <https://github.com/apache/s

Re: Spark Metrics Framework?

2016-03-22 Thread Silvio Fiorito
6 at 3:13 PM To: Silvio Fiorito <silvio.fior...@granturing.com<mailto:silvio.fior...@granturing.com>>, "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Re: Spark Metrics Framework? The Source cl

Re: Spark Metrics Framework?

2016-03-22 Thread Ted Yu
/latest/monitoring.html#metrics >> >> If you want to push the metrics to another system you can define a custom >> sink. You can also extend the metrics by defining a custom source. >> >> From: Mike Sukmanowsky <mike.sukmanow...@gmail.com> >> Date: Mond

Re: Spark Metrics Framework?

2016-03-22 Thread Mike Sukmanowsky
sky <mike.sukmanow...@gmail.com> > Date: Monday, March 21, 2016 at 11:54 AM > To: "user@spark.apache.org" <user@spark.apache.org> > Subject: Spark Metrics Framework? > > We make extensive use of the elasticsearch-hadoop library for > Hadoop/Spark. In trying to t

Re: Spark Metrics Framework?

2016-03-21 Thread Silvio Fiorito
<mike.sukmanow...@gmail.com<mailto:mike.sukmanow...@gmail.com>> Date: Monday, March 21, 2016 at 11:54 AM To: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Spark Metrics Framework? We make extensive

Spark Metrics Framework?

2016-03-21 Thread Mike Sukmanowsky
We make extensive use of the elasticsearch-hadoop library for Hadoop/Spark. In trying to troubleshoot our Spark applications, it'd be very handy to have access to some of the many metrics that the library makes available