Flink Accumulators vs Metrics

2016-09-22 Thread Chawla,Sumit
Hi All Based on my code reading, I have following understanding of the Metrics and Accumulators. 1. Accumulators for a Flink JOB work like global counters. They are designed so that accumulator values from different instances of Execution Vertex can be combined. They are essentially

Re: Get Flink ExecutionGraph Programmatically

2016-09-22 Thread Chawla,Sumit
ld be a good solution. > > Cheers, > Aljoscha > > On Wed, 21 Sep 2016 at 21:15 Chawla,Sumit <sumitkcha...@gmail.com> wrote: > > > Hi Sean > > > > My goal here is to get User Accumulators. I know there exists the REST > > Calls. But since i am runnin

Re: Get Flink ExecutionGraph Programmatically

2016-09-21 Thread Chawla,Sumit
he execution graph is not easily possible, and not intended, as it > actually contains RPC resources, etc. > > What do you need from the execution graph? Maybe there is another way to > achieve that... > > On Wed, Sep 21, 2016 at 8:08 PM, Chawla,Sumit <sumitkcha...@gmail.com&

Re: Get Flink ExecutionGraph Programmatically

2016-09-21 Thread Chawla,Sumit
Regards, > Chesnay > > > On 21.09.2016 06:11, Chawla,Sumit wrote: > >> Hi All >> >> >> I am trying to get JOB accumulators. ( I am aware that I can get the >> accumulators through REST APIs as well, but i wanted to avoid JSON >> parsing). >>

Get Flink ExecutionGraph Programmatically

2016-09-20 Thread Chawla,Sumit
Hi All I am trying to get JOB accumulators. ( I am aware that I can get the accumulators through REST APIs as well, but i wanted to avoid JSON parsing). Looking at JobAccumulatorsHandler i am trying to get execution graph for currently running job. Following is my code: InetSocketAddress

Re: Performance and Latency Chart for Flink

2016-09-18 Thread Chawla,Sumit
Has anyone else run these kind of benchmarks? Would love to hear more people'e experience and details about those benchmarks. Regards Sumit Chawla On Sun, Sep 18, 2016 at 2:01 PM, Chawla,Sumit <sumitkcha...@gmail.com> wrote: > Hi Amir > > Would it be possible for you to sh

Re: Performance and Latency Chart for Flink

2016-09-18 Thread Chawla,Sumit
e-stream-processing-with-apache-flink/ > [2] 12/2015: > https://yahooeng.tumblr.com/post/135321837876/benchmarking-streaming- > computation-engines-at > [3] 02/2016: > http://data-artisans.com/extending-the-yahoo-streaming-benchmark/ > > > 2016-09-16 5:54 GMT+02:00 Chawla,

Performance and Latency Chart for Flink

2016-09-15 Thread Chawla,Sumit
Hi Is there any performance run that is done for each Flink release? Or you are aware of any third party evaluation of performance metrics for Flink? I am interested in seeing how performance has improved over release to release, and performance vs other competitors. Regards Sumit Chawla