Re: Default Flink Metrics Graphite

2020-09-03 Thread Till Rohrmann
Hi Vijay, yes the last value is the timestamp when this value was sent to Graphite. Cheers, Till On Wed, Sep 2, 2020 at 6:39 PM Vijayendra Yadav wrote: > Hi Till, > > *Info below, also I have a question at the end. * > pretty much what was told earlier, for 1.10.0 use: > metrics.reporter.grph

Re: Default Flink Metrics Graphite

2020-09-02 Thread Vijayendra Yadav
Hi Till, *Info below, also I have a question at the end. * pretty much what was told earlier, for 1.10.0 use: metrics.reporter.grph.class: org.apache.flink.metrics.graphite.GraphiteReporter And then Looks like my Graphite installation has a problem or I am missing something. Just to make sure Flin

Re: Default Flink Metrics Graphite

2020-09-02 Thread Till Rohrmann
Hi Vijayendra, what was the problem in the end? Sharing this knowledge might help other community member who might run into the same issue. Cheers, Till On Wed, Sep 2, 2020 at 3:34 AM Vijayendra Yadav wrote: > Thanks all, I could see the metrics. > > On Thu, Aug 27, 2020 at 7:51 AM Robert Metz

Re: Default Flink Metrics Graphite

2020-09-01 Thread Vijayendra Yadav
Thanks all, I could see the metrics. On Thu, Aug 27, 2020 at 7:51 AM Robert Metzger wrote: > I don't think these error messages give us a hint why you can't see the > metrics (because they are about registering metrics, not reporting them) > > Are you sure you are using the right configuration p

Re: Default Flink Metrics Graphite

2020-08-27 Thread Robert Metzger
I don't think these error messages give us a hint why you can't see the metrics (because they are about registering metrics, not reporting them) Are you sure you are using the right configuration parameters for Flink 1.10? That all required JARs are in the lib/ folder (on all machines) and that yo

Re: Default Flink Metrics Graphite

2020-08-26 Thread Vijayendra Yadav
Hi Chesnay and Dawid, I see multiple entries as following in Log: 2020-08-26 23:46:19,105 WARN org.apache.flink.runtime.metrics.MetricRegistryImpl - Error while registering metric: numRecordsIn. java.lang.IllegalArgumentException: A metric named ip-99--99-99.taskmanager.container_159605640970

Re: Default Flink Metrics Graphite

2020-08-26 Thread Chesnay Schepler
metrics.reporter.grph.class: org.apache.flink.metrics.graphite.GraphiteReporter https://ci.apache.org/projects/flink/flink-docs-release-1.10/monitoring/metrics.html#graphite-orgapacheflinkmetricsgraphitegraphitereporter On 26/08/2020 16:40, Vijayendra Yadav wrote: Hi Dawid, I have 1.10.0 vers

Re: Default Flink Metrics Graphite

2020-08-26 Thread Dawid Wysakowicz
I'd recommend then following this instruction from older docs[1] The difference are that you should set: |metrics.reporter.grph.class: org.apache.flink.metrics.graphite.GraphiteReporter| and put the reporter jar to the /lib folder: In order to use this reporter you must copy |/opt/flink-metrics

Re: Default Flink Metrics Graphite

2020-08-26 Thread Vijayendra Yadav
Hi Dawid, I have 1.10.0 version of flink. What is alternative for this version ? Regards, Vijay > > On Aug 25, 2020, at 11:44 PM, Dawid Wysakowicz wrote: > >  > Hi Vijay, > > I think the problem might be that you are using a wrong version of the > reporter. > > You say you used flink-metr

Re: Default Flink Metrics Graphite

2020-08-25 Thread Dawid Wysakowicz
Hi Vijay, I think the problem might be that you are using a wrong version of the reporter. You say you used flink-metrics-graphite-1.10.0.jar from 1.10 as a plugin, but it was migrated to plugins in 1.11 only[1]. I'd recommend trying it out with the same 1.11 version of Flink and Graphite report

Re: Default Flink Metrics Graphite

2020-08-25 Thread Vijayendra Yadav
Hi Nikola, To rule out any other cluster issues, I have tried it in my local now. Steps as follows, but don't see any metrics yet. 1) Set up local Graphite docker run -d\ --name graphite\ --restart=always\ -p 80:80\ -p 2003-2004:2003-2004\ -p 2023-2024:2023-2024\ -p 8125:8125/udp\ -p 8126

Re: Default Flink Metrics Graphite

2020-08-25 Thread Vijayendra Yadav
Thanks for inputs Nikola. I will check on graphite side. Sent from my iPhone > On Aug 23, 2020, at 9:26 PM, Nikola Hrusov wrote: > >  > Hi Vijay, > > Your steps look correct to me. > Perhaps you can double check that the graphite port you are sending is > correct? THe default carbon port is

Re: Default Flink Metrics Graphite

2020-08-23 Thread Nikola Hrusov
Hi Vijay, Your steps look correct to me. Perhaps you can double check that the graphite port you are sending is correct? THe default carbon port is 2003 and if you use the aggregator it is 2023. You should be able to see in both flink jobmanager and taskmanager that the metrics have been initiali

Default Flink Metrics Graphite

2020-08-23 Thread Vijayendra Yadav
Hi Team, I am trying to export Flink stream default metrics using Graphite, but I can't find it in the Graphite metrics console. Could you confirm the steps below are correct? *1) Updated flink-conf.yaml* metrics.reporter.grph.factory.class: org.apache.flink.metrics.graphite.GraphiteReporterFa