@Matthias Thanks for advice :-) ======================================
I personally never used Metrics in Storm. It would be best, if you design an own example. I guess you are familiar with https://storm.apache.org/documentation/Metrics.html As a first step, I would try to include the predefined Storm metric and work on custom metrics later. As the Storm documentation points out, the metrics are used to get the value for Storm UI. Maybe, you can start to add Tuple-count metrics for whole topologies to be collected and displayed in Flink WebUI. -Matthias On 09/07/2015 02:51 PM, huangwei (G) wrote: > Hi Kostas, > > Thanks for your support! > I created the JIRA and pushed a PR for it. > > @Matthias > Could you give me a storm example in using the cust metrics? > Since it is needed for follow-up development. > Many thanks! > > Greetings, > Huang Wei > > ===================================== > > Sounds great. It is easy to create an AverageAccumulator by implementing the > org.apache.flink.api.common.accumulators.Accumulator interface, accumulating > the sum and the count internally, and dividing in the end. > > This would be something useful also outside of Storm compatibility. > > Then, MultiReduceMetrics can be implemented on top of that. > > Looking forward to the JIRA. > > On Wed, Sep 2, 2015 at 8:36 AM, huangwei (G) <huangwei...@huawei.com> wrote: > >> Dear all, >> >> I focused on the Flink-accumulator and found that there is not any >> feature to count the average of values. >> And there is a MultiReducedMetric class in storm that calculates the >> average. >> This class can be used internally to get the latency in storm. >> So as the first step, I`d like to add a class like MultiReducedMetric. >> And the detail about design I`ll describe in a new JIRA if you agree >> this above. >> Please let me know if I`m wrong. >> Thank you! >> >> ======================================== >> >> Hi Kostas, >> Thank you for the information. >> I`ll take a look. >> And I`m comparing the storm metrics with Flink accumulators. >> I`ll let you know if I have some ideas. >> >> ======================================== >> >> Flink accumulators are documented here: >> >> https://ci.apache.org/projects/flink/flink-docs-master/apis/programmi >> n >> g_guide.html#accumulators--counters >> >> I think Aljoscha's idea is to implement Storm metrics on top of those. >> >> Huangwei, perhaps you can look whether the interfaces match >> (basically if Flink accumulators have all the features needed to >> support the kinds of metrics that Storm exposes, or if there is a >> significant impedance mismatch). >> >> On Mon, Aug 31, 2015 at 2:06 PM, Matthias J. Sax < >> mj...@informatik.hu-berlin.de> wrote: >> >>> I did not look into it and I am not super familiar with Flink's >>> accumulators... Can not provide much help right now. Sorry :( >>> >>> -Matthias >>> >>> On 08/31/2015 01:01 PM, huangwei (G) wrote: >>>> Hi, >>>> I think I can take a simple design for it. >>>> Do you have any idea? >>>> >>>> ======================================== >>>> >>>> Maybe. I did not put any thoughts into this... >>>> >>>> On 08/31/2015 12:25 PM, Aljoscha Krettek wrote: >>>>> Hi, >>>>> could the metrics not be implemented on top of Flink accumulators? >>>>> They would even be live-updated in the new web front-end. >>>>> >>>>> Cheers, >>>>> Aljoscha >>>>> >>>>> On Mon, 31 Aug 2015 at 11:32 Matthias J. Sax >>>>> <mj...@informatik.hu-berlin.de> >>>>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> custom metrics are currently not supported by the compatibility >> layer. >>>>>> See README here: >>>>>> >>>>>> https://github.com/apache/flink/tree/master/flink-contrib/flink- >>>>>> st orm -compatibility/flink-storm-compatibility-core >>>>>> >>>>>> It is an open question, if/how Flink can support this feature. >>>>>> >>>>>> -Matthias >>>>>> >>>>>> On 08/31/2015 09:53 AM, huangwei (G) wrote: >>>>>>> Hi Matthias and all, >>>>>>> >>>>>>> I`d like to do the custom metrics in flink-storm-compatibility. >>>>>>> And there are some questions following: >>>>>>> Is there anything like storm metrics in Flink? >>>>>>> If not, does Flink need to have metrics mechanism in internal first? >>>>>>> Or just let the metrics use in flink-storm-compatibility? >>>>>>> >>>>>>> >>>>>>> Greetings, >>>>>>> Huang Wei >>>>>>> 华为技术有限公司 Huawei Technologies Co., Ltd. >>>>>>> >>>>>>> >>>>>>> Tel:+86 18106512602 >>>>>>> Email:huangwei...@huawei.com >>>>>>> >>>>>> >>>>>> >>>>> >>>> >>>> >>> >>> >>
