It would be a dream to have an easy-to-use dynamic metric system AND a
reliable counting system (accumulator-like) in Spark...
Thanks
Roberto
On Tue, May 7, 2019 at 3:54 AM Saisai Shao wrote:
> I think the main reason why that was not merged is that Spark itself
> doesn't have such
Hi Saisai,
Thanks a lot for the link! This is exactly what I need.
Just curious, why this PR has not been merged, as it seems to implement
rather natural requirement.
There are a number or use cases which can benefit from this feature, e.g.
- collecting business metrics based on the data's
I remembered there was a PR about doing similar thing (
https://github.com/apache/spark/pull/18406). From my understanding, this
seems like a quite specific requirement, it may requires code change to
support your needs.
Thanks
Saisai
Sergey Zhemzhitsky 于2019年5月4日周六 下午4:44写道：
> Hello Spark
Hello Spark Users!
Just wondering whether it is possible to register a metric source without
metrics known in advance and add the metrics themselves to this source
later on?
It seems that currently MetricSystem puts all the metrics from the source's
MetricRegistry into a shared MetricRegistry of
