[
https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15116461#comment-15116461
]
Jakob Odersky commented on SPARK-12958:
---------------------------------------
I agree that it's very specific, maybe it would make sense to include a more
generic version of {{MapAccumulator}}. Something like MapAccumulator[A, B],
where B has to have an implicit AccumulatorParam[B] itself?
> Map accumulator in spark
> ------------------------
>
> Key: SPARK-12958
> URL: https://issues.apache.org/jira/browse/SPARK-12958
> Project: Spark
> Issue Type: Wish
> Components: Spark Core
> Reporter: Souri
> Priority: Minor
>
> Spark by default supports accumulators of Int,Long,Double,Float.
> It would be good if we can have a Map accumulator where each executor can
> just add key->value pairs and driver can have access to the aggregated value
> for each key in the map.
> In this way, it would also be easier to use accumulators for various metrics.
> We can define metrics at runtime as the map can take any string key.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
