[
https://issues.apache.org/jira/browse/SPARK-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512540#comment-17512540
]
Rafal Wojdyla commented on SPARK-2868:
--------------------------------------
Is there a better issue to track the work on named accumulators in pyspark? Is
it still the case that named accumulators do not work in pyspark and it's not
possible to see pyspark accumulators in the web UI? Would appreciate you
feedback [~pwendell] [~holden] [~heathkh] please?
> Support named accumulators in Python
> ------------------------------------
>
> Key: SPARK-2868
> URL: https://issues.apache.org/jira/browse/SPARK-2868
> Project: Spark
> Issue Type: New Feature
> Components: PySpark
> Reporter: Patrick Wendell
> Priority: Major
> Labels: bulk-closed
>
> SPARK-2380 added this for Java/Scala. To allow this in Python we'll need to
> make some additional changes. One potential path is to have a 1:1
> correspondence with Scala accumulators (instead of a one-to-many). A
> challenge is exposing the stringified values of the accumulators to the Scala
> code.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
