[
https://issues.apache.org/jira/browse/SPARK-24745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16538260#comment-16538260
]
Marco Gaido commented on SPARK-24745:
-------------------------------------
A RDD already has a unique ID. I think the name is just useful for the
UI/debug, but if you want to use it in your application you can still set the
name also on the RDD you create from mapping the original RDD or you can create
your own RDD implementation which retrieves the name from any ancestor.
> Map function does not keep rdd name
> ------------------------------------
>
> Key: SPARK-24745
> URL: https://issues.apache.org/jira/browse/SPARK-24745
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.1
> Reporter: Igor Pergenitsa
> Priority: Minor
>
> This snippet
> {code:scala}
> val namedRdd = sparkContext.makeRDD(List("abc", "123")).setName("named_rdd")
> println(namedRdd.name)
> val mappedRdd = namedRdd.map(_.length)
> println(mappedRdd.name){code}
> outputs:
> named_rdd
> null
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
