[
https://issues.apache.org/jira/browse/SPARK-27385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809706#comment-16809706
]
Liang-Chi Hsieh edited comment on SPARK-27385 at 4/4/19 10:39 AM:
------------------------------------------------------------------
I don't really see {{dataframe.rdd.mapPartitionsWithIndex}} gives any
significant advantage over {{dataframe.mapPartitionsWithIndex}}, if you just
want to do {{mapPartitionsWithIndex}} on the underlying rdd.
was (Author: viirya):
I don't really see {dataframe.rdd.mapPartitionsWithIndex}} gives any
significant advantage over {{dataframe.mapPartitionsWithIndex}}, if you just
want to do {{mapPartitionsWithIndex}} on the underlying rdd.
> use mapPartitionsWIthIndex in Dataframe
> ---------------------------------------
>
> Key: SPARK-27385
> URL: https://issues.apache.org/jira/browse/SPARK-27385
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 1.6.0, 1.6.1, 1.6.2, 1.6.3
> Reporter: 范晓亮
> Priority: Minor
> Labels: DataFrame, mapPartitionsWithIndex
>
> As there is no mapPartitionsWithIndex in Dataframe ,if I want to use
> mapPartitionsWithIndex, I have to use dataframe.rdd.mapPartitionsWithIndex
> instade. What I want to do is to use mapPartitionsWithIndex directly in
> Dataframe. So, I want to add mapPartitionsWithIndex in Dataframe, that's all.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
