Josh created SPARK-35864:
Summary: CatalogFileIndex only used if Partition Columns Nonempty
Key: SPARK-35864
URL: https://issues.apache.org/jira/browse/SPARK-35864
Project: Spark
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/SPARK-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh updated SPARK-12774:
-
Labels: dataframe mapPartitions pandas (was: dataframe pandas)
> DataFrame.mapPartitions apply function operates
[
https://issues.apache.org/jira/browse/SPARK-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh updated SPARK-12774:
-
Description:
Currently DataFrame.mapPatitions is analogous to DataFrame.rdd.mapPatitions in
both Spark and pySpa
Josh created SPARK-12774:
Summary: DataFrame.mapPartitions apply function operates on Pandas
DataFrame instead of a generator or rows
Key: SPARK-12774
URL: https://issues.apache.org/jira/browse/SPARK-12774
Pr