[
https://issues.apache.org/jira/browse/SPARK-23970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438188#comment-16438188
]
Matthew Anthony commented on SPARK-23970:
-
Understood but this isnhorribly inefficient. In the
[
https://issues.apache.org/jira/browse/SPARK-23970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Anthony updated SPARK-23970:
Description:
Running in (py)spark 2.2.
Marking this as PySpark, but have not confirmed
[
https://issues.apache.org/jira/browse/SPARK-23970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Anthony updated SPARK-23970:
Description:
Running in (py)spark 2.2.
Marking this as PySpark, but have not confirmed
Matthew Anthony created SPARK-23970:
---
Summary: pyspark - simple filter/select doesn't use all tasks when
coalesce is set
Key: SPARK-23970
URL: https://issues.apache.org/jira/browse/SPARK-23970