[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746414#comment-15746414
]
Reynold Xin commented on SPARK-18676:
-
That's the other option I was considering. It'd be good to
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746382#comment-15746382
]
Michael Allman commented on SPARK-18676:
Yeah, I was wondering how that would work with the
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746370#comment-15746370
]
Davies Liu commented on SPARK-18676:
I had a working prototype, but in introduce some weird behavior,
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743362#comment-15743362
]
Reynold Xin commented on SPARK-18676:
-
Can we just increase the size by 5X if it is a Parquet or ORC
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743076#comment-15743076
]
Michael Allman commented on SPARK-18676:
I'm sorry I have not had time to provide more
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734560#comment-15734560
]
Michael Allman commented on SPARK-18676:
Ah okay. That might be a strategy to explore.
> Spark
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733569#comment-15733569
]
Davies Liu commented on SPARK-18676:
Yes, it can, see WholeStageCodegen.doExecute() as an example.
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726437#comment-15726437
]
Michael Allman commented on SPARK-18676:
> maybe we could switch to ShuffleJoin when it realize
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726431#comment-15726431
]
Michael Allman commented on SPARK-18676:
I'm spending some more time this week to understand
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726247#comment-15726247
]
Davies Liu commented on SPARK-18676:
What's the schema and plan of the child looks like? It's
[
https://issues.apache.org/jira/browse/SPARK-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712823#comment-15712823
]
Michael Allman commented on SPARK-18676:
cc [~davies] as author of
11 matches
Mail list logo
