[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Component/s: (was: Spark Core)
SQL
> Multiple unionAll on Dataframe goes
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Description:
Multiple unionAll on Dataframe seems to cause repeated calculations. Here is
the
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Summary: Multiple unionAll on Dataframe goes growingly slow. (was:
Multiple unionAll on Dataframe
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Description:
Multiple unionAll on Dataframe seems to somehow cause repeated calculations.
Here is
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096247#comment-15096247
]
Allen Liang commented on SPARK-12691:
-
Hi Bo Meng, do you have any comments in response to my reply.
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Summary: Multiple unionAll on Dataframe goes extremely slow. (was:
Multiple unionAll on Dataframe
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090908#comment-15090908
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 10:30 AM:
---
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Description:
Multiple unionAll on Dataframe seems to cause repeated calculations. Here is
the
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:22 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:25 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:23 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:24 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang commented on SPARK-12691:
-
Hi Bo Meng,
I understand you point, but why size of dataframe
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:28 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:27 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:29 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:30 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:34 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:37 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:37 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Comment: was deleted
(was: Hi Bo Meng,
I understand your point, but I don't think this has
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090906#comment-15090906
]
Allen Liang commented on SPARK-12691:
-
Hi Bo Meng,
I understand your point, but I don't think this
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:46 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090896#comment-15090896
]
Allen Liang edited comment on SPARK-12691 at 1/10/16 5:47 AM:
--
Hi Bo Meng,
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Comment: was deleted
(was: Hi Bo Meng,
I understand your point, but I don't think this has
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090908#comment-15090908
]
Allen Liang commented on SPARK-12691:
-
Hi Bo Meng,
I understand your point, but I don't think this
[
https://issues.apache.org/jira/browse/SPARK-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Liang updated SPARK-12691:
Affects Version/s: 1.3.0
1.3.1
1.4.0
Allen Liang created SPARK-12691:
---
Summary: Multiple unionAll on Dataframe seems to cause repeated
calculations in a "Fibonacci" manner
Key: SPARK-12691
URL: https://issues.apache.org/jira/browse/SPARK-12691
28 matches
Mail list logo