[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-07-23 Thread Emma Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390586#comment-15390586 ] Emma Tang commented on SPARK-2183: -- [~khussein] You're right, it does not load from sourc

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-07-22 Thread Khaled Hammouda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15389751#comment-15389751 ] Khaled Hammouda commented on SPARK-2183: [~etang] For us caching the dataframe bef

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-07-19 Thread Emma Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385332#comment-15385332 ] Emma Tang commented on SPARK-2183: -- Hitting the same problem, the data is being loaded tw

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-07-19 Thread Emma Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385019#comment-15385019 ] Emma Tang commented on SPARK-2183: -- I'm bumping into the same issue here with a self join

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-05-06 Thread Khaled Hammouda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15275109#comment-15275109 ] Khaled Hammouda commented on SPARK-2183: Same here. We're running a self-join quer

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-04-05 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226141#comment-15226141 ] Justin Uang commented on SPARK-2183: Yup, we're hitting this as well > Avoid loading/

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-03-02 Thread Bartosz Owczarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176032#comment-15176032 ] Bartosz Owczarek commented on SPARK-2183: - I can confim that it exists in spark 1.

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-02-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148065#comment-15148065 ] Xiao Li commented on SPARK-2183: This problem still exists, right? I guess it might hurt t