[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:28 PM: -- Well, you

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:26 PM: -- Well, you

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:26 PM: -- Well, you

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:24 PM: -- Well, you

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:24 PM: -- Well, you

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:24 PM: -- Well, you

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:23 PM: -- Well, you

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge edited comment on SPARK-20227 at 4/7/17 3:22 PM: -- Well, you

[jira] [Commented] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-07 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960953#comment-15960953 ] Quentin Auge commented on SPARK-20227: -- Well, you were right to ask. After further investigation, it

[jira] [Updated] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-06 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Auge updated SPARK-20227: - Environment: AWS emr-5.4.0, master: m4.xlarge, core: 4 m4.xlarge (was: AWS emr-5.4.0 m4.xlarge)

[jira] [Updated] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Auge updated SPARK-20227: - Description: I'm trying to replace a lot of different columns in a dataframe with aggregates of

[jira] [Updated] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Auge updated SPARK-20227: - Description: I'm trying to replace a lot of different columns in a dataframe with aggregates of

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956973#comment-15956973 ] Quentin Auge edited comment on SPARK-20227 at 4/5/17 2:55 PM: -- I managed to

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956973#comment-15956973 ] Quentin Auge edited comment on SPARK-20227 at 4/5/17 2:51 PM: -- I managed to

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956973#comment-15956973 ] Quentin Auge edited comment on SPARK-20227 at 4/5/17 2:51 PM: -- I manages to

[jira] [Comment Edited] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956973#comment-15956973 ] Quentin Auge edited comment on SPARK-20227 at 4/5/17 2:51 PM: -- I managed to

[jira] [Commented] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956973#comment-15956973 ] Quentin Auge commented on SPARK-20227: -- I found two distinct workarounds that prevent the job for

[jira] [Updated] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Auge updated SPARK-20227: - Description: I'm trying to replace a lot of different columns in a dataframe with aggregates of

[jira] [Created] (SPARK-20227) Job hangs when joining a lot of aggregated columns

2017-04-05 Thread Quentin Auge (JIRA)
Quentin Auge created SPARK-20227: Summary: Job hangs when joining a lot of aggregated columns Key: SPARK-20227 URL: https://issues.apache.org/jira/browse/SPARK-20227 Project: Spark Issue