[jira] [Created] (SPARK-5951) Remove unreachable driver memory properties in yarn client mode (YarnClientSchedulerBackend)

2015-02-23 Thread Shekhar Bansal (JIRA)
Shekhar Bansal created SPARK-5951: - Summary: Remove unreachable driver memory properties in yarn client mode (YarnClientSchedulerBackend) Key: SPARK-5951 URL: https://issues.apache.org/jira/browse/SPARK-5951

[jira] [Updated] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-5861: -- Description: I am using {code}spark.driver.memory=6g{code} which creates application master of

[jira] [Updated] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-5861: -- Description: I am using {code}spark.driver.memory=6g{code} which creates application master of

[jira] [Comment Edited] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324056#comment-14324056 ] Shekhar Bansal edited comment on SPARK-5861 at 2/17/15 11:14 AM:

[jira] [Commented] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324069#comment-14324069 ] Shekhar Bansal commented on SPARK-5861: --- I am submitting my job using spark summit

[jira] [Issue Comment Deleted] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-5861: -- Comment: was deleted (was: I am submitting my job using spark summit reproducible by

[jira] [Issue Comment Deleted] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-5861: -- Comment: was deleted (was: Thanks for the quick reply I know all this. I mean yarn-client mode

[jira] [Commented] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324055#comment-14324055 ] Shekhar Bansal commented on SPARK-5861: --- Thanks for the quick reply I know all this.

[jira] [Commented] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324053#comment-14324053 ] Shekhar Bansal commented on SPARK-5861: --- Thanks for the quick reply I know all this.

[jira] [Issue Comment Deleted] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-5861: -- Comment: was deleted (was: Thanks for the quick reply I know all this. I mean yarn-client mode

[jira] [Commented] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324056#comment-14324056 ] Shekhar Bansal commented on SPARK-5861: --- Thanks for the quick reply I know all this.

[jira] [Issue Comment Deleted] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-5861: -- Comment: was deleted (was: Thanks for the quick reply I know all this. I mean yarn-client mode

[jira] [Commented] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324054#comment-14324054 ] Shekhar Bansal commented on SPARK-5861: --- Thanks for the quick reply I know all this.

[jira] [Created] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
Shekhar Bansal created SPARK-5861: - Summary: [yarn-client mode] Application master should not use memory = spark.driver.memory Key: SPARK-5861 URL: https://issues.apache.org/jira/browse/SPARK-5861

[jira] [Commented] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324070#comment-14324070 ] Shekhar Bansal commented on SPARK-5861: --- I am submitting my job using spark summit

[jira] [Updated] (SPARK-5861) [yarn-client mode] Application master should not use memory = spark.driver.memory

2015-02-17 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-5861: -- Description: I am using {code}spark.driver.memory=6g{code} which creates application master of

[jira] [Commented] (SPARK-5081) Shuffle write increases

2015-02-05 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308596#comment-14308596 ] Shekhar Bansal commented on SPARK-5081: --- I faced same problem, moving to lz4

[jira] [Created] (SPARK-4968) [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used

2014-12-25 Thread Shekhar Bansal (JIRA)
Shekhar Bansal created SPARK-4968: - Summary: [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used Key: SPARK-4968 URL:

[jira] [Updated] (SPARK-4968) [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used

2014-12-25 Thread Shekhar Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-4968: -- Environment: Spark 1.1.1 scala - 2.10.2 hive metastore db - pgsql OS- Linux was: Spark 1.1.1