[jira] [Resolved] (SPARK-17650) Adding a malformed URL to sc.addJar and/or sc.addFile bricks Executors

2016-09-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17650. -- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.1.0

[jira] [Updated] (SPARK-17665) SparkR supports options in other types consistently other APIs

2016-09-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17665: - Component/s: SparkR > SparkR supports options in other types consistently other APIs >

[jira] [Updated] (SPARK-17665) SparkR supports options in other types consistently other APIs

2016-09-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17665: - Affects Version/s: 2.0.0 > SparkR supports options in other types consistently other APIs >

[jira] [Created] (SPARK-17665) SparkR supports options in other types consistently other APIs

2016-09-25 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-17665: Summary: SparkR supports options in other types consistently other APIs Key: SPARK-17665 URL: https://issues.apache.org/jira/browse/SPARK-17665 Project: Spark

[jira] [Comment Edited] (SPARK-17527) mergeSchema with `_OPTIONAL_` metadata fails

2016-09-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522051#comment-15522051 ] Liang-Chi Hsieh edited comment on SPARK-17527 at 9/26/16 4:58 AM: -- Do

[jira] [Commented] (SPARK-17527) mergeSchema with `_OPTIONAL_` metadata fails

2016-09-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522051#comment-15522051 ] Liang-Chi Hsieh commented on SPARK-17527: - Do you have a small spark code snippet which can

[jira] [Assigned] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17653: Assignee: Apache Spark > Optimizer should remove unnecessary distincts (in multiple

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15521950#comment-15521950 ] Apache Spark commented on SPARK-17653: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17653: Assignee: (was: Apache Spark) > Optimizer should remove unnecessary distincts (in

[jira] [Updated] (SPARK-17664) Failed to saveAsHadoop when speculate is enabled

2016-09-25 Thread sharkd tu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sharkd tu updated SPARK-17664: -- Description: >From follow logs, task 22 has failed 4 times because of "the driver did not >authorize

[jira] [Created] (SPARK-17664) Failed to saveAsHadoop when speculate is enabled

2016-09-25 Thread sharkd tu (JIRA)
sharkd tu created SPARK-17664: - Summary: Failed to saveAsHadoop when speculate is enabled Key: SPARK-17664 URL: https://issues.apache.org/jira/browse/SPARK-17664 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-17551) support null ordering for DataFrame API

2016-09-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17551. - Resolution: Fixed Assignee: Xin Wu Fix Version/s: 2.1.0 > support null ordering

[jira] [Assigned] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17663: Assignee: (was: Apache Spark) > SchedulableBuilder should handle invalid data access

[jira] [Assigned] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17663: Assignee: Apache Spark > SchedulableBuilder should handle invalid data access via >

[jira] [Commented] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15521517#comment-15521517 ] Apache Spark commented on SPARK-17663: -- User 'erenavsarogullari' has created a pull request for this

[jira] [Updated] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17663: --- Description: If spark.scheduler.allocation.file has invalid *minShare* or/and

[jira] [Updated] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17663: --- Description: If spark.scheduler.allocation.file has invalid minShare or/and weight,

[jira] [Updated] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-17663: --- Description: If spark.scheduler.allocation.file has invalid minShare or/and weight,

[jira] [Created] (SPARK-17663) SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2016-09-25 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-17663: -- Summary: SchedulableBuilder should handle invalid data access via scheduler.allocation.file Key: SPARK-17663 URL: https://issues.apache.org/jira/browse/SPARK-17663

[jira] [Commented] (SPARK-17017) Add a chiSquare Selector based on False Positive Rate (FPR) test

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15521055#comment-15521055 ] Apache Spark commented on SPARK-17017: -- User 'lins05' has created a pull request for this issue:

[jira] [Resolved] (SPARK-17579) Exception When the Main object extends Encoder in cluster mode but ok in local mode

2016-09-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17579. --- Resolution: Not A Problem This shows a different error, which is just a config problem. I'm not

[jira] [Resolved] (SPARK-17582) Dead executors shouldn't show in the SparkUI

2016-09-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17582. --- Resolution: Not A Problem > Dead executors shouldn't show in the SparkUI >

[jira] [Created] (SPARK-17662) Dedup UDAF

2016-09-25 Thread Ohad Raviv (JIRA)
Ohad Raviv created SPARK-17662: -- Summary: Dedup UDAF Key: SPARK-17662 URL: https://issues.apache.org/jira/browse/SPARK-17662 Project: Spark Issue Type: New Feature Reporter: Ohad

[jira] [Assigned] (SPARK-17661) Consolidate various listLeafFiles implementations

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17661: Assignee: (was: Apache Spark) > Consolidate various listLeafFiles implementations >

[jira] [Commented] (SPARK-17661) Consolidate various listLeafFiles implementations

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15520314#comment-15520314 ] Apache Spark commented on SPARK-17661: -- User 'petermaxlee' has created a pull request for this

[jira] [Assigned] (SPARK-17661) Consolidate various listLeafFiles implementations

2016-09-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17661: Assignee: Apache Spark > Consolidate various listLeafFiles implementations >

[jira] [Created] (SPARK-17661) Consolidate various listLeafFiles implementations

2016-09-25 Thread Peter Lee (JIRA)
Peter Lee created SPARK-17661: - Summary: Consolidate various listLeafFiles implementations Key: SPARK-17661 URL: https://issues.apache.org/jira/browse/SPARK-17661 Project: Spark Issue Type: