[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-07-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393283#comment-15393283 ] Hyukjin Kwon commented on SPARK-14536: -- FYI, It seems {{ArrayType}} is not supported for JDBC for

[jira] [Commented] (SPARK-8500) Support for array types in JDBCRDD

2016-07-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393282#comment-15393282 ] Hyukjin Kwon commented on SPARK-8500: - FYI, this is still happening in 2.0.0 and current master. The

[jira] [Commented] (SPARK-16730) Spark 2.0 breaks various Hive cast functions

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393218#comment-15393218 ] Apache Spark commented on SPARK-16730: -- User 'petermaxlee' has created a pull request for this

[jira] [Assigned] (SPARK-16730) Spark 2.0 breaks various Hive cast functions

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16730: Assignee: (was: Apache Spark) > Spark 2.0 breaks various Hive cast functions >

[jira] [Assigned] (SPARK-16730) Spark 2.0 breaks various Hive cast functions

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16730: Assignee: Apache Spark > Spark 2.0 breaks various Hive cast functions >

[jira] [Updated] (SPARK-16686) Dataset.sample with seed: result seems to depend on downstream usage

2016-07-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16686: Assignee: Liang-Chi Hsieh > Dataset.sample with seed: result seems to depend on downstream usage >

[jira] [Commented] (SPARK-16720) Loading CSV file with 2k+ columns fails during attribute resolution on action

2016-07-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393182#comment-15393182 ] Hyukjin Kwon commented on SPARK-16720: -- [~holdenk] I just tried to reproduce this with the codes

[jira] [Resolved] (SPARK-16642) ResolveWindowFrame should not be triggered on UnresolvedFunctions.

2016-07-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16642. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Resolved] (SPARK-16633) lag/lead using constant input values does not return the default value when the offset row does not exist

2016-07-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16633. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Resolved] (SPARK-16721) Lead/lag needs to respect nulls

2016-07-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16721. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Created] (SPARK-16730) Spark 2.0 breaks various Hive cast functions

2016-07-25 Thread Peter Lee (JIRA)
Peter Lee created SPARK-16730: - Summary: Spark 2.0 breaks various Hive cast functions Key: SPARK-16730 URL: https://issues.apache.org/jira/browse/SPARK-16730 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-07-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393161#comment-15393161 ] Hyukjin Kwon commented on SPARK-14536: -- Hi [~jeremyrsmith], are you working on this? > NPE in

[jira] [Resolved] (SPARK-16724) Expose DefinedByConstructorParams

2016-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16724. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Expose

[jira] [Resolved] (SPARK-16672) SQLBuilder should not raise exceptions on EXISTS queries

2016-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16672. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0

[jira] [Comment Edited] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Asmaa Ali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393068#comment-15393068 ] Asmaa Ali edited comment on SPARK-16723 at 7/26/16 2:23 AM: - Yes, I've

[jira] [Commented] (SPARK-16719) RandomForest: communicate fewer trees on each iteration

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393075#comment-15393075 ] Apache Spark commented on SPARK-16719: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Commented] (SPARK-16720) Loading CSV file with 2k+ columns fails during attribute resolution on action

2016-07-25 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393069#comment-15393069 ] Hyukjin Kwon commented on SPARK-16720: -- Hi [~holdenk], this part seems familiar to me. Do you mind

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Asmaa Ali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393068#comment-15393068 ] Asmaa Ali commented on SPARK-16723: Yes, I've copied all what I got from the command, there is no

[jira] [Commented] (SPARK-16729) Spark should throw analysis exception for invalid casts to date type

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393064#comment-15393064 ] Apache Spark commented on SPARK-16729: -- User 'petermaxlee' has created a pull request for this

[jira] [Assigned] (SPARK-16729) Spark should throw analysis exception for invalid casts to date type

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16729: Assignee: (was: Apache Spark) > Spark should throw analysis exception for invalid

[jira] [Assigned] (SPARK-16729) Spark should throw analysis exception for invalid casts to date type

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16729: Assignee: Apache Spark > Spark should throw analysis exception for invalid casts to date

[jira] [Comment Edited] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true

2016-07-25 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393062#comment-15393062 ] Hong Shen edited comment on SPARK-16709 at 7/26/16 2:10 AM: It different, the

[jira] [Commented] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true

2016-07-25 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393062#comment-15393062 ] Hong Shen commented on SPARK-16709: --- It different, the task has no attempt succeed. this happen when a

[jira] [Created] (SPARK-16729) Spark should throw analysis exception for invalid casts to date type

2016-07-25 Thread Peter Lee (JIRA)
Peter Lee created SPARK-16729: - Summary: Spark should throw analysis exception for invalid casts to date type Key: SPARK-16729 URL: https://issues.apache.org/jira/browse/SPARK-16729 Project: Spark

[jira] [Commented] (SPARK-16708) ExecutorAllocationManager.numRunningTasks can be negative when stage retry

2016-07-25 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393054#comment-15393054 ] Hong Shen commented on SPARK-16708: --- It's different,ExecutorAllocationManager.numRunningTasks be

[jira] [Updated] (SPARK-16677) Strange Error when Issuing Load Table Against A View

2016-07-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16677: Assignee: Xiao Li > Strange Error when Issuing Load Table Against A View >

[jira] [Resolved] (SPARK-16677) Strange Error when Issuing Load Table Against A View

2016-07-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16677. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14314

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393033#comment-15393033 ] Saisai Shao commented on SPARK-16723: - So maybe this application is not yet started in the yarn side,

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Asmaa Ali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393021#comment-15393021 ] Asmaa Ali commented on SPARK-16723: I have set the yarn.log-aggregation-enable to true, but The

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393003#comment-15393003 ] Saisai Shao commented on SPARK-16723: - Did you enable log aggregation in YARN, if not this command is

[jira] [Comment Edited] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393003#comment-15393003 ] Saisai Shao edited comment on SPARK-16723 at 7/26/16 1:36 AM: -- Did you

[jira] [Resolved] (SPARK-16678) Disallow Creating/Altering a View when the same-name Table Exists

2016-07-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16678. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14314

[jira] [Updated] (SPARK-16678) Disallow Creating/Altering a View when the same-name Table Exists

2016-07-25 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16678: Assignee: Xiao Li > Disallow Creating/Altering a View when the same-name Table Exists >

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Asmaa Ali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392999#comment-15392999 ] Asmaa Ali commented on SPARK-16723: Connecting to ResourceManager at

[jira] [Resolved] (SPARK-16722) Fix a StreamingContext leak in StreamingContextSuite when eventually fails

2016-07-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-16722. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Commented] (SPARK-16707) TransportClientFactory.createClient may throw NPE

2016-07-25 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392987#comment-15392987 ] Hong Shen commented on SPARK-16707: --- It happened many times in our cluster(with thousand of machines),

[jira] [Updated] (SPARK-15959) Add the support of hive.metastore.warehouse.dir back

2016-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15959: Labels: (was: release_notes releasenotes) > Add the support of hive.metastore.warehouse.dir back

[jira] [Updated] (SPARK-12544) Support window functions in SQLContext

2016-07-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12544: Labels: (was: releasenotes) > Support window functions in SQLContext >

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392980#comment-15392980 ] Saisai Shao commented on SPARK-16723: - {{yarn logs -applicationId application_1467990031555_0089}} >

[jira] [Comment Edited] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Asmaa Ali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392972#comment-15392972 ] Asmaa Ali edited comment on SPARK-16723 at 7/26/16 1:20 AM: - [~jerryshao]

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Asmaa Ali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392972#comment-15392972 ] Asmaa Ali commented on SPARK-16723: [~saisai_shao] How can I check the AM and executor logs,

[jira] [Commented] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392965#comment-15392965 ] Saisai Shao commented on SPARK-16723: - I think you should check the AM and executor logs to see the

[jira] [Commented] (SPARK-16727) SparkR unit test fails - incorrect expected output

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392959#comment-15392959 ] Apache Spark commented on SPARK-16727: -- User 'junyangq' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16727) SparkR unit test fails - incorrect expected output

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16727: Assignee: (was: Apache Spark) > SparkR unit test fails - incorrect expected output >

[jira] [Assigned] (SPARK-16727) SparkR unit test fails - incorrect expected output

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16727: Assignee: Apache Spark > SparkR unit test fails - incorrect expected output >

[jira] [Commented] (SPARK-16724) Expose DefinedByConstructorParams

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392953#comment-15392953 ] Apache Spark commented on SPARK-16724: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16724) Expose DefinedByConstructorParams

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16724: Assignee: Apache Spark (was: Michael Armbrust) > Expose DefinedByConstructorParams >

[jira] [Assigned] (SPARK-16724) Expose DefinedByConstructorParams

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16724: Assignee: Michael Armbrust (was: Apache Spark) > Expose DefinedByConstructorParams >

[jira] [Comment Edited] (SPARK-16702) Driver hangs after executors are lost

2016-07-25 Thread Angus Gerry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392938#comment-15392938 ] Angus Gerry edited comment on SPARK-16702 at 7/26/16 12:54 AM: --- I'm not so

[jira] [Commented] (SPARK-16702) Driver hangs after executors are lost

2016-07-25 Thread Angus Gerry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392938#comment-15392938 ] Angus Gerry commented on SPARK-16702: - I'm not so sure about SPARK-12419. SPARK-16355 however

[jira] [Created] (SPARK-16728) migrate internal API for MLlib trees from spark.mllib to spark.ml

2016-07-25 Thread Vladimir Feinberg (JIRA)
Vladimir Feinberg created SPARK-16728: - Summary: migrate internal API for MLlib trees from spark.mllib to spark.ml Key: SPARK-16728 URL: https://issues.apache.org/jira/browse/SPARK-16728 Project:

[jira] [Resolved] (SPARK-15590) Paginate Job Table in Jobs tab

2016-07-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15590. -- Resolution: Fixed Fix Version/s: 2.1.0 > Paginate Job Table in Jobs tab >

[jira] [Created] (SPARK-16727) SparkR unit test fails - incorrect expected output

2016-07-25 Thread Junyang Qian (JIRA)
Junyang Qian created SPARK-16727: Summary: SparkR unit test fails - incorrect expected output Key: SPARK-16727 URL: https://issues.apache.org/jira/browse/SPARK-16727 Project: Spark Issue

[jira] [Updated] (SPARK-16726) Improve error message for `Union` queries on incompatible types

2016-07-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16726: -- Description: Currently, `UNION` query on incompatible types shows a misleading error message,

[jira] [Commented] (SPARK-16718) gbm-style treeboost

2016-07-25 Thread Vladimir Feinberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392914#comment-15392914 ] Vladimir Feinberg commented on SPARK-16718: --- L1 support for loss-based impurity will be delayed

[jira] [Updated] (SPARK-16726) Improve error message for `Union` queries on incompatible types

2016-07-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16726: -- Summary: Improve error message for `Union` queries on incompatible types (was: Improve error

[jira] [Commented] (SPARK-16726) Improve error message for `Union` queries for incompatible types

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392899#comment-15392899 ] Apache Spark commented on SPARK-16726: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-16726) Improve error message for `Union` queries for incompatible types

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16726: Assignee: (was: Apache Spark) > Improve error message for `Union` queries for

[jira] [Assigned] (SPARK-16726) Improve error message for `Union` queries for incompatible types

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16726: Assignee: Apache Spark > Improve error message for `Union` queries for incompatible types

[jira] [Created] (SPARK-16726) Improve error message for `Union` queries for incompatible types

2016-07-25 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-16726: - Summary: Improve error message for `Union` queries for incompatible types Key: SPARK-16726 URL: https://issues.apache.org/jira/browse/SPARK-16726 Project: Spark

[jira] [Created] (SPARK-16725) Migrate Guava to 16+

2016-07-25 Thread Min Wei (JIRA)
Min Wei created SPARK-16725: --- Summary: Migrate Guava to 16+ Key: SPARK-16725 URL: https://issues.apache.org/jira/browse/SPARK-16725 Project: Spark Issue Type: Bug Components: Build

[jira] [Created] (SPARK-16724) Expose DefinedByConstructorParams

2016-07-25 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-16724: Summary: Expose DefinedByConstructorParams Key: SPARK-16724 URL: https://issues.apache.org/jira/browse/SPARK-16724 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status

2016-07-25 Thread Asmaa Ali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asmaa Ali updated SPARK-16723: --- Summary: exception in thread main org.apache.spark.sparkexception application finished with failed

[jira] [Created] (SPARK-16723) exception in thread main org.apache.spark.sparkexception application finished with failed status #19

2016-07-25 Thread Asmaa Ali (JIRA)
Asmaa Ali created SPARK-16723: -- Summary: exception in thread main org.apache.spark.sparkexception application finished with failed status #19 Key: SPARK-16723 URL: https://issues.apache.org/jira/browse/SPARK-16723

[jira] [Assigned] (SPARK-16722) Fix a StreamingContext leak in StreamingContextSuite when eventually fails

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16722: Assignee: Shixiong Zhu (was: Apache Spark) > Fix a StreamingContext leak in

[jira] [Created] (SPARK-16722) Fix a StreamingContext leak in StreamingContextSuite when eventually fails

2016-07-25 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-16722: Summary: Fix a StreamingContext leak in StreamingContextSuite when eventually fails Key: SPARK-16722 URL: https://issues.apache.org/jira/browse/SPARK-16722 Project:

[jira] [Commented] (SPARK-16722) Fix a StreamingContext leak in StreamingContextSuite when eventually fails

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392842#comment-15392842 ] Apache Spark commented on SPARK-16722: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16722) Fix a StreamingContext leak in StreamingContextSuite when eventually fails

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16722: Assignee: Apache Spark (was: Shixiong Zhu) > Fix a StreamingContext leak in

[jira] [Created] (SPARK-16721) Lead/lag needs to respect nulls

2016-07-25 Thread Yin Huai (JIRA)
Yin Huai created SPARK-16721: Summary: Lead/lag needs to respect nulls Key: SPARK-16721 URL: https://issues.apache.org/jira/browse/SPARK-16721 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16633) lag/lead using constant input values does not return the default value when the offset row does not exist

2016-07-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392824#comment-15392824 ] Yin Huai commented on SPARK-16633: -- https://issues.apache.org/jira/browse/SPARK-16721 > lag/lead using

[jira] [Assigned] (SPARK-16721) Lead/lag needs to respect nulls

2016-07-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-16721: Assignee: Yin Huai > Lead/lag needs to respect nulls > > >

[jira] [Commented] (SPARK-16721) Lead/lag needs to respect nulls

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392826#comment-15392826 ] Apache Spark commented on SPARK-16721: -- User 'yhuai' has created a pull request for this issue:

[jira] [Resolved] (SPARK-16715) Fix a potential ExprId conflict for SubexpressionEliminationSuite."Semantic equals and hash"

2016-07-25 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-16715. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Fix a potential

[jira] [Updated] (SPARK-16633) lag/lead using constant input values does not return the default value when the offset row does not exist

2016-07-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16633: - Summary: lag/lead using constant input values does not return the default value when the offset row does

[jira] [Commented] (SPARK-16717) Dataframe (jdbc) is missing a way to link and external function to get a connection

2016-07-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392814#comment-15392814 ] Dongjoon Hyun commented on SPARK-16717: --- Hi, [~rjtokenring]. It seems not about Spark 1.3.0. Do you

[jira] [Assigned] (SPARK-16714) Fail to create a decimal arrays with literals having different inferred precessions and scales

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16714: Assignee: Apache Spark > Fail to create a decimal arrays with literals having different

[jira] [Updated] (SPARK-3162) Train DecisionTree locally when possible

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3162: - Target Version/s: 2.1.0 > Train DecisionTree locally when possible >

[jira] [Updated] (SPARK-3723) DecisionTree, RandomForest: Add more instrumentation

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3723: - Target Version/s: 2.1.0 > DecisionTree, RandomForest: Add more instrumentation >

[jira] [Commented] (SPARK-16714) Fail to create a decimal arrays with literals having different inferred precessions and scales

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392799#comment-15392799 ] Apache Spark commented on SPARK-16714: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-16714) Fail to create a decimal arrays with literals having different inferred precessions and scales

2016-07-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16714: Assignee: (was: Apache Spark) > Fail to create a decimal arrays with literals having

[jira] [Issue Comment Deleted] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3717: - Comment: was deleted (was: [~manishamde][~josephkb] This is very annoying from you

[jira] [Commented] (SPARK-16719) RandomForest: communicate fewer trees on each iteration

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392794#comment-15392794 ] Joseph K. Bradley commented on SPARK-16719: --- I've found (for my tests) that this is one of the

[jira] [Updated] (SPARK-16719) RandomForest: communicate fewer trees on each iteration

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16719: -- Priority: Critical (was: Major) > RandomForest: communicate fewer trees on each

[jira] [Commented] (SPARK-3162) Train DecisionTree locally when possible

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392792#comment-15392792 ] Joseph K. Bradley commented on SPARK-3162: -- [~yuhaoyan] [~MechCoder] This may be one of the most

[jira] [Updated] (SPARK-3162) Train DecisionTree locally when possible

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3162: - Priority: Critical (was: Major) > Train DecisionTree locally when possible >

[jira] [Commented] (SPARK-3162) Train DecisionTree locally when possible

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392788#comment-15392788 ] Joseph K. Bradley commented on SPARK-3162: -- Linking [SPARK-14043] since local training might be a

[jira] [Updated] (SPARK-16719) RandomForest: communicate fewer trees on each iteration

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16719: -- Priority: Critical (was: Major) > RandomForest: communicate fewer trees on each

[jira] [Updated] (SPARK-16719) RandomForest: communicate fewer trees on each iteration

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16719: -- Priority: Major (was: Critical) > RandomForest: communicate fewer trees on each

[jira] [Commented] (SPARK-16714) Fail to create a decimal arrays with literals having different inferred precessions and scales

2016-07-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392780#comment-15392780 ] Dongjoon Hyun commented on SPARK-16714: --- Thank you! :) > Fail to create a decimal arrays with

[jira] [Commented] (SPARK-13434) Reduce Spark RandomForest memory footprint

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392779#comment-15392779 ] Joseph K. Bradley commented on SPARK-13434: --- I agree it's very important. That JIRA had gotten

[jira] [Updated] (SPARK-3162) Train DecisionTree locally when possible

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3162: - Component/s: (was: MLlib) ML > Train DecisionTree locally when

[jira] [Commented] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392775#comment-15392775 ] Joseph K. Bradley commented on SPARK-3717: -- Note: Initial code for this is available here:

[jira] [Updated] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3717: - Assignee: (was: Joseph K. Bradley) > DecisionTree, RandomForest: Partition by feature

[jira] [Updated] (SPARK-3155) Support DecisionTree pruning

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3155: - Priority: Minor (was: Major) > Support DecisionTree pruning >

[jira] [Commented] (SPARK-16714) Fail to create a decimal arrays with literals having different inferred precessions and scales

2016-07-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392772#comment-15392772 ] Yin Huai commented on SPARK-16714: -- Sure. Thank you! > Fail to create a decimal arrays with literals

[jira] [Commented] (SPARK-3728) RandomForest: Learn models too large to store in memory

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392769#comment-15392769 ] Joseph K. Bradley commented on SPARK-3728: -- I was actually thinking of closing this issue. I

[jira] [Updated] (SPARK-3728) RandomForest: Learn models too large to store in memory

2016-07-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3728: - Priority: Minor (was: Major) > RandomForest: Learn models too large to store in memory >

[jira] [Commented] (SPARK-16714) Fail to create a decimal arrays with literals having different inferred precessions and scales

2016-07-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392765#comment-15392765 ] Dongjoon Hyun commented on SPARK-16714: --- Hi, [~yhuai]. May I create a PR for this? > Fail to

[jira] [Commented] (SPARK-16628) OrcConversions should not convert an ORC table represented by MetastoreRelation to HadoopFsRelation if metastore schema does not match schema stored in ORC files

2016-07-25 Thread Nic Eggert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392751#comment-15392751 ] Nic Eggert commented on SPARK-16628: Yeah, I attempted to fix this myself by having it just take the

[jira] [Updated] (SPARK-16166) Correctly honor off heap memory usage in web ui and log display

2016-07-25 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-16166: --- Assignee: Saisai Shao > Correctly honor off heap memory usage in web ui and log display >

  1   2   3   >