[jira] [Commented] (SPARK-10994) Local clustering coefficient computation in GraphX

2015-10-12 Thread Yang Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952716#comment-14952716 ] Yang Yang commented on SPARK-10994: --- Proposed implementation:

[jira] [Updated] (SPARK-11058) failed spark job reports on YARN as successful

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11058: -- Priority: Minor (was: Critical) (This is not "Critical") Was your job in fact successful? an

[jira] [Assigned] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11051: Assignee: (was: Apache Spark) > NullPointerException when action called on

[jira] [Assigned] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11051: Assignee: Apache Spark > NullPointerException when action called on localCheckpointed RDD

[jira] [Commented] (SPARK-10507) reject temporal expressions such as timestamp - timestamp at parse time

2015-10-12 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952747#comment-14952747 ] Adrian Wang commented on SPARK-10507: - It seems this bug has been fixed long long ago. I just checked

[jira] [Commented] (SPARK-9844) File appender race condition during SparkWorker shutdown

2015-10-12 Thread Alexander Krasheninnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952761#comment-14952761 ] Alexander Krasheninnikov commented on SPARK-9844: - Is this issue really minor? In my case,

[jira] [Commented] (SPARK-11029) Add computeCost to KMeansModel in spark.ml

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952731#comment-14952731 ] Apache Spark commented on SPARK-11029: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11029) Add computeCost to KMeansModel in spark.ml

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11029: Assignee: Apache Spark > Add computeCost to KMeansModel in spark.ml >

[jira] [Resolved] (SPARK-10507) reject temporal expressions such as timestamp - timestamp at parse time

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10507. --- Resolution: Cannot Reproduce > reject temporal expressions such as timestamp - timestamp at parse

[jira] [Created] (SPARK-11061) baidu

2015-10-12 Thread jason kim (JIRA)
jason kim created SPARK-11061: - Summary: baidu Key: SPARK-11061 URL: https://issues.apache.org/jira/browse/SPARK-11061 Project: Spark Issue Type: Question Reporter: jason kim

[jira] [Assigned] (SPARK-11029) Add computeCost to KMeansModel in spark.ml

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11029: Assignee: (was: Apache Spark) > Add computeCost to KMeansModel in spark.ml >

[jira] [Updated] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11008: -- Priority: Minor (was: Blocker) [~pchalasani] don't set "Blocker". I agree that most bets are off when

[jira] [Resolved] (SPARK-11061) baidu

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11061. --- Resolution: Invalid [~leehom] Have a look at

[jira] [Resolved] (SPARK-11054) WARN ReliableDeliverySupervisor: Association with remote system

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11054. --- Resolution: Not A Problem > WARN ReliableDeliverySupervisor: Association with remote system >

[jira] [Resolved] (SPARK-10989) Add the dot and hadamard products to the Vectors object

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10989. --- Resolution: Duplicate I'd like to consider this a subset of the existing SPARK-6442 discussion. In

[jira] [Assigned] (SPARK-11063) Spark TaskSetManager doesn't use Receiver's scheduling executors

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11063: Assignee: (was: Apache Spark) > Spark TaskSetManager doesn't use Receiver's

[jira] [Assigned] (SPARK-11063) Spark TaskSetManager doesn't use Receiver's scheduling executors

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11063: Assignee: Apache Spark > Spark TaskSetManager doesn't use Receiver's scheduling executors

[jira] [Commented] (SPARK-11062) Thrift server does not support operationLog

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952815#comment-14952815 ] Apache Spark commented on SPARK-11062: -- User 'navis' has created a pull request for this issue:

[jira] [Commented] (SPARK-11061) baidu

2015-10-12 Thread jason kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952816#comment-14952816 ] jason kim commented on SPARK-11061: --- sorry,Can you give me a link,Because I'm here to open Google has

[jira] [Assigned] (SPARK-11062) Thrift server does not support operationLog

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11062: Assignee: Apache Spark > Thrift server does not support operationLog >

[jira] [Created] (SPARK-11063) Spark TaskSetManager doesn't use Receiver's scheduling executors

2015-10-12 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11063: Summary: Spark TaskSetManager doesn't use Receiver's scheduling executors Key: SPARK-11063 URL: https://issues.apache.org/jira/browse/SPARK-11063 Project: Spark

[jira] [Created] (SPARK-11064) spark streaming checkpoint question

2015-10-12 Thread jason kim (JIRA)
jason kim created SPARK-11064: - Summary: spark streaming checkpoint question Key: SPARK-11064 URL: https://issues.apache.org/jira/browse/SPARK-11064 Project: Spark Issue Type: Question

[jira] [Commented] (SPARK-8598) Implementation of 1-sample, two-sided, Kolmogorov Smirnov Test for RDDs

2015-10-12 Thread Christophe S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952906#comment-14952906 ] Christophe S commented on SPARK-8598: - Hi, It would be nice to be able to get the KS distance. It

[jira] [Commented] (SPARK-11061) baidu

2015-10-12 Thread jason kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952814#comment-14952814 ] jason kim commented on SPARK-11061: --- sorry,Can you give me a link,Because I'm here to open Google has

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-10-12 Thread christian sommeregger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952869#comment-14952869 ] christian sommeregger commented on SPARK-2309: -- Sorry everyone! I got confused by the

[jira] [Commented] (SPARK-11063) Spark TaskSetManager doesn't use Receiver's scheduling executors

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952822#comment-14952822 ] Apache Spark commented on SPARK-11063: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-11062) Thrift server does not support operationLog

2015-10-12 Thread Navis (JIRA)
Navis created SPARK-11062: - Summary: Thrift server does not support operationLog Key: SPARK-11062 URL: https://issues.apache.org/jira/browse/SPARK-11062 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test

2015-10-12 Thread Christophe S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952907#comment-14952907 ] Christophe S commented on SPARK-8674: - Hi, It would be nice to be able to get the KS distance. It

[jira] [Commented] (SPARK-3533) Add saveAsTextFileByKey() method to RDDs

2015-10-12 Thread Alexander Betaev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952860#comment-14952860 ] Alexander Betaev commented on SPARK-3533: - I may suggest

[jira] [Commented] (SPARK-5885) Add VectorAssembler

2015-10-12 Thread Alexis Seigneurin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953236#comment-14953236 ] Alexis Seigneurin commented on SPARK-5885: -- {quote} I tried to create a pipeline in which the

[jira] [Comment Edited] (SPARK-10976) java.lang.UnsupportedOperationException: taskSucceeded() called on a finished JobWaiter

2015-10-12 Thread Dr Stephen A Hellberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953260#comment-14953260 ] Dr Stephen A Hellberg edited comment on SPARK-10976 at 10/12/15 4:16 PM:

[jira] [Closed] (SPARK-10976) java.lang.UnsupportedOperationException: taskSucceeded() called on a finished JobWaiter

2015-10-12 Thread Dr Stephen A Hellberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dr Stephen A Hellberg closed SPARK-10976. - Resolution: Invalid Cancelling my first report and investigation of this problem

[jira] [Updated] (SPARK-10960) SQL with windowing function cannot reference column in inner select block

2015-10-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10960: - Assignee: Liang-Chi Hsieh > SQL with windowing function cannot reference column in inner select block >

[jira] [Assigned] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11066: Assignee: Apache Spark > Flaky test

[jira] [Assigned] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11066: Assignee: (was: Apache Spark) > Flaky test

[jira] [Created] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-12 Thread Dr Stephen A Hellberg (JIRA)
Dr Stephen A Hellberg created SPARK-11066: - Summary: Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter Key:

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953241#comment-14953241 ] Apache Spark commented on SPARK-11066: -- User 'shellberg' has created a pull request for this issue:

[jira] [Commented] (SPARK-5885) Add VectorAssembler

2015-10-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953269#comment-14953269 ] Xiangrui Meng commented on SPARK-5885: -- Set withMean to false in StandardScaler. > Add

[jira] [Created] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-12 Thread Alex Liu (JIRA)
Alex Liu created SPARK-11067: Summary: Spark SQL thrift server fails to handle decimal value Key: SPARK-11067 URL: https://issues.apache.org/jira/browse/SPARK-11067 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10976) java.lang.UnsupportedOperationException: taskSucceeded() called on a finished JobWaiter

2015-10-12 Thread Dr Stephen A Hellberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953260#comment-14953260 ] Dr Stephen A Hellberg commented on SPARK-10976: --- Got further this time... although I was

[jira] [Resolved] (SPARK-10960) SQL with windowing function cannot reference column in inner select block

2015-10-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10960. -- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10960) SQL with windowing function cannot reference column in inner select block

2015-10-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10960: - Fix Version/s: 1.4.2 > SQL with windowing function cannot reference column in inner select block >

[jira] [Commented] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953038#comment-14953038 ] Jean-Baptiste Onofré commented on SPARK-11051: -- By the way, I don't reproduce this issue

[jira] [Closed] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-12 Thread Prasad Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasad Chalasani closed SPARK-11008. Resolution: Not A Problem > Spark window function returns inconsistent/wrong results >

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953024#comment-14953024 ] Sean Owen commented on SPARK-2309: -- Hm, I'm not sure I've seen a formulation like that before. Typically

[jira] [Commented] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-10-12 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953158#comment-14953158 ] Tien-Dung LE commented on SPARK-9280: - [~davies] I have just checked out with the latest spark master

[jira] [Commented] (SPARK-11058) failed spark job reports on YARN as successful

2015-10-12 Thread Lan Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953184#comment-14953184 ] Lan Jiang commented on SPARK-11058: --- Sean, Thanks for your comments. I made it critical because

[jira] [Created] (SPARK-11065) IOException thrown at job submit shutdown

2015-10-12 Thread JIRA
Jean-Baptiste Onofré created SPARK-11065: Summary: IOException thrown at job submit shutdown Key: SPARK-11065 URL: https://issues.apache.org/jira/browse/SPARK-11065 Project: Spark

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-10-12 Thread christian sommeregger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953136#comment-14953136 ] christian sommeregger commented on SPARK-2309: -- yes, I think the k should be dropped in x_k

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

2015-10-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953172#comment-14953172 ] Jean-Baptiste Onofré commented on SPARK-10876: -- I've updated the PR. > display total

[jira] [Commented] (SPARK-11064) spark streaming checkpoint question

2015-10-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953175#comment-14953175 ] Jean-Baptiste Onofré commented on SPARK-11064: -- Hi Jason, can you explain a bit your use

[jira] [Updated] (SPARK-11065) IOException thrown at job submit shutdown

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11065: -- Priority: Minor (was: Major) I am not sure this is actually a problem; during shutdown it could be

[jira] [Resolved] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11023. Resolution: Fixed Fix Version/s: 1.5.2 > Error initializing SparkContext.

[jira] [Updated] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10930: -- Assignee: Derek Dagit > History "Stages" page "duration" can be confusing >

[jira] [Resolved] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

2015-10-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8170. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9033

[jira] [Updated] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11066: -- Target Version/s: (was: 1.5.1, 1.6.0) Fix Version/s: (was: 1.5.1)

[jira] [Commented] (SPARK-11042) Introduce a mechanism to ban creating new root SQLContexts in a JVM

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953433#comment-14953433 ] Apache Spark commented on SPARK-11042: -- User 'yhuai' has created a pull request for this issue:

[jira] [Updated] (SPARK-11057) SQL: corr and cov for many columns

2015-10-12 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-11057: -- Component/s: SQL > SQL: corr and cov for many columns >

[jira] [Updated] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-11023: --- Target Version/s: 1.5.2, 1.6.0 Fix Version/s: 1.6.0 > Error initializing

[jira] [Commented] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953480#comment-14953480 ] Sean Owen commented on SPARK-10930: --- (Done) > History "Stages" page "duration" can be confusing >

[jira] [Updated] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11066: -- Component/s: Tests > Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler >

[jira] [Updated] (SPARK-11038) Consolidate the format of UnsafeArrayData and UnsafeMapData

2015-10-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11038: --- Component/s: (was: Spark Core) SQL > Consolidate the format of UnsafeArrayData

[jira] [Resolved] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-10-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9280. --- Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 > New HiveContext object

[jira] [Resolved] (SPARK-11007) Add dictionary support for CatalystDecimalConverter

2015-10-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11007. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9040

[jira] [Updated] (SPARK-11050) PySpark SparseVector can return wrong index in error message

2015-10-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11050: -- Shepherd: Joseph K. Bradley Target Version/s: 1.6.0 > PySpark SparseVector

[jira] [Commented] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-12 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953469#comment-14953469 ] Thomas Graves commented on SPARK-10930: --- [~pwendell] Can you add Derek as a contributor? >

[jira] [Commented] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-12 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953486#comment-14953486 ] Thomas Graves commented on SPARK-10930: --- thanks [~srowen] > History "Stages" page "duration" can

[jira] [Updated] (SPARK-11029) Add computeCost to KMeansModel in spark.ml

2015-10-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11029: -- Shepherd: Joseph K. Bradley Assignee: yuhao yang > Add computeCost to KMeansModel

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-10-12 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953530#comment-14953530 ] DB Tsai commented on SPARK-2309: I think the priority will be porting MLOR into Spark ML framework first,

[jira] [Created] (SPARK-11068) Add callback to query execution

2015-10-12 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11068: --- Summary: Add callback to query execution Key: SPARK-11068 URL: https://issues.apache.org/jira/browse/SPARK-11068 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-11068) Add callback to query execution

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953578#comment-14953578 ] Apache Spark commented on SPARK-11068: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11068) Add callback to query execution

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11068: Assignee: (was: Apache Spark) > Add callback to query execution >

[jira] [Commented] (SPARK-10505) windowed form of count ( star ) fails with No handler for udf class

2015-10-12 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953580#comment-14953580 ] Xin Wu commented on SPARK-10505: [~the6campbells] I also tried this on Spark 1.5.1 and it is not

[jira] [Assigned] (SPARK-11068) Add callback to query execution

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11068: Assignee: Apache Spark > Add callback to query execution >

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-10-12 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953520#comment-14953520 ] DB Tsai commented on SPARK-2309: That was a typo. In line 3, x should be x_k. Several people already sent

[jira] [Created] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2015-10-12 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11069: - Summary: Add RegexTokenizer option to convert to lowercase Key: SPARK-11069 URL: https://issues.apache.org/jira/browse/SPARK-11069 Project: Spark

[jira] [Created] (SPARK-11070) Remove older releases on dist.apache.org

2015-10-12 Thread Sean Owen (JIRA)
Sean Owen created SPARK-11070: - Summary: Remove older releases on dist.apache.org Key: SPARK-11070 URL: https://issues.apache.org/jira/browse/SPARK-11070 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-11042) Introduce a mechanism to ban creating new root SQLContexts in a JVM

2015-10-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11042. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9058

[jira] [Comment Edited] (SPARK-10505) windowed form of count ( star ) fails with No handler for udf class

2015-10-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945791#comment-14945791 ] Reynold Xin edited comment on SPARK-10505 at 10/12/15 8:53 PM: ---

[jira] [Comment Edited] (SPARK-10505) windowed form of count ( star ) fails with No handler for udf class

2015-10-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953580#comment-14953580 ] Reynold Xin edited comment on SPARK-10505 at 10/12/15 8:53 PM: ---

[jira] [Resolved] (SPARK-10505) windowed form of count ( star ) fails with No handler for udf class

2015-10-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10505. -- Resolution: Invalid > windowed form of count ( star ) fails with No handler for udf class >

[jira] [Commented] (SPARK-10505) windowed form of count ( star ) fails with No handler for udf class

2015-10-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953719#comment-14953719 ] Yin Huai commented on SPARK-10505: -- [~the6campbells] Seems you were using Spark 1.3 (I got the exception

[jira] [Commented] (SPARK-11071) LauncherServerSuite::testTimeout is flaky

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953753#comment-14953753 ] Apache Spark commented on SPARK-11071: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11071) LauncherServerSuite::testTimeout is flaky

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11071: Assignee: Marcelo Vanzin (was: Apache Spark) > LauncherServerSuite::testTimeout is flaky

[jira] [Resolved] (SPARK-11056) Improve documentation on how to build Spark efficiently

2015-10-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-11056. Resolution: Fixed > Improve documentation on how to build Spark efficiently >

[jira] [Updated] (SPARK-11072) simplify self join handling

2015-10-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-11072: Description: self-join is a diamond problem that confuse our analyzer. Our current solution is

[jira] [Created] (SPARK-11073) Remove akka dependency from SecurityManager

2015-10-12 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11073: -- Summary: Remove akka dependency from SecurityManager Key: SPARK-11073 URL: https://issues.apache.org/jira/browse/SPARK-11073 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11074) Attempt to automatically create event log directory if it doesn't already exist

2015-10-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954238#comment-14954238 ] Kay Ousterhout commented on SPARK-11074: But the logs also don't belong to the application,

[jira] [Commented] (SPARK-11074) Attempt to automatically create event log directory if it doesn't already exist

2015-10-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954007#comment-14954007 ] Marcelo Vanzin commented on SPARK-11074: BTW there have been previous attempts to do this, and I

[jira] [Commented] (SPARK-11074) Attempt to automatically create event log directory if it doesn't already exist

2015-10-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954019#comment-14954019 ] Kay Ousterhout commented on SPARK-11074: For the first issue (that the user doesn't have

[jira] [Commented] (SPARK-11074) Attempt to automatically create event log directory if it doesn't already exist

2015-10-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954094#comment-14954094 ] Marcelo Vanzin commented on SPARK-11074: bq. they don't get the "it just works" behavior that I

[jira] [Commented] (SPARK-11074) Attempt to automatically create event log directory if it doesn't already exist

2015-10-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954090#comment-14954090 ] Kay Ousterhout commented on SPARK-11074: Using 1777 as the default seems fine -- but for all of

[jira] [Commented] (SPARK-11074) Attempt to automatically create event log directory if it doesn't already exist

2015-10-12 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954119#comment-14954119 ] Kay Ousterhout commented on SPARK-11074: Is your pushback here because you've seen cases where

[jira] [Assigned] (SPARK-10983) Implement unified memory manager

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10983: Assignee: Andrew Or (was: Apache Spark) > Implement unified memory manager >

[jira] [Assigned] (SPARK-10983) Implement unified memory manager

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10983: Assignee: Apache Spark (was: Andrew Or) > Implement unified memory manager >

[jira] [Commented] (SPARK-10983) Implement unified memory manager

2015-10-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954189#comment-14954189 ] Apache Spark commented on SPARK-10983: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Updated] (SPARK-10668) Use WeightedLeastSquares in LinearRegression with L2 regularization if the number of features is small

2015-10-12 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-10668: Shepherd: DB Tsai (was: Xiangrui Meng) > Use WeightedLeastSquares in LinearRegression with L2

[jira] [Commented] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

2015-10-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953852#comment-14953852 ] Yin Huai commented on SPARK-10953: -- Yes, I think so. > Benchmark codegen vs. hand-written code for

[jira] [Commented] (SPARK-11074) Attempt to automatically create event log directory if it doesn't already exist

2015-10-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954025#comment-14954025 ] Marcelo Vanzin commented on SPARK-11074: bq. What do you mean by the "right" permissions here?

[jira] [Commented] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

2015-10-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954202#comment-14954202 ] Ted Yu commented on SPARK-10985: I am bit confused by the assignment of this JIRA. Normally assignee is

  1   2   >