[jira] [Closed] (SPARK-7220) Check whether moving shared params is a compatible change

2015-04-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-7220. Resolution: Done Fix Version/s: 1.4.0 > Check whether moving shared params is a compatible ch

[jira] [Commented] (SPARK-7220) Check whether moving shared params is a compatible change

2015-04-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518747#comment-14518747 ] Xiangrui Meng commented on SPARK-7220: -- I compiled an example app that calls LinearRe

[jira] [Updated] (SPARK-7221) Expose the current processed file name of FileInputDStream to the users

2015-04-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-7221: --- Issue Type: Wish (was: New Feature) > Expose the current processed file name of FileInputDStream to t

[jira] [Created] (SPARK-7221) Expose the current processed file name of FileInputDStream to the users

2015-04-28 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-7221: -- Summary: Expose the current processed file name of FileInputDStream to the users Key: SPARK-7221 URL: https://issues.apache.org/jira/browse/SPARK-7221 Project: Spark

[jira] [Resolved] (SPARK-6756) Add compress() to Vector

2015-04-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6756. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5756 [https://githu

[jira] [Created] (SPARK-7220) Check whether moving shared params is a compatible change

2015-04-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7220: Summary: Check whether moving shared params is a compatible change Key: SPARK-7220 URL: https://issues.apache.org/jira/browse/SPARK-7220 Project: Spark Issue

[jira] [Commented] (SPARK-7189) History server will always reload the same file even when no log file is updated

2015-04-28 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518721#comment-14518721 ] Zhang, Liye commented on SPARK-7189: Hi [~vanzin], I think using timestamp is not that

[jira] [Resolved] (SPARK-7208) Add Matrix, SparseMatrix to __all__ list in linalg.py

2015-04-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7208. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5759 [https://githu

[jira] [Updated] (SPARK-7202) Add SparseMatrixPickler to SerDe

2015-04-28 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-7202: --- Priority: Major (was: Minor) > Add SparseMatrixPickler to SerDe > >

[jira] [Created] (SPARK-7219) HashingTF should output ML attributes

2015-04-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7219: Summary: HashingTF should output ML attributes Key: SPARK-7219 URL: https://issues.apache.org/jira/browse/SPARK-7219 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-7219) HashingTF should output ML attributes

2015-04-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7219: - Priority: Trivial (was: Major) > HashingTF should output ML attributes >

[jira] [Assigned] (SPARK-7194) Vectors factors method for sparse vectors should accept the output of zipWithIndex

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7194: --- Assignee: Apache Spark > Vectors factors method for sparse vectors should accept the output o

[jira] [Commented] (SPARK-7194) Vectors factors method for sparse vectors should accept the output of zipWithIndex

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518623#comment-14518623 ] Apache Spark commented on SPARK-7194: - User 'kaka1992' has created a pull request for

[jira] [Assigned] (SPARK-7194) Vectors factors method for sparse vectors should accept the output of zipWithIndex

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7194: --- Assignee: (was: Apache Spark) > Vectors factors method for sparse vectors should accept t

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518621#comment-14518621 ] Guoqiang Li commented on SPARK-5556: [spark-summit.pptx|https://issues.apache.org/jira

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518618#comment-14518618 ] Guoqiang Li commented on SPARK-5556: LDA_Gibbs combines the advantages of AliasLDA, Fa

[jira] [Updated] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-5556: --- Attachment: spark-summit.pptx > Latent Dirichlet Allocation (LDA) using Gibbs sampler > -

[jira] [Comment Edited] (SPARK-7193) "Spark on Mesos" may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518610#comment-14518610 ] Littlestar edited comment on SPARK-7193 at 4/29/15 2:40 AM: I

[jira] [Resolved] (SPARK-7193) "Spark on Mesos" may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar resolved SPARK-7193. --- Resolution: Invalid I think official document missing some notes about "Spark on Mesos" I worked well

[jira] [Resolved] (SPARK-7138) Add method to BlockGenerator to add multiple records to BlockGenerator with single callback

2015-04-28 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7138. -- Resolution: Fixed Fix Version/s: 1.4.0 > Add method to BlockGenerator to add multiple rec

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518602#comment-14518602 ] Guoqiang Li commented on SPARK-5556: I put the latest LDA code in [Zen|https://github

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Pedro Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518601#comment-14518601 ] Pedro Rodriguez commented on SPARK-5556: [~gq] is the LDAGibbs line what I impleme

[jira] [Updated] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-5556: --- Attachment: LDA_test.xlsx > Latent Dirichlet Allocation (LDA) using Gibbs sampler > -

[jira] [Created] (SPARK-7218) Create a real iterator with open/close for Spark SQL

2015-04-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7218: -- Summary: Create a real iterator with open/close for Spark SQL Key: SPARK-7218 URL: https://issues.apache.org/jira/browse/SPARK-7218 Project: Spark Issue Type: Ne

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-04-28 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518508#comment-14518508 ] Saisai Shao commented on SPARK-7169: Hi [~jlewandowski], regard to your second problem

[jira] [Created] (SPARK-7217) Add configuration to disable stopping of SparkContext when StreamingContext.stop()

2015-04-28 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7217: Summary: Add configuration to disable stopping of SparkContext when StreamingContext.stop() Key: SPARK-7217 URL: https://issues.apache.org/jira/browse/SPARK-7217 Proj

[jira] [Resolved] (SPARK-6965) StringIndexer should convert input to Strings

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6965. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5753 [https

[jira] [Created] (SPARK-7216) Show driver details in Mesos cluster UI

2015-04-28 Thread Timothy Chen (JIRA)
Timothy Chen created SPARK-7216: --- Summary: Show driver details in Mesos cluster UI Key: SPARK-7216 URL: https://issues.apache.org/jira/browse/SPARK-7216 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7216) Show driver details in Mesos cluster UI

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518447#comment-14518447 ] Apache Spark commented on SPARK-7216: - User 'tnachen' has created a pull request for t

[jira] [Assigned] (SPARK-7216) Show driver details in Mesos cluster UI

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7216: --- Assignee: Apache Spark > Show driver details in Mesos cluster UI > --

[jira] [Assigned] (SPARK-7216) Show driver details in Mesos cluster UI

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7216: --- Assignee: (was: Apache Spark) > Show driver details in Mesos cluster UI > ---

[jira] [Commented] (SPARK-6627) Clean up of shuffle code and interfaces

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518402#comment-14518402 ] Apache Spark commented on SPARK-6627: - User 'kayousterhout' has created a pull request

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518400#comment-14518400 ] Joseph K. Bradley commented on SPARK-5556: -- That plan sounds good. I haven't yet

[jira] [Assigned] (SPARK-7215) Make repartition and coalesce a part of the query plan

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7215: --- Assignee: Apache Spark > Make repartition and coalesce a part of the query plan > ---

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Pedro Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518378#comment-14518378 ] Pedro Rodriguez commented on SPARK-5556: I will start working on it again then. It

[jira] [Commented] (SPARK-7215) Make repartition and coalesce a part of the query plan

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518379#comment-14518379 ] Apache Spark commented on SPARK-7215: - User 'brkyvz' has created a pull request for th

[jira] [Assigned] (SPARK-7215) Make repartition and coalesce a part of the query plan

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7215: --- Assignee: (was: Apache Spark) > Make repartition and coalesce a part of the query plan >

[jira] [Created] (SPARK-7215) Make repartition and coalesce a part of the query plan

2015-04-28 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-7215: -- Summary: Make repartition and coalesce a part of the query plan Key: SPARK-7215 URL: https://issues.apache.org/jira/browse/SPARK-7215 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5182) Partitioning support for tables created by the data source API

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518305#comment-14518305 ] Apache Spark commented on SPARK-5182: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-04-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518286#comment-14518286 ] Sandy Ryza commented on SPARK-3655: --- My opinion is that a secondary sort operator in cor

[jira] [Created] (SPARK-7214) Unrolling never evicts blocks when MemoryStore is nearly full

2015-04-28 Thread Charles Reiss (JIRA)
Charles Reiss created SPARK-7214: Summary: Unrolling never evicts blocks when MemoryStore is nearly full Key: SPARK-7214 URL: https://issues.apache.org/jira/browse/SPARK-7214 Project: Spark

[jira] [Commented] (SPARK-7156) Add randomSplit method to DataFrame

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518248#comment-14518248 ] Apache Spark commented on SPARK-7156: - User 'brkyvz' has created a pull request for th

[jira] [Commented] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518201#comment-14518201 ] Apache Spark commented on SPARK-7213: - User 'nishkamravi2' has created a pull request

[jira] [Assigned] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7213: --- Assignee: Apache Spark > Exception while copying Hadoop config files due to permission issues

[jira] [Assigned] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7213: --- Assignee: (was: Apache Spark) > Exception while copying Hadoop config files due to permis

[jira] [Commented] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

2015-04-28 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518197#comment-14518197 ] Nishkam Ravi commented on SPARK-7213: - PR: https://github.com/apache/spark/pull/5760/

[jira] [Commented] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

2015-04-28 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518188#comment-14518188 ] Nishkam Ravi commented on SPARK-7213: - Exception in thread "main" java.io.FileNotFound

[jira] [Created] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

2015-04-28 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-7213: --- Summary: Exception while copying Hadoop config files due to permission issues Key: SPARK-7213 URL: https://issues.apache.org/jira/browse/SPARK-7213 Project: Spark

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518141#comment-14518141 ] Joseph K. Bradley commented on SPARK-5556: -- Great! I'm not aware of blockers. A

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-04-28 Thread Pedro Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518133#comment-14518133 ] Pedro Rodriguez commented on SPARK-5556: With the refactoring done, I can get to w

[jira] [Created] (SPARK-7212) Frequent pattern mining for sequential item sets

2015-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7212: Summary: Frequent pattern mining for sequential item sets Key: SPARK-7212 URL: https://issues.apache.org/jira/browse/SPARK-7212 Project: Spark Issue

[jira] [Created] (SPARK-7211) Improvements for FPGrowth

2015-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7211: Summary: Improvements for FPGrowth Key: SPARK-7211 URL: https://issues.apache.org/jira/browse/SPARK-7211 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-7210) Test matrix decompositions for speed vs. numerical stability for Gaussians

2015-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7210: Summary: Test matrix decompositions for speed vs. numerical stability for Gaussians Key: SPARK-7210 URL: https://issues.apache.org/jira/browse/SPARK-7210 Proj

[jira] [Updated] (SPARK-7209) Adding new Manning book "Spark in Action" to the official Spark Webpage

2015-04-28 Thread Aleksandar Dragosavljevic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Dragosavljevic updated SPARK-7209: - Attachment: Spark in Action.jpg Book cover > Adding new Manning book "Spa

[jira] [Commented] (SPARK-6943) Graphically show RDD's included in a stage

2015-04-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518084#comment-14518084 ] Andrew Or commented on SPARK-6943: -- Yeah ideally we will have the job graph that magnifie

[jira] [Created] (SPARK-7209) Adding new Manning book "Spark in Action" to the official Spark Webpage

2015-04-28 Thread Aleksandar Dragosavljevic (JIRA)
Aleksandar Dragosavljevic created SPARK-7209: Summary: Adding new Manning book "Spark in Action" to the official Spark Webpage Key: SPARK-7209 URL: https://issues.apache.org/jira/browse/SPARK-7209

[jira] [Assigned] (SPARK-7208) Add Matrix, SparseMatrix to __all__ list in linalg.py

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7208: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Add Matrix, SparseMatrix to __all__ list i

[jira] [Assigned] (SPARK-7208) Add Matrix, SparseMatrix to __all__ list in linalg.py

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7208: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Add Matrix, SparseMatrix to __all__ list i

[jira] [Commented] (SPARK-7208) Add Matrix, SparseMatrix to __all__ list in linalg.py

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518075#comment-14518075 ] Apache Spark commented on SPARK-7208: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-7208) Add Matrix, SparseMatrix to __all__ list in linalg.py

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7208: - Summary: Add Matrix, SparseMatrix to __all__ list in linalg.py (was: Add SparseMatrix to

[jira] [Created] (SPARK-7208) Add SparseMatrix to __all__ list in linalg.py

2015-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7208: Summary: Add SparseMatrix to __all__ list in linalg.py Key: SPARK-7208 URL: https://issues.apache.org/jira/browse/SPARK-7208 Project: Spark Issue Typ

[jira] [Commented] (SPARK-7207) Add new spark.ml subpackages to SparkBuild

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518069#comment-14518069 ] Apache Spark commented on SPARK-7207: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-7207) Add new spark.ml subpackages to SparkBuild

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7207: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Add new spark.ml subpackages to SparkBuild

[jira] [Assigned] (SPARK-7207) Add new spark.ml subpackages to SparkBuild

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7207: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Add new spark.ml subpackages to SparkBuild

[jira] [Resolved] (SPARK-7201) Move identifiable to ml.util

2015-04-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7201. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5749 [https://githu

[jira] [Created] (SPARK-7207) Add new spark.ml subpackages to SparkBuild

2015-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7207: Summary: Add new spark.ml subpackages to SparkBuild Key: SPARK-7207 URL: https://issues.apache.org/jira/browse/SPARK-7207 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-7204) Call sites in UI are not accurate for DataFrame operations

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7204: --- Assignee: Apache Spark (was: Patrick Wendell) > Call sites in UI are not accurate for DataFr

[jira] [Assigned] (SPARK-7204) Call sites in UI are not accurate for DataFrame operations

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7204: --- Assignee: Patrick Wendell (was: Apache Spark) > Call sites in UI are not accurate for DataFr

[jira] [Commented] (SPARK-7204) Call sites in UI are not accurate for DataFrame operations

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518047#comment-14518047 ] Apache Spark commented on SPARK-7204: - User 'pwendell' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-5014) GaussianMixture (GMM) improvements

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5014: - Comment: was deleted (was: No need for umbrella JIRA) > GaussianMixture (GMM) improvement

[jira] [Created] (SPARK-7206) Gaussian Mixture Model (GMM) improvements

2015-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7206: Summary: Gaussian Mixture Model (GMM) improvements Key: SPARK-7206 URL: https://issues.apache.org/jira/browse/SPARK-7206 Project: Spark Issue Type: U

[jira] [Commented] (SPARK-6756) Add compress() to Vector

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518008#comment-14518008 ] Apache Spark commented on SPARK-6756: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-6756) Add compress() to Vector

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6756: --- Assignee: Xiangrui Meng (was: Apache Spark) > Add compress() to Vector > ---

[jira] [Assigned] (SPARK-6756) Add compress() to Vector

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6756: --- Assignee: Apache Spark (was: Xiangrui Meng) > Add compress() to Vector > ---

[jira] [Updated] (SPARK-5338) Support cluster mode with Mesos

2015-04-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5338: - Affects Version/s: 1.0.0 > Support cluster mode with Mesos > --- > >

[jira] [Closed] (SPARK-5338) Support cluster mode with Mesos

2015-04-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5338. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Timothy Chen Target Version/s:

[jira] [Commented] (SPARK-7205) Support local ivy cache in --packages

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517988#comment-14517988 ] Apache Spark commented on SPARK-7205: - User 'brkyvz' has created a pull request for th

[jira] [Assigned] (SPARK-7205) Support local ivy cache in --packages

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7205: --- Assignee: (was: Apache Spark) > Support local ivy cache in --packages > -

[jira] [Assigned] (SPARK-7205) Support local ivy cache in --packages

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7205: --- Assignee: Apache Spark > Support local ivy cache in --packages >

[jira] [Created] (SPARK-7204) Call sites in UI are not accurate for DataFrame operations

2015-04-28 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7204: -- Summary: Call sites in UI are not accurate for DataFrame operations Key: SPARK-7204 URL: https://issues.apache.org/jira/browse/SPARK-7204 Project: Spark

[jira] [Created] (SPARK-7205) Support local ivy cache in --packages

2015-04-28 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-7205: -- Summary: Support local ivy cache in --packages Key: SPARK-7205 URL: https://issues.apache.org/jira/browse/SPARK-7205 Project: Spark Issue Type: Bug Com

[jira] [Comment Edited] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-04-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517946#comment-14517946 ] koert kuipers edited comment on SPARK-3655 at 4/28/15 8:19 PM: -

[jira] [Comment Edited] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-04-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517946#comment-14517946 ] koert kuipers edited comment on SPARK-3655 at 4/28/15 8:18 PM: -

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-04-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517946#comment-14517946 ] koert kuipers commented on SPARK-3655: -- since the last pullreq for this ticket i crea

[jira] [Comment Edited] (SPARK-7178) Improve DataFrame documentation and code samples

2015-04-28 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517858#comment-14517858 ] Chris Fregly edited comment on SPARK-7178 at 4/28/15 8:07 PM: --

[jira] [Comment Edited] (SPARK-7202) Add SparseMatrixPickler to SerDe

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517905#comment-14517905 ] Joseph K. Bradley edited comment on SPARK-7202 at 4/28/15 8:01 PM: -

[jira] [Commented] (SPARK-7202) Add SparseMatrixPickler to SerDe

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517905#comment-14517905 ] Joseph K. Bradley commented on SPARK-7202: -- @MechCoder I just made an umbrella

[jira] [Updated] (SPARK-7202) Add SparseMatrixPickler to SerDe

2015-04-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7202: - Issue Type: Sub-task (was: New Feature) Parent: SPARK-7203 > Add SparseMatrixPick

[jira] [Created] (SPARK-7203) Python API for local linear algebra

2015-04-28 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7203: Summary: Python API for local linear algebra Key: SPARK-7203 URL: https://issues.apache.org/jira/browse/SPARK-7203 Project: Spark Issue Type: Umbrell

[jira] [Updated] (SPARK-7161) Provide REST api to download event logs from History Server

2015-04-28 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Sakellis updated SPARK-7161: --- Component/s: (was: Streaming) Spark Core > Provide REST api to download e

[jira] [Commented] (SPARK-4414) SparkContext.wholeTextFiles Doesn't work with S3 Buckets

2015-04-28 Thread Tristan Nixon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517886#comment-14517886 ] Tristan Nixon commented on SPARK-4414: -- Thanks, [~petedmarsh], I was having this same

[jira] [Comment Edited] (SPARK-6994) Allow to fetch field values by name in sql.Row

2015-04-28 Thread Shuai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517882#comment-14517882 ] Shuai Zheng edited comment on SPARK-6994 at 4/28/15 7:48 PM: -

[jira] [Commented] (SPARK-6994) Allow to fetch field values by name in sql.Row

2015-04-28 Thread Shuai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517882#comment-14517882 ] Shuai Zheng commented on SPARK-6994: I create one more pull request: https://github.co

[jira] [Commented] (SPARK-6994) Allow to fetch field values by name in sql.Row

2015-04-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517881#comment-14517881 ] Apache Spark commented on SPARK-6994: - User 'szheng79' has created a pull request for

[jira] [Commented] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-04-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517866#comment-14517866 ] Andrew Or commented on SPARK-6197: -- https://github.com/apache/spark/pull/5736 > handle j

[jira] [Updated] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-04-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6197: - Fix Version/s: 1.3.1 > handle json parse exception for eventlog file not finished writing > -

[jira] [Commented] (SPARK-7178) Improve DataFrame documentation and code samples

2015-04-28 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517858#comment-14517858 ] Chris Fregly commented on SPARK-7178: - added this to the forums to address the AND and

[jira] [Updated] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5389: - Component/s: Windows PySpark > spark-shell.cmd does not run from DOS Windows 7 >

[jira] [Updated] (SPARK-7202) Add SparseMatrixPickler to SerDe

2015-04-28 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-7202: --- Priority: Minor (was: Major) > Add SparseMatrixPickler to SerDe > >

[jira] [Commented] (SPARK-7195) Can't start spark shell or pyspark in Windows 7

2015-04-28 Thread Mark Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517826#comment-14517826 ] Mark Smiley commented on SPARK-7195: Sean, I added my bug as a comment to the old bug

  1   2   >