[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700284#comment-14700284 ] Sudhakar Thota commented on SPARK-9776: --- Michael, I am confused. These are the steps

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700285#comment-14700285 ] Michael Armbrust commented on SPARK-9776: - Do not run #2. sqlContext is created

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Eugene Zhulenev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700287#comment-14700287 ] Eugene Zhulenev commented on SPARK-9776: automatically created sqlContext is

[jira] [Commented] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

2015-08-17 Thread Robert Beauchemin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700293#comment-14700293 ] Robert Beauchemin commented on SPARK-10066: --- Yes. I've even changed it (as a

[jira] [Updated] (SPARK-9866) VersionsSuite is unnecessarily slow in Jenkins

2015-08-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9866: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-9288 VersionsSuite is unnecessarily slow in

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

2015-08-17 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700302#comment-14700302 ] Meihua Wu commented on SPARK-8518: -- [~yanbo] Thank you very much for the update! The

[jira] [Created] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-08-17 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-10079: --- Summary: Make `column` and `col` functions be S4 functions Key: SPARK-10079 URL: https://issues.apache.org/jira/browse/SPARK-10079 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9972) Add `struct`, `encode` and `decode` function in SparkR

2015-08-17 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699237#comment-14699237 ] Yu Ishikawa commented on SPARK-9972: This is a quick note to tell the reason. When I

[jira] [Commented] (SPARK-10026) Implement some common Params for regression in PySpark

2015-08-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699240#comment-14699240 ] Yanbo Liang commented on SPARK-10026: - I'm working on it. Implement some common

[jira] [Commented] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699280#comment-14699280 ] Apache Spark commented on SPARK-7837: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7837: --- Assignee: Cheng Lian (was: Apache Spark) NPE when save as parquet in speculative tasks

[jira] [Updated] (SPARK-10035) Parquet filters does not process EqualNullSafe filter.

2015-08-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10035: --- Assignee: Hyukjin Kwon Parquet filters does not process EqualNullSafe filter.

[jira] [Commented] (SPARK-8847) String concatination with column in SparkR

2015-08-17 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699219#comment-14699219 ] Sun Rui commented on SPARK-8847: The concat() expression is addressing this issue.

[jira] [Assigned] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7837: --- Assignee: Apache Spark (was: Cheng Lian) NPE when save as parquet in speculative tasks

[jira] [Commented] (SPARK-10035) Parquet filters does not process EqualNullSafe filter.

2015-08-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699316#comment-14699316 ] Cheng Lian commented on SPARK-10035: Done, thanks for working on this! Parquet

[jira] [Created] (SPARK-10048) Support arbitrary nested Java array in serde

2015-08-17 Thread Sun Rui (JIRA)
Sun Rui created SPARK-10048: --- Summary: Support arbitrary nested Java array in serde Key: SPARK-10048 URL: https://issues.apache.org/jira/browse/SPARK-10048 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-10050) Support collecting data of MapType in DataFrame

2015-08-17 Thread Sun Rui (JIRA)
Sun Rui created SPARK-10050: --- Summary: Support collecting data of MapType in DataFrame Key: SPARK-10050 URL: https://issues.apache.org/jira/browse/SPARK-10050 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-10049) Support collecting data of ArraryType in DataFrame

2015-08-17 Thread Sun Rui (JIRA)
Sun Rui created SPARK-10049: --- Summary: Support collecting data of ArraryType in DataFrame Key: SPARK-10049 URL: https://issues.apache.org/jira/browse/SPARK-10049 Project: Spark Issue Type:

[jira] [Created] (SPARK-10051) Support collecting data of StructType in DataFrame

2015-08-17 Thread Sun Rui (JIRA)
Sun Rui created SPARK-10051: --- Summary: Support collecting data of StructType in DataFrame Key: SPARK-10051 URL: https://issues.apache.org/jira/browse/SPARK-10051 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10030) Managed memory leak detected when cache table

2015-08-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699372#comment-14699372 ] Cheng Lian commented on SPARK-10030: [~joshrosen] Seems to be related to Tungsten?

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10030: -- Component/s: SQL Managed memory leak detected when cache table

[jira] [Created] (SPARK-10052) KafKaDirectDstream should filter empty partition task or rdd

2015-08-17 Thread SuYan (JIRA)
SuYan created SPARK-10052: - Summary: KafKaDirectDstream should filter empty partition task or rdd Key: SPARK-10052 URL: https://issues.apache.org/jira/browse/SPARK-10052 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-08-17 Thread Aram Mkrtchyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699397#comment-14699397 ] Aram Mkrtchyan commented on SPARK-5480: --- We also have the same problem almost every

[jira] [Commented] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700342#comment-14700342 ] Feynman Liang commented on SPARK-10068: --- Working on this Add links to sections in

[jira] [Resolved] (SPARK-9868) auto_sortmerge_join_8 fails non-deterministically in Jenkins

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9868. - Resolution: Cannot Reproduce Fix Version/s: 1.5.0 auto_sortmerge_join_8 fails

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700377#comment-14700377 ] Sudhakar Thota commented on SPARK-9776: --- Thanks Michael and Eugene. I have no

[jira] [Created] (SPARK-10071) QueueInputDStream Should Allow Checkpointing

2015-08-17 Thread Asim Jalis (JIRA)
Asim Jalis created SPARK-10071: -- Summary: QueueInputDStream Should Allow Checkpointing Key: SPARK-10071 URL: https://issues.apache.org/jira/browse/SPARK-10071 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9906) User guide for LogisticRegressionSummary

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9906: - Shepherd: Joseph K. Bradley User guide for LogisticRegressionSummary

[jira] [Updated] (SPARK-9786) Test backpressure

2015-08-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9786: - Description: 1. Build a test bench for generating different workloads and data with varying

[jira] [Commented] (SPARK-9662) ML 1.5 QA: API: Python API coverage

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700460#comment-14700460 ] Joseph K. Bradley commented on SPARK-9662: -- Perfect, thanks. Also, to confirm:

[jira] [Resolved] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9768. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8061

[jira] [Resolved] (SPARK-8916) Add @since tags to mllib.regression

2015-08-17 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-8916. Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7518

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700526#comment-14700526 ] Sudhakar Thota commented on SPARK-9776: --- Thanks Michael and Eugene for your quick

[jira] [Updated] (SPARK-9906) User guide for LogisticRegressionSummary

2015-08-17 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9906: - Description: SPARK-9112 introduces {{LogisticRegressionSummary}} to provide R-like model

[jira] [Created] (SPARK-10077) Java package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10077: - Summary: Java package doc for spark.ml.feature Key: SPARK-10077 URL: https://issues.apache.org/jira/browse/SPARK-10077 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7808) Scala package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7808: - Summary: Scala package doc for spark.ml.feature (was: Package doc for spark.ml.feature) Scala

[jira] [Created] (SPARK-10076) makes MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10076: --- Summary: makes MultilayerPerceptronClassifier layers and weights public Key: SPARK-10076 URL: https://issues.apache.org/jira/browse/SPARK-10076 Project: Spark

[jira] [Commented] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700688#comment-14700688 ] Apache Spark commented on SPARK-9856: - User 'yu-iskw' has created a pull request for

[jira] [Assigned] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9856: --- Assignee: (was: Apache Spark) Add expression functions into SparkR whose params are

[jira] [Assigned] (SPARK-9856) Add expression functions into SparkR whose params are complicated

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9856: --- Assignee: Apache Spark Add expression functions into SparkR whose params are complicated

[jira] [Commented] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-17 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700357#comment-14700357 ] Meihua Wu commented on SPARK-8520: -- For 1, how about migrate to treeReduce and

[jira] [Commented] (SPARK-9910) User guide for train validation split

2015-08-17 Thread Martin Zapletal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700372#comment-14700372 ] Martin Zapletal commented on SPARK-9910: I noticed 1.5.0 should be closed by now.

[jira] [Resolved] (SPARK-8920) Add @since tags to mllib.linalg

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8920. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7729

[jira] [Updated] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10072: -- Priority: Blocker (was: Major) BlockGenerator can deadlock when the queue block queue of

[jira] [Created] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-10072: - Summary: BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity Key: SPARK-10072 URL: https://issues.apache.org/jira/browse/SPARK-10072

[jira] [Assigned] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10072: Assignee: Apache Spark (was: Tathagata Das) BlockGenerator can deadlock when the queue

[jira] [Commented] (SPARK-10023) Unified DecisionTreeParams checkpointInterval between Scala and Python API.

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700445#comment-14700445 ] Joseph K. Bradley commented on SPARK-10023: --- For this and other JIRAs, could

[jira] [Updated] (SPARK-9550) Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket)

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9550: --- Description: This ticket tracks configurations which need to be renamed, deprecated, or have their

[jira] [Resolved] (SPARK-9974) SBT build: com.twitter:parquet-hadoop-bundle:1.6.0 is not packaged into the assembly jar

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9974. Resolution: Fixed Assignee: Cheng Lian Fix Version/s: 1.5.0 SBT build:

[jira] [Updated] (SPARK-7707) User guide and example code for KernelDensity

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7707: - Shepherd: Xiangrui Meng User guide and example code for KernelDensity

[jira] [Assigned] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10076: Assignee: (was: Apache Spark) make MultilayerPerceptronClassifier layers and weights

[jira] [Commented] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700629#comment-14700629 ] Apache Spark commented on SPARK-10076: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10076: Assignee: Apache Spark make MultilayerPerceptronClassifier layers and weights public

[jira] [Updated] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10076: Summary: make MultilayerPerceptronClassifier layers and weights public (was: makes

[jira] [Updated] (SPARK-10076) make MultilayerPerceptronClassifier layers and weights public

2015-08-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10076: Description: make MultilayerPerceptronClassifier layers and weights public (was: makes

[jira] [Resolved] (SPARK-7808) Scala package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7808. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8260

[jira] [Updated] (SPARK-9898) User guide for PrefixSpan

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9898: - Shepherd: Xiangrui Meng User guide for PrefixSpan -

[jira] [Updated] (SPARK-9654) Add IndexToString in Pyspark

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9654: - Summary: Add IndexToString in Pyspark (was: Add StringIndexer inverse in Pyspark) Add

[jira] [Resolved] (SPARK-10021) Add Python API for ml.feature.IndexToString

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10021. --- Resolution: Duplicate Add Python API for ml.feature.IndexToString

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) Exception not failing Python applications (in yarn cluster

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0 (was: 1.5.1) Exception not failing Python applications (in yarn cluster mode)

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: 1.6.0 Exception not failing Python applications (in yarn cluster mode)

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: (was: 1.6.0) Exception not failing Python applications (in yarn cluster mode)

[jira] [Resolved] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9951. -- Resolution: Duplicate Example code for Multilayer Perceptron Classifier

[jira] [Commented] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700568#comment-14700568 ] Joseph K. Bradley commented on SPARK-9951: -- Just glanced at it. I think that

[jira] [Commented] (SPARK-9888) Update LDA User Guide

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700332#comment-14700332 ] Apache Spark commented on SPARK-9888: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-9888) Update LDA User Guide

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9888: --- Assignee: Apache Spark (was: Feynman Liang) Update LDA User Guide -

[jira] [Assigned] (SPARK-9888) Update LDA User Guide

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9888: --- Assignee: Feynman Liang (was: Apache Spark) Update LDA User Guide -

[jira] [Created] (SPARK-10069) Python's ReduceByKeyAndWindow DStream Keeps Growing

2015-08-17 Thread Asim Jalis (JIRA)
Asim Jalis created SPARK-10069: -- Summary: Python's ReduceByKeyAndWindow DStream Keeps Growing Key: SPARK-10069 URL: https://issues.apache.org/jira/browse/SPARK-10069 Project: Spark Issue Type:

[jira] [Closed] (SPARK-5901) [PySpark] pickle classes in main module

2015-08-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-5901. - Resolution: Invalid Target Version/s: (was: 1.5.0) couldpickle does support to serialize

[jira] [Created] (SPARK-10070) Remove Guava dependencies in user guides

2015-08-17 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-10070: - Summary: Remove Guava dependencies in user guides Key: SPARK-10070 URL: https://issues.apache.org/jira/browse/SPARK-10070 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10072: Assignee: Tathagata Das (was: Apache Spark) BlockGenerator can deadlock when the queue

[jira] [Commented] (SPARK-10072) BlockGenerator can deadlock when the queue block queue of generate blocks fills up to capacity

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700426#comment-14700426 ] Apache Spark commented on SPARK-10072: -- User 'tdas' has created a pull request for

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700451#comment-14700451 ] Apache Spark commented on SPARK-7736: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10074: Assignee: (was: Apache Spark) Include Float in @specialized annotation

[jira] [Commented] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700535#comment-14700535 ] Apache Spark commented on SPARK-10074: -- User 'tedyu' has created a pull request for

[jira] [Assigned] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10074: Assignee: Apache Spark Include Float in @specialized annotation

[jira] [Created] (SPARK-10078) Vector-free L-BFGS

2015-08-17 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10078: - Summary: Vector-free L-BFGS Key: SPARK-10078 URL: https://issues.apache.org/jira/browse/SPARK-10078 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700634#comment-14700634 ] Xiangrui Meng commented on SPARK-8520: -- No, this is for general discussion. I created

[jira] [Updated] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8520: - Issue Type: Brainstorming (was: Improvement) Improve GLM's scalability on number of features

[jira] [Resolved] (SPARK-10059) Broken test: YarnClusterSuite

2015-08-17 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10059. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.5.0 Broken

[jira] [Updated] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9783: --- Sprint: (was: Spark 1.5 doc/QA sprint) Use SqlNewHadoopRDD in JSONRelation to eliminate extra

[jira] [Updated] (SPARK-9783) Use SqlNewHadoopRDD in JSONRelation to eliminate extra refresh() call

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9783: --- Target Version/s: 1.6.0 (was: 1.5.0) Use SqlNewHadoopRDD in JSONRelation to eliminate extra

[jira] [Updated] (SPARK-9205) org.apache.spark.sql.hive.HiveSparkSubmitSuite failing for Scala 2.11

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9205: Target Version/s: 1.6.0 (was: 1.5.0) org.apache.spark.sql.hive.HiveSparkSubmitSuite

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700392#comment-14700392 ] Michael Armbrust commented on SPARK-9776: - The variable is always called

[jira] [Resolved] (SPARK-9902) Add Java and Python examples to user guide for 1-sample KS test

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9902. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8154

[jira] [Closed] (SPARK-10063) Remove DirectParquetOutputCommitter

2015-08-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-10063. --- Resolution: Won't Fix Let's not remove it for now until we have a better alternative. Remove

[jira] [Resolved] (SPARK-9592) Last implemented based on AggregateExpression1 are calculating the values for entire DataFrame partition not on GroupedData partition.

2015-08-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9592. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8172

[jira] [Updated] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10068: -- Assignee: Feynman Liang Add links to sections in MLlib's user guide

[jira] [Updated] (SPARK-10068) Add links to sections in MLlib's user guide

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10068: -- Shepherd: Xiangrui Meng Add links to sections in MLlib's user guide

[jira] [Assigned] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-7808: Assignee: Xiangrui Meng Package doc for spark.ml.feature

[jira] [Resolved] (SPARK-10025) Add Python API for ml.attribute

2015-08-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10025. --- Resolution: Duplicate Add Python API for ml.attribute

[jira] [Assigned] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7808: --- Assignee: Apache Spark (was: Xiangrui Meng) Package doc for spark.ml.feature

[jira] [Assigned] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7808: --- Assignee: Xiangrui Meng (was: Apache Spark) Package doc for spark.ml.feature

[jira] [Commented] (SPARK-7808) Package doc for spark.ml.feature

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700520#comment-14700520 ] Apache Spark commented on SPARK-7808: - User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-10074) Include Float in @specialized annotation

2015-08-17 Thread Ted Yu (JIRA)
Ted Yu created SPARK-10074: -- Summary: Include Float in @specialized annotation Key: SPARK-10074 URL: https://issues.apache.org/jira/browse/SPARK-10074 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-9846) User guide for Multilayer Perceptron Classifier

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9846: --- Assignee: Alexander Ulanov (was: Apache Spark) User guide for Multilayer Perceptron

[jira] [Assigned] (SPARK-9846) User guide for Multilayer Perceptron Classifier

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9846: --- Assignee: Apache Spark (was: Alexander Ulanov) User guide for Multilayer Perceptron

[jira] [Commented] (SPARK-9846) User guide for Multilayer Perceptron Classifier

2015-08-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700564#comment-14700564 ] Apache Spark commented on SPARK-9846: - User 'avulanov' has created a pull request for

[jira] [Commented] (SPARK-9951) Example code for Multilayer Perceptron Classifier

2015-08-17 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700567#comment-14700567 ] Alexander Ulanov commented on SPARK-9951: - I've submitter a PR for the user guide.

  1   2   3   >