[jira] [Created] (SPARK-9926) Parallelize file listing for partitioned Hive table

2015-08-12 Thread Cheolsoo Park (JIRA)
Cheolsoo Park created SPARK-9926: Summary: Parallelize file listing for partitioned Hive table Key: SPARK-9926 URL: https://issues.apache.org/jira/browse/SPARK-9926 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9658) ML 1.5 QA: API: Binary incompatible changes

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694529#comment-14694529 ] Joseph K. Bradley commented on SPARK-9658: -- The only remaining item is (3) + runn

[jira] [Updated] (SPARK-9855) Add expression functions into SparkR whose params are simple

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9855: - Assignee: Yu Ishikawa > Add expression functions into SparkR whose params are simp

[jira] [Resolved] (SPARK-9855) Add expression functions into SparkR whose params are simple

2015-08-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9855. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 812

[jira] [Updated] (SPARK-8744) StringIndexerModel should have public constructor

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8744: - Target Version/s: 1.6.0 (was: 1.5.0) > StringIndexerModel should have public constructor

[jira] [Updated] (SPARK-8744) StringIndexerModel should have public constructor

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8744: - Assignee: holdenk > StringIndexerModel should have public constructor > --

[jira] [Updated] (SPARK-8531) Update ML user guide for MinMaxScaler

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8531: - Issue Type: Documentation (was: Improvement) > Update ML user guide for MinMaxScaler > --

[jira] [Updated] (SPARK-8472) Python API for DCT

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8472: - Target Version/s: 1.6.0 (was: 1.5.0) > Python API for DCT > -- > >

[jira] [Updated] (SPARK-8473) Documentation for DCT

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8473: - Assignee: Feynman Liang > Documentation for DCT > - > >

[jira] [Updated] (SPARK-8473) Documentation for DCT

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8473: - Issue Type: Documentation (was: New Feature) > Documentation for DCT > --

[jira] [Updated] (SPARK-6723) Model import/export for ChiSqSelector

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6723: - Target Version/s: 1.6.0 (was: 1.5.0) > Model import/export for ChiSqSelector > --

[jira] [Commented] (SPARK-6723) Model import/export for ChiSqSelector

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694523#comment-14694523 ] Joseph K. Bradley commented on SPARK-6723: -- Sorry we weren't able to get to this

[jira] [Updated] (SPARK-7675) PySpark spark.ml Params type conversions

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7675: - Target Version/s: 1.6.0 (was: 1.5.0) > PySpark spark.ml Params type conversions > ---

[jira] [Commented] (SPARK-9120) Add multivariate regression (or prediction) interface

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694516#comment-14694516 ] Joseph K. Bradley commented on SPARK-9120: -- We can set a new target version as ne

[jira] [Updated] (SPARK-9120) Add multivariate regression (or prediction) interface

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9120: - Target Version/s: (was: 1.5.0) > Add multivariate regression (or prediction) interface >

[jira] [Updated] (SPARK-8467) Add LDAModel.describeTopics() in Python

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8467: - Target Version/s: 1.6.0 (was: 1.5.0) > Add LDAModel.describeTopics() in Python >

[jira] [Updated] (SPARK-8767) Abstractions for InputColParam, OutputColParam

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8767: - Target Version/s: 1.6.0 (was: 1.5.0) > Abstractions for InputColParam, OutputColParam > -

[jira] [Updated] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9245: - Target Version/s: 1.6.0 (was: 1.5.0) > DistributedLDAModel predict top topic per doc-term

[jira] [Commented] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694515#comment-14694515 ] Joseph K. Bradley commented on SPARK-9245: -- Yes, that's correct. > DistributedLD

[jira] [Updated] (SPARK-9134) LDA Asymmetric topic-word prior

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9134: - Target Version/s: (was: 1.5.0) > LDA Asymmetric topic-word prior > -

[jira] [Commented] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694512#comment-14694512 ] Joseph K. Bradley commented on SPARK-6823: -- Removing target version. Feel free t

[jira] [Updated] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6823: - Target Version/s: (was: 1.5.0) > Add a model.matrix like capability to DataFrames (model

[jira] [Updated] (SPARK-5565) LDA wrapper for spark.ml package

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5565: - Target Version/s: 1.6.0 (was: 1.5.0) > LDA wrapper for spark.ml package > ---

[jira] [Updated] (SPARK-7434) DSL for Pipeline assembly

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7434: - Target Version/s: (was: 1.5.0) > DSL for Pipeline assembly > - >

[jira] [Commented] (SPARK-1655) In naive Bayes, store conditional probabilities distributively.

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694510#comment-14694510 ] Joseph K. Bradley commented on SPARK-1655: -- Mind if I change the target version t

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-08-12 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694499#comment-14694499 ] Koert Kuipers commented on SPARK-3655: -- i assume you want to do some analysis on the

[jira] [Commented] (SPARK-9890) User guide for CountVectorizer

2015-08-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694491#comment-14694491 ] yuhao yang commented on SPARK-9890: --- [~josephkb] Currently we have the transfomer (model

[jira] [Commented] (SPARK-9901) User guide for RowMatrix Tall-and-skinny QR

2015-08-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694485#comment-14694485 ] yuhao yang commented on SPARK-9901: --- mllib-data-types#rowmatrix does not list methods in

[jira] [Assigned] (SPARK-9925) Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9925: --- Assignee: Apache Spark (was: Yin Huai) > Set SQLConf.SHUFFLE_PARTITIONS.key correctly for te

[jira] [Assigned] (SPARK-9925) Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9925: --- Assignee: Yin Huai (was: Apache Spark) > Set SQLConf.SHUFFLE_PARTITIONS.key correctly for te

[jira] [Commented] (SPARK-9925) Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694482#comment-14694482 ] Apache Spark commented on SPARK-9925: - User 'yhuai' has created a pull request for thi

[jira] [Updated] (SPARK-9724) Avoid unnecessary redirects in the Spark Web UI

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-9724: -- Assignee: Rohit Agarwal Priority: Minor (was: Major) Fix Version/s: 1.6.0 > A

[jira] [Commented] (SPARK-9902) Add Java and Python examples to user guide for 1-sample KS test

2015-08-12 Thread Jose Cambronero (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694478#comment-14694478 ] Jose Cambronero commented on SPARK-9902: [~fliang] linked to github PR (https://gi

[jira] [Resolved] (SPARK-9826) Cannot use custom classes in log4j.properties

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9826. --- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 > Cannot use custom cla

[jira] [Created] (SPARK-9925) Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

2015-08-12 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9925: --- Summary: Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests Key: SPARK-9925 URL: https://issues.apache.org/jira/browse/SPARK-9925 Project: Spark Issue Type: Sub-ta

[jira] [Commented] (SPARK-9890) User guide for CountVectorizer

2015-08-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694463#comment-14694463 ] yuhao yang commented on SPARK-9890: --- Thanks. I'll start working on this. > User guide f

[jira] [Commented] (SPARK-9901) User guide for RowMatrix Tall-and-skinny QR

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694459#comment-14694459 ] Feynman Liang commented on SPARK-9901: -- [~mengxr] please assign > User guide for Row

[jira] [Commented] (SPARK-9901) User guide for RowMatrix Tall-and-skinny QR

2015-08-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694458#comment-14694458 ] yuhao yang commented on SPARK-9901: --- Thanks for helping create the item. I'd like to tak

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-8167: -- Target Version/s: (was: 1.5.0) Fix Version/s: 1.6.0 Sorry, reviewing your PR is on my l

[jira] [Assigned] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9924: --- Assignee: Apache Spark > checkForLogs and cleanLogs are scheduled at fixed rate and can get p

[jira] [Assigned] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9924: --- Assignee: (was: Apache Spark) > checkForLogs and cleanLogs are scheduled at fixed rate an

[jira] [Commented] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694450#comment-14694450 ] Apache Spark commented on SPARK-9924: - User 'mindprince' has created a pull request fo

[jira] [Created] (SPARK-9924) checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up

2015-08-12 Thread Rohit Agarwal (JIRA)
Rohit Agarwal created SPARK-9924: Summary: checkForLogs and cleanLogs are scheduled at fixed rate and can get piled up Key: SPARK-9924 URL: https://issues.apache.org/jira/browse/SPARK-9924 Project: Sp

[jira] [Updated] (SPARK-8617) Handle history files better

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-8617: -- Target Version/s: (was: 1.5.0) > Handle history files better > --- > >

[jira] [Updated] (SPARK-6280) Remove Akka systemName from Spark

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-6280: -- Target Version/s: 1.6.0 (was: 1.5.0) > Remove Akka systemName from Spark >

[jira] [Created] (SPARK-9923) ShuffleMapStage.numAvailableOutputs should be an Int instead of Long

2015-08-12 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-9923: Summary: ShuffleMapStage.numAvailableOutputs should be an Int instead of Long Key: SPARK-9923 URL: https://issues.apache.org/jira/browse/SPARK-9923 Project: Spark

[jira] [Updated] (SPARK-9923) ShuffleMapStage.numAvailableOutputs should be an Int instead of Long

2015-08-12 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-9923: - Labels: Starter (was: ) > ShuffleMapStage.numAvailableOutputs should be an Int instead of Long >

[jira] [Resolved] (SPARK-9449) inputFiles misses files from MetastoreRelation

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9449. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8119 [https:/

[jira] [Resolved] (SPARK-9915) StopWordsRemover.stopWords should use StringArrayParam

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9915. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8141 [https://githu

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-7736: -- Target Version/s: 1.5.1 (was: 1.5.0) > Exception not failing Python applications (in yarn clust

[jira] [Resolved] (SPARK-9912) QRDecomposition should use QType and RType for type names instead of UType and VType

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9912. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8140 [https://githu

[jira] [Updated] (SPARK-9826) Cannot use custom classes in log4j.properties

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-9826: -- Target Version/s: 1.4.2, 1.5.0 Labels: regression (was: ) > Cannot use custom cla

[jira] [Updated] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9909: - Assignee: holdenk > Move weightCol to sharedParams > -- > >

[jira] [Updated] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9909: - Target Version/s: 1.5.0 > Move weightCol to sharedParams > -- > >

[jira] [Resolved] (SPARK-9909) Move weightCol to sharedParams

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9909. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8144 [https://githu

[jira] [Resolved] (SPARK-9913) LDAUtils should be private

2015-08-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9913. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8142 [https://githu

[jira] [Resolved] (SPARK-9894) Writing of JSON files with MapType is broken

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9894. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8137 [https:/

[jira] [Assigned] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9922: --- Assignee: Xiangrui Meng (was: Apache Spark) > Rename StringIndexerInverse to IndexToString >

[jira] [Commented] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694414#comment-14694414 ] Apache Spark commented on SPARK-9922: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9922: --- Assignee: Apache Spark (was: Xiangrui Meng) > Rename StringIndexerInverse to IndexToString >

[jira] [Commented] (SPARK-7707) User guide and example code for Statistics.kernelDensity

2015-08-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694413#comment-14694413 ] Sandy Ryza commented on SPARK-7707: --- Again, sorry for the long delay here. I'm travelin

[jira] [Assigned] (SPARK-9832) TPCDS Q98 Fails

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9832: --- Assignee: Apache Spark (was: Davies Liu) > TPCDS Q98 Fails > --- > >

[jira] [Assigned] (SPARK-9832) TPCDS Q98 Fails

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9832: --- Assignee: Davies Liu (was: Apache Spark) > TPCDS Q98 Fails > --- > >

[jira] [Commented] (SPARK-9832) TPCDS Q98 Fails

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694410#comment-14694410 ] Apache Spark commented on SPARK-9832: - User 'davies' has created a pull request for th

[jira] [Created] (SPARK-9922) Rename StringIndexerInverse to IndexToString

2015-08-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9922: Summary: Rename StringIndexerInverse to IndexToString Key: SPARK-9922 URL: https://issues.apache.org/jira/browse/SPARK-9922 Project: Spark Issue Type: Improv

[jira] [Assigned] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9920: --- Assignee: Apache Spark (was: Yin Huai) > The simpleString of TungstenAggregate does not show

[jira] [Commented] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694403#comment-14694403 ] Apache Spark commented on SPARK-9920: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9920: --- Assignee: Yin Huai (was: Apache Spark) > The simpleString of TungstenAggregate does not show

[jira] [Created] (SPARK-9921) Too many open files in Spark SQL

2015-08-12 Thread Antonio Piccolboni (JIRA)
Antonio Piccolboni created SPARK-9921: - Summary: Too many open files in Spark SQL Key: SPARK-9921 URL: https://issues.apache.org/jira/browse/SPARK-9921 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9920) The simpleString of TungstenAggregate does not show its output

2015-08-12 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9920: --- Summary: The simpleString of TungstenAggregate does not show its output Key: SPARK-9920 URL: https://issues.apache.org/jira/browse/SPARK-9920 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-9092) Make --num-executors compatible with dynamic allocation

2015-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-9092. --- Resolution: Fixed Fix Version/s: 1.5.0 > Make --num-executors compatible with dynamic a

[jira] [Resolved] (SPARK-9707) Test sort-based fallback mode for dynamic partition insert

2015-08-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9707. - Resolution: Fixed I ran a test using a medium sized table in TPCDS SF=1500 both with a low

[jira] [Assigned] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9908: --- Assignee: Apache Spark (was: Yin Huai) > TPCDS Q98 failed when tungsten is off > ---

[jira] [Assigned] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9908: --- Assignee: Yin Huai (was: Apache Spark) > TPCDS Q98 failed when tungsten is off > ---

[jira] [Commented] (SPARK-9908) TPCDS Q98 failed when tungsten is off

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694382#comment-14694382 ] Apache Spark commented on SPARK-9908: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694372#comment-14694372 ] Feynman Liang commented on SPARK-9895: -- [~mengxr] please assign > User Guide for RFo

[jira] [Commented] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-12 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694371#comment-14694371 ] Eric Liang commented on SPARK-9895: --- Sure, I can take this task. > User Guide for RForm

[jira] [Commented] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694365#comment-14694365 ] Joseph K. Bradley commented on SPARK-9918: -- I like this idea. "runs" seems like

[jira] [Closed] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-9897. Resolution: Duplicate > User Guide for Multilayer Perceptron Classifier > --

[jira] [Commented] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694361#comment-14694361 ] Feynman Liang commented on SPARK-9897: -- Yep, thanks for pointing that out! > User Gu

[jira] [Issue Comment Deleted] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-9897: Comment: was deleted (was: We already have an issue for MLP classifier docs: https://issues

[jira] [Commented] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694355#comment-14694355 ] Alexander Ulanov commented on SPARK-9897: - We already have an issue for MLP classi

[jira] [Commented] (SPARK-9897) User Guide for Multilayer Perceptron Classifier

2015-08-12 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694356#comment-14694356 ] Alexander Ulanov commented on SPARK-9897: - We already have an issue for MLP classi

[jira] [Commented] (SPARK-3655) Support sorting of values in addition to keys (i.e. secondary sort)

2015-08-12 Thread SWETHARAM KASIREDDI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694353#comment-14694353 ] SWETHARAM KASIREDDI commented on SPARK-3655: [~koert] Could you please provid

[jira] [Assigned] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9918: --- Assignee: Apache Spark (was: Xiangrui Meng) > Remove runs from KMeans under the pipeline API

[jira] [Assigned] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9918: --- Assignee: Xiangrui Meng (was: Apache Spark) > Remove runs from KMeans under the pipeline API

[jira] [Commented] (SPARK-9918) Remove runs from KMeans under the pipeline API

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694352#comment-14694352 ] Apache Spark commented on SPARK-9918: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694342#comment-14694342 ] Feynman Liang commented on SPARK-9660: -- Makes sense, resolving this issue. > ML 1.5

[jira] [Resolved] (SPARK-9660) ML 1.5 QA: API: New Scala APIs, docs

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang resolved SPARK-9660. -- Resolution: Fixed > ML 1.5 QA: API: New Scala APIs, docs >

[jira] [Assigned] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9916: --- Assignee: Apache Spark > Clear leftover sparkr.zip copies and creations (e.g. make-distributi

[jira] [Assigned] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9916: --- Assignee: (was: Apache Spark) > Clear leftover sparkr.zip copies and creations (e.g. make

[jira] [Commented] (SPARK-9916) Clear leftover sparkr.zip copies and creations (e.g. make-distribution.sh)

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694337#comment-14694337 ] Apache Spark commented on SPARK-9916: - User 'brkyvz' has created a pull request for th

[jira] [Updated] (SPARK-9919) Matrices should respect Java's equals and hashCode contract

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9919: - Target Version/s: 1.5.0 Description: The contract for Java's Object is that a.equals(b) i

[jira] [Created] (SPARK-9919) Matrices should respect Java's equals and hashCode contract

2015-08-12 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9919: Summary: Matrices should respect Java's equals and hashCode contract Key: SPARK-9919 URL: https://issues.apache.org/jira/browse/SPARK-9919 Project: Spark Is

[jira] [Updated] (SPARK-9919) Matrices should respect Java's equals and hashCode contract

2015-08-12 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-9919: - Component/s: MLlib > Matrices should respect Java's equals and hashCode contract > ---

[jira] [Assigned] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9843: --- Assignee: Apache Spark > Catalyst: Allow adding custom optimizers > -

[jira] [Commented] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694331#comment-14694331 ] Apache Spark commented on SPARK-9843: - User 'robert3005' has created a pull request fo

[jira] [Assigned] (SPARK-9843) Catalyst: Allow adding custom optimizers

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9843: --- Assignee: (was: Apache Spark) > Catalyst: Allow adding custom optimizers > --

[jira] [Assigned] (SPARK-9917) MinMaxScaler missing getters and docs

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9917: --- Assignee: Apache Spark (was: Xiangrui Meng) > MinMaxScaler missing getters and docs > --

[jira] [Assigned] (SPARK-9917) MinMaxScaler missing getters and docs

2015-08-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9917: --- Assignee: Xiangrui Meng (was: Apache Spark) > MinMaxScaler missing getters and docs > --

<    1   2   3   4   5   >