[jira] [Updated] (SPARK-6166) Limit number of in flight outbound requests for shuffle fetch

2016-02-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-6166: Description: spark.reducer.maxMbInFlight puts a bound on the in flight data in terms of size. But th

[jira] [Commented] (SPARK-6166) Limit number of in flight outbound requests for shuffle fetch

2016-02-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144148#comment-15144148 ] Shixiong Zhu commented on SPARK-6166: - Sure. Done > Limit number of in flight outboun

[jira] [Commented] (SPARK-6166) Limit number of in flight outbound requests for shuffle fetch

2016-02-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144147#comment-15144147 ] Reynold Xin commented on SPARK-6166: Thanks! > Limit number of in flight outbound re

[jira] [Updated] (SPARK-6166) Limit number of in flight outbound requests for shuffle fetch

2016-02-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-6166: Summary: Limit number of in flight outbound requests for shuffle fetch (was: Add config to limit nu

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-02-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144146#comment-15144146 ] Reynold Xin commented on SPARK-6166: [~zsxwing] can you update the title of this ticke

[jira] [Resolved] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-02-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-6166. - Resolution: Fixed Fix Version/s: 2.0.0 > Add config to limit number of concurrent outbound

[jira] [Updated] (SPARK-13012) Replace example code in ml-guide.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13012: -- Assignee: Devaraj K > Replace example code in ml-guide.md using include_example > -

[jira] [Updated] (SPARK-13012) Replace example code in ml-guide.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13012: -- Shepherd: Xusen Yin > Replace example code in ml-guide.md using include_example > -

[jira] [Updated] (SPARK-13019) Replace example code in mllib-statistics.md using include_example

2016-02-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13019: Description: The example code in the user guide is embedded in the markdown and hence it is not easy to te

[jira] [Updated] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13018: Description: The example code in the user guide is embedded in the markdown and hence it is not easy to te

[jira] [Updated] (SPARK-13017) Replace example code in mllib-feature-extraction.md using include_example

2016-02-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13017: Description: The example code in the user guide is embedded in the markdown and hence it is not easy to te

[jira] [Updated] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13015: Description: The example code in the user guide is embedded in the markdown and hence it is not easy to te

[jira] [Updated] (SPARK-13014) Replace example code in mllib-collaborative-filtering.md using include_example

2016-02-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13014: Description: The example code in the user guide is embedded in the markdown and hence it is not easy to te

[jira] [Updated] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-02-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13013: Description: The example code in the user guide is embedded in the markdown and hence it is not easy to te

[jira] [Updated] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-02-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13013: Description: The example code in the user guide is embedded in the markdown and hence it is not easy to te

[jira] [Updated] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-11 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-13295: -- Description: As also mentioned/marked by TODO in AFTAggregator.AFTAggregator.add(data:

[jira] [Assigned] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13295: Assignee: Apache Spark > ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid cr

[jira] [Assigned] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13295: Assignee: (was: Apache Spark) > ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator

[jira] [Commented] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144067#comment-15144067 ] Apache Spark commented on SPARK-13295: -- User 'NarineK' has created a pull request fo

[jira] [Updated] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-11 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-13295: -- Description: As also mentioned/marked by TODO in AFTAggregator.AFTAggregator.add(data:

[jira] [Created] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-11 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-13295: - Summary: ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record Key: SPARK-13295 URL: https://issues.apa

[jira] [Updated] (SPARK-7889) Jobs progress of apps on complete page of HistoryServer shows uncompleted

2016-02-11 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-7889: Assignee: Steve Loughran > Jobs progress of apps on complete page of HistoryServer shows uncompleted

[jira] [Resolved] (SPARK-7889) Jobs progress of apps on complete page of HistoryServer shows uncompleted

2016-02-11 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-7889. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 8 [https://github

[jira] [Assigned] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-13097: - Assignee: Xiangrui Meng > Extend Binarizer to allow Double AND Vector inputs > -

[jira] [Updated] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13097: -- Assignee: Mike Seddon (was: Xiangrui Meng) > Extend Binarizer to allow Double AND Vector input

[jira] [Updated] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13097: -- Shepherd: Xiangrui Meng (was: Liang-Chi Hsieh) > Extend Binarizer to allow Double AND Vector i

[jira] [Updated] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13097: -- Target Version/s: 2.0.0 > Extend Binarizer to allow Double AND Vector inputs >

[jira] [Resolved] (SPARK-13153) PySpark ML persistence failed when handle no default value parameter

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13153. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Resolved] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12746. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10697 [https://g

[jira] [Resolved] (SPARK-12915) SQL metrics for generated operators

2016-02-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12915. - Resolution: Fixed Fix Version/s: 2.0.0 > SQL metrics for generated operators > ---

[jira] [Updated] (SPARK-12375) VectorIndexer: allow unknown categories

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12375: -- Assignee: yuhao yang (was: Apache Spark) > VectorIndexer: allow unknown categories > -

[jira] [Updated] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12746: -- Shepherd: Xiangrui Meng > ArrayType(_, true) should also accept ArrayType(_, false) > -

[jira] [Updated] (SPARK-11940) Python API for ml.clustering.LDA

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11940: -- Shepherd: Yanbo Liang > Python API for ml.clustering.LDA > > >

[jira] [Updated] (SPARK-11940) Python API for ml.clustering.LDA

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11940: -- Assignee: Jeff Zhang > Python API for ml.clustering.LDA > > >

[jira] [Updated] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12765: -- Target Version/s: 2.0.0 > CountVectorizerModel.transform lost the transformSchema > ---

[jira] [Updated] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12765: -- Assignee: sloth > CountVectorizerModel.transform lost the transformSchema > ---

[jira] [Resolved] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12765. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10720 [https://g

[jira] [Updated] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12746: -- Assignee: Earthson Lu > ArrayType(_, true) should also accept ArrayType(_, false) > ---

[jira] [Updated] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12746: -- Target Version/s: 1.6.1, 2.0.0 > ArrayType(_, true) should also accept ArrayType(_, false) > --

[jira] [Assigned] (SPARK-13294) Don't build assembly in dev/run-tests

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13294: Assignee: (was: Apache Spark) > Don't build assembly in dev/run-tests > --

[jira] [Commented] (SPARK-13294) Don't build assembly in dev/run-tests

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143846#comment-15143846 ] Apache Spark commented on SPARK-13294: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-13294) Don't build assembly in dev/run-tests

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13294: Assignee: Apache Spark > Don't build assembly in dev/run-tests > -

[jira] [Created] (SPARK-13294) Don't build assembly in dev/run-tests

2016-02-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-13294: -- Summary: Don't build assembly in dev/run-tests Key: SPARK-13294 URL: https://issues.apache.org/jira/browse/SPARK-13294 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13033) PySpark ml.regression support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13033: -- Shepherd: Yanbo Liang Target Version/s: 2.0.0 > PySpark ml.regression support expor

[jira] [Updated] (SPARK-13033) PySpark ml.regression support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13033: -- Assignee: Tommy Yu > PySpark ml.regression support export/import >

[jira] [Updated] (SPARK-13153) PySpark ML persistence failed when handle no default value parameter

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13153: -- Shepherd: Yanbo Liang Target Version/s: 1.6.1, 2.0.0 > PySpark ML persistence faile

[jira] [Updated] (SPARK-13153) PySpark ML persistence failed when handle no default value parameter

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13153: -- Assignee: Tommy Yu > PySpark ML persistence failed when handle no default value parameter > ---

[jira] [Updated] (SPARK-13011) K-means wrapper in SparkR

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13011: -- Shepherd: Xiangrui Meng > K-means wrapper in SparkR > - > >

[jira] [Assigned] (SPARK-13293) Generate code for Expand

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13293: Assignee: Davies Liu (was: Apache Spark) > Generate code for Expand > ---

[jira] [Commented] (SPARK-13293) Generate code for Expand

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143802#comment-15143802 ] Apache Spark commented on SPARK-13293: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-13293) Generate code for Expand

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13293: Assignee: Apache Spark (was: Davies Liu) > Generate code for Expand > ---

[jira] [Resolved] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13047. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-12949) Support common expression elimination

2016-02-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143787#comment-15143787 ] Davies Liu commented on SPARK-12949: After some prototype, enable common expression e

[jira] [Created] (SPARK-13293) Generate code for Expand

2016-02-11 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13293: -- Summary: Generate code for Expand Key: SPARK-13293 URL: https://issues.apache.org/jira/browse/SPARK-13293 Project: Spark Issue Type: Improvement Compon

[jira] [Commented] (SPARK-13069) ActorHelper is not throttled by rate limiter

2016-02-11 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143768#comment-15143768 ] Lin Zhao commented on SPARK-13069: -- [~zsxwing] I created the PR, please review at your c

[jira] [Commented] (SPARK-13069) ActorHelper is not throttled by rate limiter

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143760#comment-15143760 ] Apache Spark commented on SPARK-13069: -- User 'lin-zhao' has created a pull request f

[jira] [Assigned] (SPARK-13069) ActorHelper is not throttled by rate limiter

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13069: Assignee: (was: Apache Spark) > ActorHelper is not throttled by rate limiter > ---

[jira] [Assigned] (SPARK-13069) ActorHelper is not throttled by rate limiter

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13069: Assignee: Apache Spark > ActorHelper is not throttled by rate limiter > --

[jira] [Updated] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7483: - Shepherd: Sean Owen > [MLLib] Using Kryo with FPGrowth fails with an exception > -

[jira] [Updated] (SPARK-13035) PySpark ml.clustering support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13035: -- Assignee: Yanbo Liang > PySpark ml.clustering support export/import > -

[jira] [Resolved] (SPARK-13035) PySpark ml.clustering support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13035. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10999 [https://g

[jira] [Updated] (SPARK-13035) PySpark ml.clustering support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13035: -- Target Version/s: 2.0.0 > PySpark ml.clustering support export/import > ---

[jira] [Updated] (SPARK-13037) PySpark ml.recommendation support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13037: -- Target Version/s: 2.0.0 > PySpark ml.recommendation support export/import > ---

[jira] [Resolved] (SPARK-13037) PySpark ml.recommendation support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13037. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11044 [https://g

[jira] [Updated] (SPARK-13037) PySpark ml.recommendation support export/import

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13037: -- Assignee: Kai Jiang > PySpark ml.recommendation support export/import > ---

[jira] [Updated] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13047: -- Target Version/s: 1.6.1, 2.0.0 (was: 1.6.1) > Pyspark Params.hasParam should not throw an erro

[jira] [Updated] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13047: -- Assignee: Seth Hendrickson > Pyspark Params.hasParam should not throw an error > --

[jira] [Updated] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13047: -- Target Version/s: 1.6.1 > Pyspark Params.hasParam should not throw an error > -

[jira] [Updated] (SPARK-13019) Replace example code in mllib-statistics.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13019: -- Shepherd: Xusen Yin > Replace example code in mllib-statistics.md using include_example > -

[jira] [Updated] (SPARK-13019) Replace example code in mllib-statistics.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13019: -- Assignee: Xin Ren > Replace example code in mllib-statistics.md using include_example > ---

[jira] [Updated] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13013: -- Assignee: Xin Ren > Replace example code in mllib-clustering.md using include_example > ---

[jira] [Updated] (SPARK-13013) Replace example code in mllib-clustering.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13013: -- Shepherd: Xusen Yin > Replace example code in mllib-clustering.md using include_example > -

[jira] [Updated] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13015: -- Assignee: Xin Ren > Replace example code in mllib-data-types.md using include_example > ---

[jira] [Updated] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13018: -- Assignee: Xin Ren > Replace example code in mllib-pmml-model-export.md using include_example >

[jira] [Updated] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13018: -- Shepherd: Xusen Yin (was: Xusen Yin) > Replace example code in mllib-pmml-model-export.md usin

[jira] [Updated] (SPARK-13014) Replace example code in mllib-collaborative-filtering.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13014: -- Assignee: Xin Ren > Replace example code in mllib-collaborative-filtering.md using include_exam

[jira] [Updated] (SPARK-13015) Replace example code in mllib-data-types.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13015: -- Shepherd: Xusen Yin > Replace example code in mllib-data-types.md using include_example > -

[jira] [Updated] (SPARK-13018) Replace example code in mllib-pmml-model-export.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13018: -- Shepherd: Xusen Yin > Replace example code in mllib-pmml-model-export.md using include_example

[jira] [Updated] (SPARK-13014) Replace example code in mllib-collaborative-filtering.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13014: -- Shepherd: Xusen Yin > Replace example code in mllib-collaborative-filtering.md using include_ex

[jira] [Updated] (SPARK-13016) Replace example code in mllib-dimensionality-reduction.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13016: -- Assignee: Devaraj K > Replace example code in mllib-dimensionality-reduction.md using > includ

[jira] [Updated] (SPARK-13016) Replace example code in mllib-dimensionality-reduction.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13016: -- Shepherd: Xusen Yin > Replace example code in mllib-dimensionality-reduction.md using > includ

[jira] [Updated] (SPARK-13017) Replace example code in mllib-feature-extraction.md using include_example

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13017: -- Shepherd: Xusen Yin Assignee: Xin Ren > Replace example code in mllib-feature-extraction.md

[jira] [Updated] (SPARK-13292) QuantileDiscretizer should take random seed in PySpark

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13292: -- Description: SPARK-11515 for the Python API. > QuantileDiscretizer should take random seed in P

[jira] [Created] (SPARK-13292) QuantileDiscretizer should take random seed in PySpark

2016-02-11 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-13292: - Summary: QuantileDiscretizer should take random seed in PySpark Key: SPARK-13292 URL: https://issues.apache.org/jira/browse/SPARK-13292 Project: Spark Issu

[jira] [Updated] (SPARK-11515) QuantileDiscretizer should take random seed

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11515: -- Target Version/s: 2.0.0 > QuantileDiscretizer should take random seed > ---

[jira] [Updated] (SPARK-11515) QuantileDiscretizer should take random seed

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11515: -- Assignee: Yu Ishikawa > QuantileDiscretizer should take random seed > -

[jira] [Resolved] (SPARK-11515) QuantileDiscretizer should take random seed

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11515. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9535 [https://gi

[jira] [Resolved] (SPARK-13265) Refactoring of basic ML import/export for other file system besides HDFS

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13265. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-13265) Refactoring of basic ML import/export for other file system besides HDFS

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13265: -- Assignee: Yu Ishikawa > Refactoring of basic ML import/export for other file system besides HDF

[jira] [Updated] (SPARK-13265) Refactoring of basic ML import/export for other file system besides HDFS

2016-02-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13265: -- Target Version/s: 1.6.1, 2.0.0 > Refactoring of basic ML import/export for other file system be

[jira] [Commented] (SPARK-13279) Scheduler does O(N^2) operation when adding a new task set (making it prohibitively slow for scheduling 200K tasks)

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143629#comment-15143629 ] Apache Spark commented on SPARK-13279: -- User 'sitalkedia' has created a pull request

[jira] [Commented] (SPARK-13277) ANTLR ignores other rule using the USING keyword

2016-02-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143571#comment-15143571 ] Apache Spark commented on SPARK-13277: -- User 'hvanhovell' has created a pull request

[jira] [Created] (SPARK-13291) Numerical models should preserve label attributes

2016-02-11 Thread Piotr Smolinski (JIRA)
Piotr Smolinski created SPARK-13291: --- Summary: Numerical models should preserve label attributes Key: SPARK-13291 URL: https://issues.apache.org/jira/browse/SPARK-13291 Project: Spark Issue

[jira] [Created] (SPARK-13290) wholeTextFile and binaryFiles are really slow

2016-02-11 Thread mathieu longtin (JIRA)
mathieu longtin created SPARK-13290: --- Summary: wholeTextFile and binaryFiles are really slow Key: SPARK-13290 URL: https://issues.apache.org/jira/browse/SPARK-13290 Project: Spark Issue Typ

[jira] [Comment Edited] (SPARK-8162) Run spark-shell cause NullPointerException

2016-02-11 Thread Matthew Campbell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143513#comment-15143513 ] Matthew Campbell edited comment on SPARK-8162 at 2/11/16 9:14 PM: --

[jira] [Commented] (SPARK-8162) Run spark-shell cause NullPointerException

2016-02-11 Thread Matthew Campbell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143513#comment-15143513 ] Matthew Campbell commented on SPARK-8162: - I'm also running into this problem with

[jira] [Created] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-11 Thread Qi Dai (JIRA)
Qi Dai created SPARK-13289: -- Summary: Word2Vec generate infinite distances when numIterations>5 Key: SPARK-13289 URL: https://issues.apache.org/jira/browse/SPARK-13289 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-02-11 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13288: -- Summary: [1.6.0] Memory leak in Spark streaming Key: SPARK-13288 URL: https://issues.apache.org/jira/browse/SPARK-13288 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13287) Standalone REST API throttling?

2016-02-11 Thread Rares Vernica (JIRA)
Rares Vernica created SPARK-13287: - Summary: Standalone REST API throttling? Key: SPARK-13287 URL: https://issues.apache.org/jira/browse/SPARK-13287 Project: Spark Issue Type: Bug C

[jira] [Resolved] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-02-11 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-12982. --- Resolution: Resolved Assignee: Jayadevan M Fix Version/s: 2.0.0 > SQL

  1   2   >