[jira] [Commented] (SPARK-10951) Support private S3 repositories using spark-submit via --repositories flag

[ https://issues.apache.org/jira/browse/SPARK-10951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083841#comment-15083841 ] Josh Rosen commented on SPARK-10951: This missed the boat for 1.6 but feel free to submit a PR for

[jira] [Resolved] (SPARK-6724) Model import/export for FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6724. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: (was: )

[jira] [Commented] (SPARK-12656) Rewrite Intersect phyiscal plan using semi-join

[ https://issues.apache.org/jira/browse/SPARK-12656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083858#comment-15083858 ] Reynold Xin commented on SPARK-12656: - cc [~smilegator] one more thing for you to pick up if you are

[jira] [Created] (SPARK-12656) Rewrite Intersect phyiscal plan using semi-join

Reynold Xin created SPARK-12656: --- Summary: Rewrite Intersect phyiscal plan using semi-join Key: SPARK-12656 URL: https://issues.apache.org/jira/browse/SPARK-12656 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-12636) Expose API on UnsafeRowRecordReader to just run on files

[ https://issues.apache.org/jira/browse/SPARK-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12636. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10581

[jira] [Commented] (SPARK-10570) Add Spark version endpoint to standalone JSON API

[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083899#comment-15083899 ] Josh Rosen commented on SPARK-10570: +1; I'd like this feature as well. > Add Spark version endpoint

[jira] [Created] (SPARK-12658) Revert SPARK-12511

Shixiong Zhu created SPARK-12658: Summary: Revert SPARK-12511 Key: SPARK-12658 URL: https://issues.apache.org/jira/browse/SPARK-12658 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-7084) Improve the saveAsTable documentation

[ https://issues.apache.org/jira/browse/SPARK-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7084. --- Resolution: Fixed Assignee: madhukara phatak Fix Version/s: 1.5.0

[jira] [Updated] (SPARK-12663) More informative error message in MLUtils.loadLibSVMFile

[ https://issues.apache.org/jira/browse/SPARK-12663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Dodier updated SPARK-12663: -- Description: MLUtils.loadLibSVMFile requires that indices be strictly increasing and it prints

[jira] [Commented] (SPARK-12663) More informative error message in MLUtils.loadLibSVMFile

[ https://issues.apache.org/jira/browse/SPARK-12663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084472#comment-15084472 ] Apache Spark commented on SPARK-12663: -- User 'robert-dodier' has created a pull request for this

[jira] [Assigned] (SPARK-12663) More informative error message in MLUtils.loadLibSVMFile

[ https://issues.apache.org/jira/browse/SPARK-12663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12663: Assignee: (was: Apache Spark) > More informative error message in

[jira] [Assigned] (SPARK-12663) More informative error message in MLUtils.loadLibSVMFile

[ https://issues.apache.org/jira/browse/SPARK-12663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12663: Assignee: Apache Spark > More informative error message in MLUtils.loadLibSVMFile >

[jira] [Created] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

Robert Dodier created SPARK-12664: - Summary: Expose raw prediction scores in MultilayerPerceptronClassificationModel Key: SPARK-12664 URL: https://issues.apache.org/jira/browse/SPARK-12664 Project:

[jira] [Commented] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084497#comment-15084497 ] Saisai Shao commented on SPARK-12650: - [~vines], what is your meaning of "SparkSubmit does not Xmx

[jira] [Updated] (SPARK-12662) Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition

[ https://issues.apache.org/jira/browse/SPARK-12662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12662: - Assignee: Sameer Agarwal > Add document to randomSplit to explain the sampling depends on the ordering

[jira] [Created] (SPARK-12662) Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition

Yin Huai created SPARK-12662: Summary: Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition Key: SPARK-12662 URL: https://issues.apache.org/jira/browse/SPARK-12662

[jira] [Commented] (SPARK-12662) Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition

[ https://issues.apache.org/jira/browse/SPARK-12662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084109#comment-15084109 ] Reynold Xin commented on SPARK-12662: - Seems like that should be the user 's choice? We can improve

[jira] [Commented] (SPARK-12662) Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition

[ https://issues.apache.org/jira/browse/SPARK-12662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084106#comment-15084106 ] Yin Huai commented on SPARK-12662: -- Another option is to always add local sort operator to make sure the

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084412#comment-15084412 ] Shixiong Zhu commented on SPARK-12591: -- Ah,

[jira] [Comment Edited] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084412#comment-15084412 ] Shixiong Zhu edited comment on SPARK-12591 at 1/6/16 12:11 AM: --- Ah,

[jira] [Comment Edited] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084412#comment-15084412 ] Shixiong Zhu edited comment on SPARK-12591 at 1/6/16 12:11 AM: --- Ah,

[jira] [Commented] (SPARK-11798) Datanucleus jars is missing under lib_managed/jars

[ https://issues.apache.org/jira/browse/SPARK-11798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084423#comment-15084423 ] Jeff Zhang commented on SPARK-11798: Yes, I am sure enabled that flag. The weird thing is that I make

[jira] [Commented] (SPARK-12662) Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition

[ https://issues.apache.org/jira/browse/SPARK-12662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084429#comment-15084429 ] Yin Huai commented on SPARK-12662: -- OK. Let's use this jira to track the work of adding document. > Add

[jira] [Commented] (SPARK-12627) Remove SparkContext preferred locations constructor

[ https://issues.apache.org/jira/browse/SPARK-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084438#comment-15084438 ] Andrew Or commented on SPARK-12627: --- Resolved through https://github.com/apache/spark/pull/10569/files

[jira] [Resolved] (SPARK-12627) Remove SparkContext preferred locations constructor

[ https://issues.apache.org/jira/browse/SPARK-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12627. --- Resolution: Fixed Assignee: Reynold Xin (was: Andrew Or) Fix Version/s: 2.0.0 >

[jira] [Assigned] (SPARK-12631) Make Parameter Descriptions Consistent for PySpark MLlib Clustering

[ https://issues.apache.org/jira/browse/SPARK-12631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12631: Assignee: (was: Apache Spark) > Make Parameter Descriptions Consistent for PySpark

[jira] [Assigned] (SPARK-12631) Make Parameter Descriptions Consistent for PySpark MLlib Clustering

[ https://issues.apache.org/jira/browse/SPARK-12631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12631: Assignee: Apache Spark > Make Parameter Descriptions Consistent for PySpark MLlib

[jira] [Commented] (SPARK-12631) Make Parameter Descriptions Consistent for PySpark MLlib Clustering

[ https://issues.apache.org/jira/browse/SPARK-12631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084451#comment-15084451 ] Apache Spark commented on SPARK-12631: -- User 'BryanCutler' has created a pull request for this

[jira] [Commented] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084457#comment-15084457 ] Yuri Saito commented on SPARK-11227: [~ansonism] Even if you use HiveContext, it dosen't work with

[jira] [Commented] (SPARK-11798) Datanucleus jars is missing under lib_managed/jars

[ https://issues.apache.org/jira/browse/SPARK-11798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084458#comment-15084458 ] Josh Rosen commented on SPARK-11798: Should I leave this open or should we resolve as "cannot

[jira] [Closed] (SPARK-7128) Add generic bagging algorithm to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-7128. Resolution: Later I'm going to close this for now since we don't have the time to review

[jira] [Updated] (SPARK-12655) GraphX does not unpersist RDDs

[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated SPARK-12655: Description: Looks like Graph does not clean all RDDs from the cache on unpersist

[jira] [Updated] (SPARK-12439) Fix toCatalystArray and MapObjects

[ https://issues.apache.org/jira/browse/SPARK-12439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12439: - Assignee: Liang-Chi Hsieh (was: Apache Spark) > Fix toCatalystArray and MapObjects >

[jira] [Created] (SPARK-12663) More informative error message in MLUtils.loadLibSVMFile

Robert Dodier created SPARK-12663: - Summary: More informative error message in MLUtils.loadLibSVMFile Key: SPARK-12663 URL: https://issues.apache.org/jira/browse/SPARK-12663 Project: Spark

[jira] [Commented] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084461#comment-15084461 ] Bryan Cutler commented on SPARK-12632: -- [~somi...@us.ibm.com] recommendation.py is missing the

[jira] [Created] (SPARK-12661) Drop Python 2.6 support in PySpark

Davies Liu created SPARK-12661: -- Summary: Drop Python 2.6 support in PySpark Key: SPARK-12661 URL: https://issues.apache.org/jira/browse/SPARK-12661 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-12450) Un-persist broadcasted variables in KMeans

[ https://issues.apache.org/jira/browse/SPARK-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12450: -- Assignee: RJ Nowling Target Version/s: 1.5.3, 1.6.1, 2.0.0 > Un-persist

[jira] [Updated] (SPARK-12661) Drop Python 2.6 support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12661: --- Target Version/s: 2.0.0 Component/s: PySpark > Drop Python 2.6 support in PySpark >

[jira] [Updated] (SPARK-12661) Drop Python 2.6 support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12661: --- Labels: releasenotes (was: ) > Drop Python 2.6 support in PySpark >

[jira] [Updated] (SPARK-11945) Add computeCost to KMeansModel for PySpark spark.ml

[ https://issues.apache.org/jira/browse/SPARK-11945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11945: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target

[jira] [Resolved] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12453. --- Resolution: Fixed Fix Version/s: 1.6.1 1.5.3 2.0.0

[jira] [Assigned] (SPARK-6363) make scala 2.11 default language

[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-6363: - Assignee: Josh Rosen > make scala 2.11 default language > > >

[jira] [Updated] (SPARK-12603) PySpark MLlib GaussianMixtureModel should support single instance predict/predictSoft

[ https://issues.apache.org/jira/browse/SPARK-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12603: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target

[jira] [Resolved] (SPARK-12041) Add columnSimilarities to IndexedRowMatrix for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12041. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10158

[jira] [Assigned] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12591: Assignee: Apache Spark > NullPointerException using checkpointed mapWithState with

[jira] [Assigned] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12591: Assignee: (was: Apache Spark) > NullPointerException using checkpointed mapWithState

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084101#comment-15084101 ] Apache Spark commented on SPARK-12591: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084014#comment-15084014 ] Josh Rosen commented on SPARK-12661: Note that we'll have to continue testing Python 2.6 for the 1.x

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084016#comment-15084016 ] Josh Rosen commented on SPARK-12661: Also, we need to figure out whether {{spark-ec2}} is still

[jira] [Resolved] (SPARK-12450) Un-persist broadcasted variables in KMeans

[ https://issues.apache.org/jira/browse/SPARK-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12450. --- Resolution: Fixed Fix Version/s: 1.6.1 1.5.3

[jira] [Updated] (SPARK-12269) Update aws-java-sdk version

[ https://issues.apache.org/jira/browse/SPARK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12269: -- Assignee: Brian London (was: Apache Spark) This can proceed now after a rebase, since SPARK-12453 is

[jira] [Commented] (SPARK-6363) make scala 2.11 default language

[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084035#comment-15084035 ] Apache Spark commented on SPARK-6363: - User 'JoshRosen' has created a pull request for this issue:

[jira] [Updated] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12453: -- Assignee: Brian London > Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version >

[jira] [Updated] (SPARK-12041) Add columnSimilarities to IndexedRowMatrix for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12041: -- Assignee: Kai Jiang > Add columnSimilarities to IndexedRowMatrix for PySpark >

[jira] [Updated] (SPARK-9372) For a join operator, rows with null equal join key expression can be filtered out early

[ https://issues.apache.org/jira/browse/SPARK-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9372: Assignee: (was: Yin Huai) > For a join operator, rows with null equal join key expression can be

[jira] [Commented] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082943#comment-15082943 ] Vijay Kiran commented on SPARK-12632: - [~somi...@us.ibm.com] Did you start working on this already ?

[jira] [Comment Edited] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082943#comment-15082943 ] Vijay Kiran edited comment on SPARK-12632 at 1/5/16 12:20 PM: --

[jira] [Commented] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082964#comment-15082964 ] Apache Spark commented on SPARK-12632: -- User 'somideshmukh' has created a pull request for this

[jira] [Assigned] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12632: Assignee: Apache Spark > Make Parameter Descriptions Consistent for PySpark MLlib FPM and

[jira] [Assigned] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12632: Assignee: (was: Apache Spark) > Make Parameter Descriptions Consistent for PySpark

[jira] [Commented] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082973#comment-15082973 ] Vijay Kiran commented on SPARK-12632: - [~somi...@us.ibm.com] I added a couple of comments, I guess

[jira] [Resolved] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12504. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10452

<    1   2   3