[jira] [Assigned] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8505: --- Assignee: Apache Spark Add settings to kick `lint-r` from `./dev/run-test.py`

[jira] [Commented] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651360#comment-14651360 ] Apache Spark commented on SPARK-8505: - User 'yu-iskw' has created a pull request for

[jira] [Resolved] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2205. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7773

[jira] [Commented] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651413#comment-14651413 ] Apache Spark commented on SPARK-7685: - User 'dbtsai' has created a pull request for

[jira] [Assigned] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7685: --- Assignee: Apache Spark (was: DB Tsai) Handle high imbalanced data and apply weights to

[jira] [Assigned] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7685: --- Assignee: DB Tsai (was: Apache Spark) Handle high imbalanced data and apply weights to

[jira] [Assigned] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8505: --- Assignee: (was: Apache Spark) Add settings to kick `lint-r` from `./dev/run-test.py`

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651367#comment-14651367 ] Hossein Falaki commented on SPARK-9319: --- Yes. I will submit a PR. Add support for

[jira] [Created] (SPARK-9550) Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket)

Josh Rosen created SPARK-9550: - Summary: Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket) Key: SPARK-9550 URL: https://issues.apache.org/jira/browse/SPARK-9550 Project:

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651436#comment-14651436 ] Shivaram Venkataraman commented on SPARK-8939: -- [~andrewor14] I ran into this

[jira] [Commented] (SPARK-9208) Audit DataFrame expression API for 1.5 release

[ https://issues.apache.org/jira/browse/SPARK-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650626#comment-14650626 ] Apache Spark commented on SPARK-9208: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-9498) Some statistical information missed when the driver is out of the cluster

[ https://issues.apache.org/jira/browse/SPARK-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9498. -- Resolution: Not A Problem Some statistical information missed when the driver is out of the cluster

[jira] [Assigned] (SPARK-9535) Modify document for codegen

[ https://issues.apache.org/jira/browse/SPARK-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9535: --- Assignee: Apache Spark Modify document for codegen ---

[jira] [Commented] (SPARK-9535) Modify document for codegen

[ https://issues.apache.org/jira/browse/SPARK-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650638#comment-14650638 ] Apache Spark commented on SPARK-9535: - User 'sarutak' has created a pull request for

[jira] [Assigned] (SPARK-9535) Modify document for codegen

[ https://issues.apache.org/jira/browse/SPARK-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9535: --- Assignee: (was: Apache Spark) Modify document for codegen ---

[jira] [Updated] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9537: --- Priority: Minor (was: Major) DecisionTreeClassifierModel support probability prediction for

[jira] [Created] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

Yanbo Liang created SPARK-9537: -- Summary: DecisionTreeClassifierModel support probability prediction for PySpark.ml Key: SPARK-9537 URL: https://issues.apache.org/jira/browse/SPARK-9537 Project: Spark

[jira] [Updated] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9536: --- Priority: Minor (was: Major) NaiveBayesModel support probability prediction for PySpark.ml

[jira] [Updated] (SPARK-9000) Support generic item type in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9000: - Assignee: Feynman Liang Support generic item type in PrefixSpan

[jira] [Resolved] (SPARK-9000) Support generic item type in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9000. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7837

[jira] [Resolved] (SPARK-9370) Support DecimalType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9370. --- Resolution: Fixed Fix Version/s: 1.5.0 Support DecimalType in UnsafeRow

[jira] [Commented] (SPARK-9370) Support DecimalType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650621#comment-14650621 ] Davies Liu commented on SPARK-9370: --- This is fixed by

[jira] [Updated] (SPARK-7497) test_count_by_value_and_window is flaky

[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7497: -- Assignee: (was: Davies Liu) test_count_by_value_and_window is flaky

[jira] [Resolved] (SPARK-9441) NoSuchMethodError: Com.typesafe.config.Config.getDuration

[ https://issues.apache.org/jira/browse/SPARK-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9441. -- Resolution: Not A Problem NoSuchMethodError: Com.typesafe.config.Config.getDuration

[jira] [Updated] (SPARK-8889) showDagViz will cause java.lang.OutOfMemoryError: Java heap space

[ https://issues.apache.org/jira/browse/SPARK-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8889: - Target Version/s: (was: 1.4.2, 1.5.0) Priority: Minor (was: Major) Fix Version/s:

[jira] [Closed] (SPARK-9099) spark-ec2 does not add important ports to security group

[ https://issues.apache.org/jira/browse/SPARK-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Sung-jin Hong closed SPARK-9099. -- Resolution: Invalid spark-ec2 does not add important ports to security group

[jira] [Updated] (SPARK-9535) Modify document for codegen

[ https://issues.apache.org/jira/browse/SPARK-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9535: - Assignee: KaiXinXIaoLei Modify document for codegen --- Key:

[jira] [Created] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

Yanbo Liang created SPARK-9536: -- Summary: NaiveBayesModel support probability prediction for PySpark.ml Key: SPARK-9536 URL: https://issues.apache.org/jira/browse/SPARK-9536 Project: Spark

[jira] [Created] (SPARK-9534) Enable javac lint for scalac parity; fix a lot of build warnings, 1.5.0 edition

Sean Owen created SPARK-9534: Summary: Enable javac lint for scalac parity; fix a lot of build warnings, 1.5.0 edition Key: SPARK-9534 URL: https://issues.apache.org/jira/browse/SPARK-9534 Project: Spark

[jira] [Resolved] (SPARK-9149) Add an example of spark.ml KMeans

[ https://issues.apache.org/jira/browse/SPARK-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9149. -- Resolution: Fixed Issue resolved by pull request 7697 [https://github.com/apache/spark/pull/7697] Add

[jira] [Updated] (SPARK-9149) Add an example of spark.ml KMeans

[ https://issues.apache.org/jira/browse/SPARK-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9149: - Priority: Minor (was: Major) Add an example of spark.ml KMeans -

[jira] [Resolved] (SPARK-4454) Race condition in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4454. -- Resolution: Fixed Given the unlikelihood of a further 1.2.x release, I'm closing this as no longer

[jira] [Updated] (SPARK-4454) Race condition in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4454: - Labels: (was: backport-needed) Race condition in DAGScheduler --

[jira] [Commented] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650657#comment-14650657 ] Sean Owen commented on SPARK-8119: -- I attempted a back-port but this depends on

[jira] [Assigned] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-9527: Assignee: Xiangrui Meng PrefixSpan.run should return a PrefixSpanModel instead of an RDD

[jira] [Commented] (SPARK-8874) Add missing methods in Word2Vec ML

[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650619#comment-14650619 ] Manoj Kumar commented on SPARK-8874: Done. Thanks. Add missing methods in Word2Vec

[jira] [Resolved] (SPARK-9529) Improve sort on Decimal

[ https://issues.apache.org/jira/browse/SPARK-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9529. Resolution: Fixed Fix Version/s: 1.5.0 Improve sort on Decimal ---

[jira] [Resolved] (SPARK-8612) Yarn application status is misreported for failed PySpark apps.

[ https://issues.apache.org/jira/browse/SPARK-8612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8612. -- Resolution: Duplicate I believe so. I think Marcelo is following up on this general issue; there are a

[jira] [Resolved] (SPARK-9521) Require Maven 3.3.3+ in the build

[ https://issues.apache.org/jira/browse/SPARK-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9521. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7852

[jira] [Created] (SPARK-9535) Modify document for codegen

Kousuke Saruta created SPARK-9535: - Summary: Modify document for codegen Key: SPARK-9535 URL: https://issues.apache.org/jira/browse/SPARK-9535 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9523) Receiver for Spark Streaming does not naturally support kryo serializer

[ https://issues.apache.org/jira/browse/SPARK-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9523: - Target Version/s: (was: 1.3.1) Priority: Minor (was: Major) Fix Version/s: (was:

[jira] [Updated] (SPARK-9533) Add missing methods in Word2Vec ML (Python API)

[ https://issues.apache.org/jira/browse/SPARK-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9533: - Priority: Minor (was: Major) Component/s: ML Add missing methods in Word2Vec ML (Python API)

[jira] [Updated] (SPARK-9504) Flaky test: o.a.s.streaming.StreamingContextSuite.stop gracefully

[ https://issues.apache.org/jira/browse/SPARK-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9504: - Assignee: Shixiong Zhu Flaky test: o.a.s.streaming.StreamingContextSuite.stop gracefully

[jira] [Commented] (SPARK-9375) The total number of executor(s) requested by the driver may be negative

[ https://issues.apache.org/jira/browse/SPARK-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650650#comment-14650650 ] Sean Owen commented on SPARK-9375: -- [~sandyr] has a question for you on the PR; this may

[jira] [Resolved] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8981. -- Resolution: Won't Fix We can reopen this if there is a PR to clarify how this would work Set

[jira] [Commented] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650652#comment-14650652 ] Apache Spark commented on SPARK-7563: - User 'srowen' has created a pull request for

[jira] [Created] (SPARK-9533) Add missing methods in Word2Vec ML (Python API)

Manoj Kumar created SPARK-9533: -- Summary: Add missing methods in Word2Vec ML (Python API) Key: SPARK-9533 URL: https://issues.apache.org/jira/browse/SPARK-9533 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-9534) Enable javac lint for scalac parity; fix a lot of build warnings, 1.5.0 edition

[ https://issues.apache.org/jira/browse/SPARK-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9534: --- Assignee: Sean Owen (was: Apache Spark) Enable javac lint for scalac parity; fix a lot of

[jira] [Commented] (SPARK-9534) Enable javac lint for scalac parity; fix a lot of build warnings, 1.5.0 edition

[ https://issues.apache.org/jira/browse/SPARK-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650631#comment-14650631 ] Apache Spark commented on SPARK-9534: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-9534) Enable javac lint for scalac parity; fix a lot of build warnings, 1.5.0 edition

[ https://issues.apache.org/jira/browse/SPARK-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9534: --- Assignee: Apache Spark (was: Sean Owen) Enable javac lint for scalac parity; fix a lot of

[jira] [Updated] (SPARK-9209) Using executor allocation, a executor is removed but it exists in ExecutorsPage of the web ui

[ https://issues.apache.org/jira/browse/SPARK-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9209: - Target Version/s: (was: 1.5.0) Priority: Minor (was: Major) Fix Version/s: (was:

[jira] [Updated] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9056: - Assignee: Sameer Abhyankar Rename configuration `spark.streaming.minRememberDuration` to

[jira] [Created] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

Yanbo Liang created SPARK-9538: -- Summary: LogisticRegression support raw and probability prediction for PySpark.ml Key: SPARK-9538 URL: https://issues.apache.org/jira/browse/SPARK-9538 Project: Spark

[jira] [Commented] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650694#comment-14650694 ] Apache Spark commented on SPARK-9536: - User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650725#comment-14650725 ] Apache Spark commented on SPARK-8064: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651023#comment-14651023 ] Michael Smith commented on SPARK-7230: -- I support Antonio's request to bring back

[jira] [Updated] (SPARK-9254) sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS redirection

[ https://issues.apache.org/jira/browse/SPARK-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9254: - Fix Version/s: 1.3.2 sbt-launch-lib.bash should use `curl --location` to support HTTP/HTTPS

[jira] [Commented] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650696#comment-14650696 ] Apache Spark commented on SPARK-9538: - User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9537: --- Assignee: (was: Apache Spark) DecisionTreeClassifierModel support probability

[jira] [Commented] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650695#comment-14650695 ] Apache Spark commented on SPARK-9537: - User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9538: --- Assignee: Apache Spark LogisticRegression support raw and probability prediction for

[jira] [Assigned] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9538: --- Assignee: (was: Apache Spark) LogisticRegression support raw and probability prediction

[jira] [Assigned] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9537: --- Assignee: Apache Spark DecisionTreeClassifierModel support probability prediction for

[jira] [Assigned] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9536: --- Assignee: (was: Apache Spark) NaiveBayesModel support probability prediction for

[jira] [Assigned] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9536: --- Assignee: Apache Spark NaiveBayesModel support probability prediction for PySpark.ml

[jira] [Assigned] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9527: --- Assignee: Xiangrui Meng (was: Apache Spark) PrefixSpan.run should return a PrefixSpanModel

[jira] [Commented] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

[ https://issues.apache.org/jira/browse/SPARK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651067#comment-14651067 ] Andrey Zimovnov commented on SPARK-9539: Hi, Owen! I'm not sure what Permanent in

[jira] [Commented] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

[ https://issues.apache.org/jira/browse/SPARK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651073#comment-14651073 ] Sean Owen commented on SPARK-9539: -- This just shows Spark is using memory. It's normal to

[jira] [Created] (SPARK-9542) create unsafe version of map type

Wenchen Fan created SPARK-9542: -- Summary: create unsafe version of map type Key: SPARK-9542 URL: https://issues.apache.org/jira/browse/SPARK-9542 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-9542) create unsafe version of map type

[ https://issues.apache.org/jira/browse/SPARK-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9542: --- Assignee: (was: Apache Spark) create unsafe version of map type

[jira] [Commented] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651062#comment-14651062 ] Apache Spark commented on SPARK-9527: - User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9527: --- Assignee: Apache Spark (was: Xiangrui Meng) PrefixSpan.run should return a PrefixSpanModel

[jira] [Updated] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

[ https://issues.apache.org/jira/browse/SPARK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Zimovnov updated SPARK-9539: --- Description: Example code in Python: {code:python} for i in range(20): print i

[jira] [Commented] (SPARK-5754) Spark AM not launching on Windows

[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651140#comment-14651140 ] Apache Spark commented on SPARK-5754: - User 'cbvoxel' has created a pull request for

[jira] [Updated] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD and it should be Java-friendly

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9527: - Shepherd: Feynman Liang PrefixSpan.run should return a PrefixSpanModel instead of an RDD and it

[jira] [Updated] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD and it should be Java-friendly

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9527: - Summary: PrefixSpan.run should return a PrefixSpanModel instead of an RDD and it should be

[jira] [Updated] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD and it should be Java-friendly

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9527: - Description: With a model wrapping the result RDD, it would be more flexible to add features in

[jira] [Commented] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

[ https://issues.apache.org/jira/browse/SPARK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651064#comment-14651064 ] Sean Owen commented on SPARK-9539: -- Why do you think this is a memory leak? That

[jira] [Created] (SPARK-9540) Optimize PrefixSpan implementation

Xiangrui Meng created SPARK-9540: Summary: Optimize PrefixSpan implementation Key: SPARK-9540 URL: https://issues.apache.org/jira/browse/SPARK-9540 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

[ https://issues.apache.org/jira/browse/SPARK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Zimovnov updated SPARK-9539: --- Attachment: Screenshot at авг. 02 19-10-53.png jstat visualization Repeated sc.close() in

[jira] [Commented] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

[ https://issues.apache.org/jira/browse/SPARK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651078#comment-14651078 ] Andrey Zimovnov commented on SPARK-9539: OK, I'll work on this later and reopen if

[jira] [Created] (SPARK-9541) DateTimeUtils cleanup

Yijie Shen created SPARK-9541: - Summary: DateTimeUtils cleanup Key: SPARK-9541 URL: https://issues.apache.org/jira/browse/SPARK-9541 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Created] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

Andrey Zimovnov created SPARK-9539: -- Summary: Repeated sc.close() in PySpark causes JVM memory leak Key: SPARK-9539 URL: https://issues.apache.org/jira/browse/SPARK-9539 Project: Spark

[jira] [Updated] (SPARK-8445) MLlib 1.5 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8445: - Description: We expect to see many MLlib contributors for the 1.5 release. To scale out the

[jira] [Commented] (SPARK-9541) DateTimeUtils cleanup

[ https://issues.apache.org/jira/browse/SPARK-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651082#comment-14651082 ] Apache Spark commented on SPARK-9541: - User 'yjshen' has created a pull request for

[jira] [Assigned] (SPARK-9541) DateTimeUtils cleanup

[ https://issues.apache.org/jira/browse/SPARK-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9541: --- Assignee: (was: Apache Spark) DateTimeUtils cleanup -

[jira] [Assigned] (SPARK-9541) DateTimeUtils cleanup

[ https://issues.apache.org/jira/browse/SPARK-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9541: --- Assignee: Apache Spark DateTimeUtils cleanup - Key:

[jira] [Assigned] (SPARK-9140) Replace TimeTracker by Stopwatch

[ https://issues.apache.org/jira/browse/SPARK-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9140: --- Assignee: Apache Spark Replace TimeTracker by Stopwatch

[jira] [Assigned] (SPARK-9140) Replace TimeTracker by Stopwatch

[ https://issues.apache.org/jira/browse/SPARK-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9140: --- Assignee: (was: Apache Spark) Replace TimeTracker by Stopwatch

[jira] [Commented] (SPARK-9140) Replace TimeTracker by Stopwatch

[ https://issues.apache.org/jira/browse/SPARK-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651083#comment-14651083 ] Apache Spark commented on SPARK-9140: - User 'hhbyyh' has created a pull request for

[jira] [Resolved] (SPARK-9539) Repeated sc.close() in PySpark causes JVM memory leak

[ https://issues.apache.org/jira/browse/SPARK-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9539. -- Resolution: Not A Problem Repeated sc.close() in PySpark causes JVM memory leak

[jira] [Commented] (SPARK-9542) create unsafe version of map type

[ https://issues.apache.org/jira/browse/SPARK-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651100#comment-14651100 ] Apache Spark commented on SPARK-9542: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9542) create unsafe version of map type

[ https://issues.apache.org/jira/browse/SPARK-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9542: --- Assignee: Apache Spark create unsafe version of map type -

[jira] [Updated] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9536: - Assignee: Yanbo Liang NaiveBayesModel support probability prediction for PySpark.ml

[jira] [Updated] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9538: - Assignee: Yanbo Liang LogisticRegression support raw and probability prediction for

[jira] [Updated] (SPARK-8874) Add missing methods in Word2Vec ML

[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8874: - Component/s: (was: PySpark) Add missing methods in Word2Vec ML

[jira] [Updated] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9537: - Assignee: Yanbo Liang Target Version/s: 1.5.0 DecisionTreeClassifierModel

[jira] [Updated] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9538: - Target Version/s: 1.5.0 LogisticRegression support raw and probability prediction for

[jira] [Updated] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9536: - Target Version/s: 1.5.0 NaiveBayesModel support probability prediction for PySpark.ml

[jira] [Resolved] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD and it should be Java-friendly

[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9527. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7869

  1   2   >