[jira] [Commented] (SPARK-3246) Support weighted SVMWithSGD for classification of unbalanced dataset

[ https://issues.apache.org/jira/browse/SPARK-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877444#comment-14877444 ] Masaki Rikitoku commented on SPARK-3246: In the libsvm package, we can set the dif

[jira] [Resolved] (SPARK-10710) Remove ability to set spark.shuffle.spill=false and spark.sql.planner.externalSort=false

[ https://issues.apache.org/jira/browse/SPARK-10710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10710. - Resolution: Fixed Fix Version/s: 1.6.0 > Remove ability to set spark.shuffle.spill=false a

[jira] [Updated] (SPARK-10710) Remove ability to set spark.shuffle.spill=false and spark.sql.planner.externalSort=false

[ https://issues.apache.org/jira/browse/SPARK-10710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10710: Labels: releasenotes (was: ) > Remove ability to set spark.shuffle.spill=false and > spark.sql.pl

[jira] [Issue Comment Deleted] (SPARK-10718) Check License should not verify conf files for license

[ https://issues.apache.org/jira/browse/SPARK-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated SPARK-10718: Comment: was deleted (was: pull request in progress. thanks) > Check License should not verify con

[jira] [Assigned] (SPARK-10718) Check License should not verify conf files for license

[ https://issues.apache.org/jira/browse/SPARK-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10718: Assignee: (was: Apache Spark) > Check License should not verify conf files for license

[jira] [Assigned] (SPARK-10718) Check License should not verify conf files for license

[ https://issues.apache.org/jira/browse/SPARK-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10718: Assignee: Apache Spark > Check License should not verify conf files for license >

[jira] [Commented] (SPARK-10718) Check License should not verify conf files for license

[ https://issues.apache.org/jira/browse/SPARK-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877413#comment-14877413 ] Apache Spark commented on SPARK-10718: -- User 'rekhajoshm' has created a pull request

[jira] [Updated] (SPARK-10718) Check License should not verify conf files for license

[ https://issues.apache.org/jira/browse/SPARK-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated SPARK-10718: Summary: Check License should not verify conf files for license (was: Post Apache license header m

[jira] [Updated] (SPARK-10718) Check License should not verify conf files for license

[ https://issues.apache.org/jira/browse/SPARK-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated SPARK-10718: Description: Check License should not verify conf files for license {code} Apache license header mi

[jira] [Commented] (SPARK-10718) Post Apache license header missing from multiple script and required files

[ https://issues.apache.org/jira/browse/SPARK-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877408#comment-14877408 ] Rekha Joshi commented on SPARK-10718: - pull request in progress. thanks > Post Apach

[jira] [Created] (SPARK-10718) Post Apache license header missing from multiple script and required files

Rekha Joshi created SPARK-10718: --- Summary: Post Apache license header missing from multiple script and required files Key: SPARK-10718 URL: https://issues.apache.org/jira/browse/SPARK-10718 Project: Spa

[jira] [Assigned] (SPARK-10706) Add java wrapper for random vector rdd

[ https://issues.apache.org/jira/browse/SPARK-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10706: Assignee: (was: Apache Spark) > Add java wrapper for random vector rdd > -

[jira] [Assigned] (SPARK-10706) Add java wrapper for random vector rdd

[ https://issues.apache.org/jira/browse/SPARK-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10706: Assignee: Apache Spark > Add java wrapper for random vector rdd >

[jira] [Commented] (SPARK-10706) Add java wrapper for random vector rdd

[ https://issues.apache.org/jira/browse/SPARK-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877399#comment-14877399 ] Apache Spark commented on SPARK-10706: -- User 'rotationsymmetry' has created a pull r

[jira] [Commented] (SPARK-10626) Create a Java friendly method for randomRDD & RandomDataGenerator on RandomRDDs.

[ https://issues.apache.org/jira/browse/SPARK-10626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877398#comment-14877398 ] Apache Spark commented on SPARK-10626: -- User 'rotationsymmetry' has created a pull r

[jira] [Commented] (SPARK-10717) remove the with Loging in the NioBlockTransferService

[ https://issues.apache.org/jira/browse/SPARK-10717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877397#comment-14877397 ] DjvuLee commented on SPARK-10717: - change to final class NioBlockTransferService(conf:

[jira] [Created] (SPARK-10717) remove the with Loging in the NioBlockTransferService

DjvuLee created SPARK-10717: --- Summary: remove the with Loging in the NioBlockTransferService Key: SPARK-10717 URL: https://issues.apache.org/jira/browse/SPARK-10717 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-8632) Poor Python UDF performance because of RDD caching

[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8632: --- Priority: Blocker (was: Major) > Poor Python UDF performance because of RDD caching > ---

[jira] [Updated] (SPARK-8632) Poor Python UDF performance because of RDD caching

[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8632: --- Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > Poor Python UDF performance because of RDD caching > --

[jira] [Commented] (SPARK-10685) Misaligned data with RDD.zip and DataFrame.withColumn after repartition

[ https://issues.apache.org/jira/browse/SPARK-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877372#comment-14877372 ] Apache Spark commented on SPARK-10685: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-8632) Poor Python UDF performance because of RDD caching

[ https://issues.apache.org/jira/browse/SPARK-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877371#comment-14877371 ] Apache Spark commented on SPARK-8632: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-10155) Memory leak in SQL parsers

[ https://issues.apache.org/jira/browse/SPARK-10155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10155: - Assignee: Shixiong Zhu > Memory leak in SQL parsers > -- > > Key:

[jira] [Resolved] (SPARK-10155) Memory leak in SQL parsers

[ https://issues.apache.org/jira/browse/SPARK-10155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10155. -- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Issue resolved by pull request 8

[jira] [Commented] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877338#comment-14877338 ] Rekha Joshi commented on SPARK-8567: Also [~mengxr] there is a worker shutdown issue (

[jira] [Updated] (SPARK-4503) The history server is not compatible with HDFS HA

[ https://issues.apache.org/jira/browse/SPARK-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated SPARK-4503: --- Attachment: historyserver1.png Hi [~xjxyxgq] MarsXu, I was not able to replicate the issue on Spark-1.

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877275#comment-14877275 ] Meihua Wu commented on SPARK-7129: -- [~josephkb] As weighting has been added to logistic r

[jira] [Commented] (SPARK-10706) Add java wrapper for random vector rdd

[ https://issues.apache.org/jira/browse/SPARK-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877274#comment-14877274 ] Sean Owen commented on SPARK-10706: --- Let's follow https://github.com/apache/spark/pull/

[jira] [Updated] (SPARK-10716) http://d3kbcqa49mib13.cloudfront.net/spark-1.5.0-bin-hadoop2.6.tgz file broken?

[ https://issues.apache.org/jira/browse/SPARK-10716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10716: -- Priority: Minor (was: Major) Issue Type: Bug (was: Question) Hm, I see the same thing on OS X a

[jira] [Comment Edited] (SPARK-10706) Add java wrapper for random vector rdd

[ https://issues.apache.org/jira/browse/SPARK-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877220#comment-14877220 ] Meihua Wu edited comment on SPARK-10706 at 9/19/15 6:48 PM: [

[jira] [Created] (SPARK-10716) http://d3kbcqa49mib13.cloudfront.net/spark-1.5.0-bin-hadoop2.6.tgz file broken?

Jack Jack created SPARK-10716: - Summary: http://d3kbcqa49mib13.cloudfront.net/spark-1.5.0-bin-hadoop2.6.tgz file broken? Key: SPARK-10716 URL: https://issues.apache.org/jira/browse/SPARK-10716 Project: Sp

[jira] [Comment Edited] (SPARK-10712) JVM crashes with spark.sql.tungsten.enabled = true

[ https://issues.apache.org/jira/browse/SPARK-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877223#comment-14877223 ] Mauro Pirrone edited comment on SPARK-10712 at 9/19/15 5:40 PM: ---

[jira] [Commented] (SPARK-10712) JVM crashes with spark.sql.tungsten.enabled = true

[ https://issues.apache.org/jira/browse/SPARK-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877223#comment-14877223 ] Mauro Pirrone commented on SPARK-10712: --- A workaround to this problem is set increa

[jira] [Commented] (SPARK-10706) Add java wrapper for random vector rdd

[ https://issues.apache.org/jira/browse/SPARK-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877220#comment-14877220 ] Meihua Wu commented on SPARK-10706: --- I will work on this. > Add java wrapper for rando

[jira] [Updated] (SPARK-10662) Code snippets are not properly formatted in tables

[ https://issues.apache.org/jira/browse/SPARK-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-10662: Summary: Code snippets are not properly formatted in tables (was: Code snippets are not pr

[jira] [Resolved] (SPARK-6067) Spark sql hive dynamic partitions job will fail if task fails

[ https://issues.apache.org/jira/browse/SPARK-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6067. -- Resolution: Duplicate >From the PR discussion, sounds like this is the same as SPARK-8379 > Spark sql h

[jira] [Commented] (SPARK-10663) Change test.toDF to test in Spark ML Programming Guide

[ https://issues.apache.org/jira/browse/SPARK-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877127#comment-14877127 ] Sean Owen commented on SPARK-10663: --- [~jzhang] I see model.transform(test.toDF) on the

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is invalid

[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877105#comment-14877105 ] Apache Spark commented on SPARK-10304: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-5905) Note requirements for certain RowMatrix methods in docs

[ https://issues.apache.org/jira/browse/SPARK-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877047#comment-14877047 ] Apache Spark commented on SPARK-5905: - User 'srowen' has created a pull request for th

[jira] [Assigned] (SPARK-5905) Note requirements for certain RowMatrix methods in docs

[ https://issues.apache.org/jira/browse/SPARK-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5905: --- Assignee: (was: Apache Spark) > Note requirements for certain RowMatrix methods in docs >

[jira] [Assigned] (SPARK-5905) Note requirements for certain RowMatrix methods in docs

[ https://issues.apache.org/jira/browse/SPARK-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5905: --- Assignee: Apache Spark > Note requirements for certain RowMatrix methods in docs > --

[jira] [Updated] (SPARK-5905) Note requirements for certain RowMatrix methods in docs

[ https://issues.apache.org/jira/browse/SPARK-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5905: - Priority: Trivial (was: Minor) Summary: Note requirements for certain RowMatrix methods in docs (was

[jira] [Commented] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

[ https://issues.apache.org/jira/browse/SPARK-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877037#comment-14877037 ] Sean Owen commented on SPARK-10568: --- [~mcheah] are you working on a PR for this? > Err

[jira] [Updated] (SPARK-10712) JVM crashes with spark.sql.tungsten.enabled = true

[ https://issues.apache.org/jira/browse/SPARK-10712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mauro Pirrone updated SPARK-10712: -- Description: When turning on tungsten, I get the following error when executing a query/job wi

[jira] [Updated] (SPARK-10715) Duplicate initialzation flag in WeightedLeastSquare

[ https://issues.apache.org/jira/browse/SPARK-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10715: -- Labels: (was: ML) Component/s: ML Issue Type: Improvement (was: Bug) > Duplicate initi

[jira] [Assigned] (SPARK-10715) Duplicate initialzation flag in WeightedLeastSquare

[ https://issues.apache.org/jira/browse/SPARK-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10715: Assignee: (was: Apache Spark) > Duplicate initialzation flag in WeightedLeastSquare >

[jira] [Commented] (SPARK-10715) Duplicate initialzation flag in WeightedLeastSquare

[ https://issues.apache.org/jira/browse/SPARK-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876953#comment-14876953 ] Apache Spark commented on SPARK-10715: -- User 'Lewuathe' has created a pull request f

[jira] [Assigned] (SPARK-10715) Duplicate initialzation flag in WeightedLeastSquare

[ https://issues.apache.org/jira/browse/SPARK-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10715: Assignee: Apache Spark > Duplicate initialzation flag in WeightedLeastSquare > ---

[jira] [Created] (SPARK-10715) Duplicate initialzation flag in WeightedLeastSquare

Kai Sasaki created SPARK-10715: -- Summary: Duplicate initialzation flag in WeightedLeastSquare Key: SPARK-10715 URL: https://issues.apache.org/jira/browse/SPARK-10715 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-10715) Duplicate initialzation flag in WeightedLeastSquare

[ https://issues.apache.org/jira/browse/SPARK-10715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated SPARK-10715: --- Labels: ML (was: ) > Duplicate initialzation flag in WeightedLeastSquare > -

[jira] [Assigned] (SPARK-10714) Refactor PythonRDD to decouple iterator computation from PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-10714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10714: Assignee: Apache Spark (was: Reynold Xin) > Refactor PythonRDD to decouple iterator compu

[jira] [Commented] (SPARK-10714) Refactor PythonRDD to decouple iterator computation from PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-10714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876947#comment-14876947 ] Apache Spark commented on SPARK-10714: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-10714) Refactor PythonRDD to decouple iterator computation from PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-10714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10714: Assignee: Reynold Xin (was: Apache Spark) > Refactor PythonRDD to decouple iterator compu

[jira] [Created] (SPARK-10714) Refactor PythonRDD to extract Python invocation out of "RDD"

Reynold Xin created SPARK-10714: --- Summary: Refactor PythonRDD to extract Python invocation out of "RDD" Key: SPARK-10714 URL: https://issues.apache.org/jira/browse/SPARK-10714 Project: Spark I

[jira] [Updated] (SPARK-10714) Refactor PythonRDD to decouple iterator computation from PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-10714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10714: Summary: Refactor PythonRDD to decouple iterator computation from PythonRDD (was: Refactor PythonR

[jira] [Resolved] (SPARK-10661) The PipelineModel class inherits from Serializable twice.

[ https://issues.apache.org/jira/browse/SPARK-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10661. --- Resolution: Not A Problem i.e. "not a problem in *Spark* as far as I can tell". Still does show up tw

[jira] [Resolved] (SPARK-10629) Gradient boosted trees: mapPartitions input size increasing

[ https://issues.apache.org/jira/browse/SPARK-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10629. --- Resolution: Duplicate > Gradient boosted trees: mapPartitions input size increasing > --

[jira] [Resolved] (SPARK-10529) When creating multiple HiveContext objects in one jvm, jdbc connections to metastore cann't be released and it may cause PermGen OutOfMemoryError.

[ https://issues.apache.org/jira/browse/SPARK-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10529. --- Resolution: Not A Problem Resolving per the PR discussion: don't make more than one context in a JVM