[jira] [Resolved] (SPARK-3544) SparkSQL thriftServer cannot release locks correctly in Zookeeper

[ https://issues.apache.org/jira/browse/SPARK-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3544. -- Resolution: Incomplete I think this is at least obsolete now; no follow up or other reports of this, bu

[jira] [Resolved] (SPARK-5772) spark-submit --driver-memory not correctly taken into account

[ https://issues.apache.org/jira/browse/SPARK-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5772. -- Resolution: Won't Fix > spark-submit --driver-memory not correctly taken into account >

[jira] [Resolved] (SPARK-5998) Make Spark Streaming checkpoint version compatible

[ https://issues.apache.org/jira/browse/SPARK-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5998. -- Resolution: Won't Fix Looks like this didn't go anywhere (and could be quite complex); it could be reop

[jira] [Updated] (SPARK-3750) Log ulimit settings at warning if they are too low

[ https://issues.apache.org/jira/browse/SPARK-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3750: - Priority: Minor (was: Major) Andrew do you still want to add this? > Log ulimit settings at warning if t

[jira] [Resolved] (SPARK-2559) Add A Link to Download the Application Events Log for Offline Analysis

[ https://issues.apache.org/jira/browse/SPARK-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2559. -- Resolution: Not A Problem I'm not sure when this was added, or else I'd link it as Fixed, but you can d

[jira] [Resolved] (SPARK-10912) Improve Spark metrics executor.filesystem

[ https://issues.apache.org/jira/browse/SPARK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10912. --- Resolution: Won't Fix This is EC2-specific, and support for that has moved out of Spark. I think this

[jira] [Resolved] (SPARK-13143) EC2 cluster silently not destroyed for non-default regions

[ https://issues.apache.org/jira/browse/SPARK-13143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13143. --- Resolution: Won't Fix I think we're not managing EC2 issues in Spark anymore as the support is no lo

[jira] [Updated] (SPARK-13913) DataFrame.withColumn fails when trying to replace existing column with dot in name

[ https://issues.apache.org/jira/browse/SPARK-13913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13913: -- Component/s: SQL > DataFrame.withColumn fails when trying to replace existing column with dot in > nam

[jira] [Resolved] (SPARK-13889) Integer overflow when calculating the max number of executor failure

[ https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13889. --- Resolution: Fixed Assignee: Carson Wang Fix Version/s: 2.0.0 Resolved by https://gith

[jira] [Commented] (SPARK-13915) Allow bin/spark-submit to be called via symbolic link

[ https://issues.apache.org/jira/browse/SPARK-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197166#comment-15197166 ] Sean Owen commented on SPARK-13915: --- (It's not a CDH difference; the script is identica

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197165#comment-15197165 ] Steve Loughran commented on SPARK-7481: --- ...thinking some more about this How about

[jira] [Commented] (SPARK-13933) hadoop-2.7 profile's curator version should be 2.7.1

[ https://issues.apache.org/jira/browse/SPARK-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197163#comment-15197163 ] Sean Owen commented on SPARK-13933: --- The curator update itself seems fine but the Guava

[jira] [Created] (SPARK-13933) hadoop-2.7 profile's curator version should be 2.7.1

Steve Loughran created SPARK-13933: -- Summary: hadoop-2.7 profile's curator version should be 2.7.1 Key: SPARK-13933 URL: https://issues.apache.org/jira/browse/SPARK-13933 Project: Spark Issu

[jira] [Commented] (SPARK-13843) Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

[ https://issues.apache.org/jira/browse/SPARK-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197147#comment-15197147 ] Sean Owen commented on SPARK-13843: --- Yeah same question about Ganglia support > Move s

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197142#comment-15197142 ] Sean Owen commented on SPARK-13928: --- Are you suggesting exposing it, or hiding it furth

[jira] [Updated] (SPARK-13932) CUBE Query with filter (HAVING) and condition (IF) raises an AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-13932: - Description: A complex aggregate query using condition in the aggregate function and GROUP BY HA

[jira] [Updated] (SPARK-13932) CUBE Query with filter (HAVING) and condition (IF) raises an AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-13932: - Description: A complex aggregate query using condition in the aggregate function and GROUP BY HA

[jira] [Created] (SPARK-13932) CUBE Query with filter (HAVING) and condition (IF) raises an AnalysisException

Tien-Dung LE created SPARK-13932: Summary: CUBE Query with filter (HAVING) and condition (IF) raises an AnalysisException Key: SPARK-13932 URL: https://issues.apache.org/jira/browse/SPARK-13932 Projec

[jira] [Updated] (SPARK-13793) PipedRDD doesn't propagate exceptions while reading parent RDDd

[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13793: -- Assignee: Tejas Patil > PipedRDD doesn't propagate exceptions while reading parent RDDd > -

[jira] [Resolved] (SPARK-13793) PipedRDD doesn't propagate exceptions while reading parent RDDd

[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13793. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11628 [https://github.co

[jira] [Commented] (SPARK-12836) spark enable both driver run executor & write to HDFS

[ https://issues.apache.org/jira/browse/SPARK-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197120#comment-15197120 ] Lior Chaga commented on SPARK-12836: I used the --no-switch_user mesos config, and it

[jira] [Commented] (SPARK-13931) Resolve stage hanging up problem in a particular case

[ https://issues.apache.org/jira/browse/SPARK-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197099#comment-15197099 ] Apache Spark commented on SPARK-13931: -- User 'GavinGavinNo1' has created a pull requ

[jira] [Assigned] (SPARK-13931) Resolve stage hanging up problem in a particular case

[ https://issues.apache.org/jira/browse/SPARK-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13931: Assignee: (was: Apache Spark) > Resolve stage hanging up problem in a particular case

[jira] [Assigned] (SPARK-13931) Resolve stage hanging up problem in a particular case

[ https://issues.apache.org/jira/browse/SPARK-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13931: Assignee: Apache Spark > Resolve stage hanging up problem in a particular case > -

[jira] [Updated] (SPARK-13396) Stop using our internal deprecated .metrics on ExceptionFailure instead use accumUpdates

[ https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13396: -- Assignee: Gayathri Murali > Stop using our internal deprecated .metrics on ExceptionFailure instead use

[jira] [Resolved] (SPARK-13396) Stop using our internal deprecated .metrics on ExceptionFailure instead use accumUpdates

[ https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13396. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11544 [https://github.co

[jira] [Resolved] (SPARK-13175) Cleanup deprecation warnings from Scala 2.11 upgrade

[ https://issues.apache.org/jira/browse/SPARK-13175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13175. --- Resolution: Done Assignee: holdenk Fix Version/s: 2.0.0 > Cleanup deprecation warning

[jira] [Resolved] (SPARK-13397) Cleanup transient annotations which aren't being applied

[ https://issues.apache.org/jira/browse/SPARK-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13397. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 Resolved by https://github

[jira] [Resolved] (SPARK-13395) Silence or skip unsafe deprecation warnings

[ https://issues.apache.org/jira/browse/SPARK-13395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13395. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 Resolved by https://github

[jira] [Updated] (SPARK-13906) Spark driver hangs when slave is started or stopped (org.apache.spark.rpc.RpcTimeoutException).

[ https://issues.apache.org/jira/browse/SPARK-13906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13906: -- Assignee: Yonathan Randolph > Spark driver hangs when slave is started or stopped > (org.apache.spark.

[jira] [Resolved] (SPARK-13906) Spark driver hangs when slave is started or stopped (org.apache.spark.rpc.RpcTimeoutException).

[ https://issues.apache.org/jira/browse/SPARK-13906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13906. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11728 [https://github.co

[jira] [Created] (SPARK-13931) Resolve stage hanging up problem in a particular case

ZhengYaofeng created SPARK-13931: Summary: Resolve stage hanging up problem in a particular case Key: SPARK-13931 URL: https://issues.apache.org/jira/browse/SPARK-13931 Project: Spark Issue T

[jira] [Assigned] (SPARK-13930) Apply fast serialization on collect limit

[ https://issues.apache.org/jira/browse/SPARK-13930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13930: Assignee: (was: Apache Spark) > Apply fast serialization on collect limit > --

[jira] [Assigned] (SPARK-13930) Apply fast serialization on collect limit

[ https://issues.apache.org/jira/browse/SPARK-13930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13930: Assignee: Apache Spark > Apply fast serialization on collect limit > -

[jira] [Commented] (SPARK-13930) Apply fast serialization on collect limit

[ https://issues.apache.org/jira/browse/SPARK-13930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197078#comment-15197078 ] Apache Spark commented on SPARK-13930: -- User 'viirya' has created a pull request for

[jira] [Created] (SPARK-13930) Apply fast serialization on collect limit

Liang-Chi Hsieh created SPARK-13930: --- Summary: Apply fast serialization on collect limit Key: SPARK-13930 URL: https://issues.apache.org/jira/browse/SPARK-13930 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-12653) Re-enable test "SPARK-8489: MissingRequirementError during reflection"

[ https://issues.apache.org/jira/browse/SPARK-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12653: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Re-enable test "SPARK-8489: M

[jira] [Updated] (SPARK-12653) Re-enable test "SPARK-8489: MissingRequirementError during reflection"

[ https://issues.apache.org/jira/browse/SPARK-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12653: -- Assignee: Dongjoon Hyun > Re-enable test "SPARK-8489: MissingRequirementError during reflection" >

[jira] [Commented] (SPARK-12855) Remove parser pluggability

[ https://issues.apache.org/jira/browse/SPARK-12855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197064#comment-15197064 ] Apache Spark commented on SPARK-12855: -- User 'adrian-wang' has created a pull reques

[jira] [Resolved] (SPARK-12653) Re-enable test "SPARK-8489: MissingRequirementError during reflection"

[ https://issues.apache.org/jira/browse/SPARK-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12653. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11744 [https://github.co

[jira] [Commented] (SPARK-1359) SGD implementation is not efficient

[ https://issues.apache.org/jira/browse/SPARK-1359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197062#comment-15197062 ] Mohamed Baddar commented on SPARK-1359: --- [~mengxr] If this issue is still of interes

[jira] [Resolved] (SPARK-13914) Add functionality to back up spark event logs

[ https://issues.apache.org/jira/browse/SPARK-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13914. --- Resolution: Won't Fix > Add functionality to back up spark event logs > -

[jira] [Commented] (SPARK-13785) Deprecate model field in ML model summary classes

[ https://issues.apache.org/jira/browse/SPARK-13785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196971#comment-15196971 ] Yanbo Liang commented on SPARK-13785: - [~josephkb] Can I work on this? I vote to mak

[jira] [Created] (SPARK-13929) Use Scala reflection for UDFs

Jakob Odersky created SPARK-13929: - Summary: Use Scala reflection for UDFs Key: SPARK-13929 URL: https://issues.apache.org/jira/browse/SPARK-13929 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10788: -- Target Version/s: 2.0.0 > Decision Tree duplicates bins for unordered categorical features > --

[jira] [Updated] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10788: -- Shepherd: Joseph K. Bradley > Decision Tree duplicates bins for unordered categorical features

[jira] [Updated] (SPARK-10788) Decision Tree duplicates bins for unordered categorical features

[ https://issues.apache.org/jira/browse/SPARK-10788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10788: -- Assignee: Seth Hendrickson > Decision Tree duplicates bins for unordered categorical features >

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196928#comment-15196928 ] Jakob Odersky commented on SPARK-13118: --- Upate: there was actually with inner class

[jira] [Commented] (SPARK-13927) Add row/column iterator to local matrices

[ https://issues.apache.org/jira/browse/SPARK-13927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196900#comment-15196900 ] Apache Spark commented on SPARK-13927: -- User 'mengxr' has created a pull request for

[jira] [Resolved] (SPARK-13855) Spark 1.6.1 artifacts not found in S3 bucket / direct download

[ https://issues.apache.org/jira/browse/SPARK-13855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-13855. - Resolution: Fixed Fix Version/s: 1.6.1 > Spark 1.6.1 artifacts not found in S3 buc

[jira] [Assigned] (SPARK-13927) Add row/column iterator to local matrices

[ https://issues.apache.org/jira/browse/SPARK-13927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13927: Assignee: Apache Spark (was: Xiangrui Meng) > Add row/column iterator to local matrices >

[jira] [Commented] (SPARK-13855) Spark 1.6.1 artifacts not found in S3 bucket / direct download

[ https://issues.apache.org/jira/browse/SPARK-13855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196901#comment-15196901 ] Patrick Wendell commented on SPARK-13855: - I've uploaded the artifacts, thanks.

[jira] [Assigned] (SPARK-13927) Add row/column iterator to local matrices

[ https://issues.apache.org/jira/browse/SPARK-13927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13927: Assignee: Xiangrui Meng (was: Apache Spark) > Add row/column iterator to local matrices >