[jira] [Created] (SPARK-38009) In start-thriftserver.sh arguments, "--hiveconf xxx" should have higher precedence over "--conf spark.hadoop.xxx", or any other hadoop configurations

Peng Cheng created SPARK-38009: -- Summary: In start-thriftserver.sh arguments, "--hiveconf xxx" should have higher precedence over "--conf spark.hadoop.xxx", or any other hadoop configurations Key: SPARK-38009 URL:

[jira] [Updated] (SPARK-32992) In OracleDialect, "RowID" SQL type should be converted into "String" Catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-32992: --- Description: Most JDBC drivers use long SQL type for dataset row ID:   (in

[jira] [Updated] (SPARK-32992) In OracleDialect, "RowID" SQL type should be converted into "String" Catalyst type

[ https://issues.apache.org/jira/browse/SPARK-32992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-32992: --- Description: Most JDBC drivers use long SQL type for dataset row ID:   (in

[jira] [Created] (SPARK-32992) In OracleDialect, "RowID" SQL type should be converted into "String" Catalyst type

Peng Cheng created SPARK-32992: -- Summary: In OracleDialect, "RowID" SQL type should be converted into "String" Catalyst type Key: SPARK-32992 URL: https://issues.apache.org/jira/browse/SPARK-32992

[jira] [Commented] (SPARK-27025) Speed up toLocalIterator

[ https://issues.apache.org/jira/browse/SPARK-27025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983635#comment-16983635 ] Peng Cheng commented on SPARK-27025: Am I too late for this issue? I submitted SPARK-29852. Do you

[jira] [Updated] (SPARK-29852) Implement parallel preemptive RDD.toLocalIterator and Dataset.toLocalIterator

[ https://issues.apache.org/jira/browse/SPARK-29852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-29852: --- Issue Type: Improvement (was: New Feature) > Implement parallel preemptive RDD.toLocalIterator and

[jira] [Created] (SPARK-29852) Implement parallel preemptive RDD.toLocalIterator and Dataset.toLocalIterator

Peng Cheng created SPARK-29852: -- Summary: Implement parallel preemptive RDD.toLocalIterator and Dataset.toLocalIterator Key: SPARK-29852 URL: https://issues.apache.org/jira/browse/SPARK-29852 Project:

[jira] [Commented] (SPARK-6473) Launcher lib shouldn't try to figure out Scala version when not in dev mode

[ https://issues.apache.org/jira/browse/SPARK-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279355#comment-16279355 ] Peng Cheng commented on SPARK-6473: --- Looks like this issue reappear at some point: getScalaVersion()

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174442#comment-15174442 ] Peng Cheng commented on SPARK-7481: --- +1 Me four > Add Hadoop 2.6+ profile to pull in object store FS

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073036#comment-15073036 ] Peng Cheng commented on SPARK-10625: I think the pull request has been merged. Can it be closed now?

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059390#comment-15059390 ] Peng Cheng commented on SPARK-10625: https://github.com/apache/spark/pull/8785 this one :) others

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030087#comment-15030087 ] Peng Cheng commented on SPARK-10625: Yes it is 2 months behind master branch. I've just rebased on

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030256#comment-15030256 ] Peng Cheng commented on SPARK-10625: rebased on 1.5 branch > Spark SQL JDBC read/write is unable to

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030257#comment-15030257 ] Peng Cheng commented on SPARK-10625: Rebased on 1.6 branch > Spark SQL JDBC read/write is unable to

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030259#comment-15030259 ] Peng Cheng commented on SPARK-10625: squash rebased on master > Spark SQL JDBC read/write is unable

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029361#comment-15029361 ] Peng Cheng commented on SPARK-10625: Hi committers, after 1.5.2 release this is still not merged, now

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950886#comment-14950886 ] Peng Cheng commented on SPARK-7708: --- This problem is affecting me and so far there is no trace whether

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950901#comment-14950901 ] Peng Cheng commented on SPARK-7708: --- Also, this problem doesn't only affect ClosureSerializer, if a

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941775#comment-14941775 ] Peng Cheng commented on SPARK-10625: The patch can be merged immediately, can some one verify and

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14900980#comment-14900980 ] Peng Cheng commented on SPARK-10625: Exactly as you described, driver can always be initialized from

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791252#comment-14791252 ] Peng Cheng commented on SPARK-10625: A pull request has been send that contains 2 extra unit tests

[jira] [Commented] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

[ https://issues.apache.org/jira/browse/SPARK-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746450#comment-14746450 ] Peng Cheng commented on SPARK-10625: branch: https://github.com/Schedule1/spark/tree/SPARK-10625 will

[jira] [Created] (SPARK-10625) Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties

Peng Cheng created SPARK-10625: -- Summary: Spark SQL JDBC read/write is unable to handle JDBC Drivers that adds unserializable objects into connection properties Key: SPARK-10625 URL:

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703585#comment-14703585 ] Peng Cheng commented on SPARK-7481: --- Thanks a lot! A long run to the end. Add Hadoop

[jira] [Commented] (SPARK-7442) Spark 1.3.1 / Hadoop 2.6 prebuilt pacakge has broken S3 filesystem access

[ https://issues.apache.org/jira/browse/SPARK-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582965#comment-14582965 ] Peng Cheng commented on SPARK-7442: --- Still not fixed in 1.4.0 ... reverting to hadoop

[jira] [Commented] (SPARK-7442) Spark 1.3.1 / Hadoop 2.6 prebuilt pacakge has broken S3 filesystem access

[ https://issues.apache.org/jira/browse/SPARK-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557820#comment-14557820 ] Peng Cheng commented on SPARK-7442: --- Adding jar won't solve the problem: you need to set

[jira] [Comment Edited] (SPARK-7442) Spark 1.3.1 / Hadoop 2.6 prebuilt pacakge has broken S3 filesystem access

[ https://issues.apache.org/jira/browse/SPARK-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557820#comment-14557820 ] Peng Cheng edited comment on SPARK-7442 at 5/24/15 6:55 PM:

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557549#comment-14557549 ] Peng Cheng commented on SPARK-7481: --- I've tried to do it but I get a lot of headaches,

[jira] [Commented] (SPARK-7043) KryoSerializer cannot be used with REPL to interpret code in which case class definition and its shipping are in the same line

[ https://issues.apache.org/jira/browse/SPARK-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507318#comment-14507318 ] Peng Cheng commented on SPARK-7043: --- Sorry, didn't read all the issues. Some of them may

[jira] [Created] (SPARK-7043) KryoSerializer cannot be used with REPL to interpret code in which case class definition and its shipping are in the same line

Peng Cheng created SPARK-7043: - Summary: KryoSerializer cannot be used with REPL to interpret code in which case class definition and its shipping are in the same line Key: SPARK-7043 URL:

[jira] [Commented] (SPARK-4590) Early investigation of parameter server

[ https://issues.apache.org/jira/browse/SPARK-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385029#comment-14385029 ] Peng Cheng commented on SPARK-4590: --- Hi Reza, that's great news. Can someone point us to

[jira] [Commented] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349760#comment-14349760 ] Peng Cheng commented on SPARK-4925: --- Me too, though the patch is applied in 1.2.1. We

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263681#comment-14263681 ] Peng Cheng commented on SPARK-4923: --- You are right, in fact 'Dev's API' simply means

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261185#comment-14261185 ] Peng Cheng commented on SPARK-4923: --- Hey, a guy waiting for it was complaining that the

[jira] [Commented] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

[ https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256228#comment-14256228 ] Peng Cheng commented on SPARK-3452: --- IMHO REPL should be kept being published, one of my

[jira] [Created] (SPARK-4923) Maven build should keep publishing spark-repl

Peng Cheng created SPARK-4923: - Summary: Maven build should keep publishing spark-repl Key: SPARK-4923 URL: https://issues.apache.org/jira/browse/SPARK-4923 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256319#comment-14256319 ] Peng Cheng commented on SPARK-4923: --- Hey Patrick, The following API has been integrated

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256322#comment-14256322 ] Peng Cheng commented on SPARK-4923: --- Sorry my project is

[jira] [Updated] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-4923: -- Attachment: SPARK-4923__Maven_build_should_keep_publishing_spark-repl.patch thank you so much! First

[jira] [Updated] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Cheng updated SPARK-4923: -- Target Version/s: 1.3.0, 1.2.1 (was: 1.3.0) Maven build should keep publishing spark-repl

[jira] [Commented] (SPARK-1270) An optimized gradient descent implementation

[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156964#comment-14156964 ] Peng Cheng commented on SPARK-1270: --- Yo, any follow up story on this one? I'm curious to

[jira] [Created] (SPARK-2083) Allow local task to retry after failure.

Peng Cheng created SPARK-2083: - Summary: Allow local task to retry after failure. Key: SPARK-2083 URL: https://issues.apache.org/jira/browse/SPARK-2083 Project: Spark Issue Type: Improvement