[jira] [Created] (SPARK-16912) Wrong import in Machine Learning documentation

2016-08-05 Thread Ganesh Krishnan (JIRA)
Ganesh Krishnan created SPARK-16912: --- Summary: Wrong import in Machine Learning documentation Key: SPARK-16912 URL: https://issues.apache.org/jira/browse/SPARK-16912 Project: Spark Issue T

[jira] [Commented] (SPARK-16912) Wrong import in Machine Learning documentation

2016-08-05 Thread Ganesh Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409021#comment-15409021 ] Ganesh Krishnan commented on SPARK-16912: - How can I assign this to myself? I can

[jira] [Resolved] (SPARK-16912) Wrong import in Machine Learning documentation

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16912. --- Resolution: Not A Problem You don't need to be assigned to work on it. But this is already fixed in

[jira] [Commented] (SPARK-16912) Wrong import in Machine Learning documentation

2016-08-05 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409045#comment-15409045 ] Jagadeesan A S commented on SPARK-16912: Please go ahead and start doing it. This

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409047#comment-15409047 ] Yanbo Liang commented on SPARK-16872: - +1 [~mlnick] But currently {{ml.NaiveBayes}} i

[jira] [Issue Comment Deleted] (SPARK-16912) Wrong import in Machine Learning documentation

2016-08-05 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S updated SPARK-16912: --- Comment: was deleted (was: Please go ahead and start doing it. This will assign to you after

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409048#comment-15409048 ] zhengruifeng commented on SPARK-16872: -- I am working on it. When finished, I will ma

[jira] [Updated] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16872: Issue Type: New Feature (was: Brainstorming) > Include Gaussian Naive Bayes Classifier > -

[jira] [Updated] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16872: Priority: Major (was: Minor) > Include Gaussian Naive Bayes Classifier > -

[jira] [Updated] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-16872: Assignee: zhengruifeng > Include Gaussian Naive Bayes Classifier >

[jira] [Commented] (SPARK-16908) Java code style guideline documentation

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409060#comment-15409060 ] Sean Owen commented on SPARK-16908: --- Sure, you just want that sentence added to the wik

[jira] [Resolved] (SPARK-16580) [WARN] class Accumulator in package spark is deprecated: use AccumulatorV2

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16580. --- Resolution: Duplicate > [WARN] class Accumulator in package spark is deprecated: use AccumulatorV2 >

[jira] [Commented] (SPARK-16910) Infrastructure Projects name update in Supplemental Spark Projects

2016-08-05 Thread Qi Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409065#comment-15409065 ] Qi Li commented on SPARK-16910: --- Thanks for your quick action :) > Infrastructure Projects

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409071#comment-15409071 ] Yanbo Liang commented on SPARK-16872: - [~podongfeng] This task can be worked together

[jira] [Updated] (SPARK-14077) Support weighted instances in naive Bayes

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-14077: Shepherd: Yanbo Liang Assignee: zhengruifeng > Support weighted instances in naive Bayes >

[jira] [Commented] (SPARK-16872) Include Gaussian Naive Bayes Classifier

2016-08-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409086#comment-15409086 ] Nick Pentreath commented on SPARK-16872: Sounds good to me > Include Gaussian Na

[jira] [Resolved] (SPARK-15726) Make DatasetBenchmark fairer among Dataset, DataFrame and RDD

2016-08-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15726. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 13459 [https://githu

[jira] [Updated] (SPARK-15726) Make DatasetBenchmark fairer among Dataset, DataFrame and RDD

2016-08-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15726: Assignee: Hiroshi Inoue > Make DatasetBenchmark fairer among Dataset, DataFrame and RDD > -

[jira] [Updated] (SPARK-16911) Remove migrating from a Spark 1.x version in programming guide documentation

2016-08-05 Thread Shivansh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivansh updated SPARK-16911: - Summary: Remove migrating from a Spark 1.x version in programming guide documentation (was: Fix broken l

[jira] [Commented] (SPARK-16908) Java code style guideline documentation

2016-08-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409159#comment-15409159 ] Hyukjin Kwon commented on SPARK-16908: -- Thanks! Yes. I just want to be sure on Java

[jira] [Commented] (SPARK-16893) Spark CSV Provider option is not documented

2016-08-05 Thread Aseem Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409183#comment-15409183 ] Aseem Bansal commented on SPARK-16893: -- Reading a CSV causes an exception. Code used

[jira] [Resolved] (SPARK-16879) unify logical plans for CREATE TABLE and CTAS

2016-08-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16879. --- Resolution: Fixed Fix Version/s: 2.1.0 > unify logical plans for CREATE TABLE

[jira] [Commented] (SPARK-16893) Spark CSV Provider option is not documented

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409201#comment-15409201 ] Sean Owen commented on SPARK-16893: --- You don't need that format line at all right? It s

[jira] [Updated] (SPARK-16911) Remove migrating to a Spark 1.x version in programming guide documentation

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16911: -- Priority: Minor (was: Trivial) Summary: Remove migrating to a Spark 1.x version in programming gui

[jira] [Resolved] (SPARK-16908) Java code style guideline documentation

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16908. --- Resolution: Done Assignee: Sean Owen > Java code style guideline documentation > --

[jira] [Updated] (SPARK-16908) Java code style guideline documentation

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16908: -- Priority: Trivial (was: Minor) > Java code style guideline documentation > ---

[jira] [Resolved] (SPARK-16312) Docs for Kafka 0.10 consumer integration

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16312. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Updated] (SPARK-16312) Docs for Kafka 0.10 consumer integration

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16312: -- Assignee: Cody Koeninger > Docs for Kafka 0.10 consumer integration > -

[jira] [Created] (SPARK-16913) Better codegen where querying nested struct

2016-08-05 Thread JIRA
Maciej Bryński created SPARK-16913: -- Summary: Better codegen where querying nested struct Key: SPARK-16913 URL: https://issues.apache.org/jira/browse/SPARK-16913 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-16893) Spark CSV Provider option is not documented

2016-08-05 Thread Aseem Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409260#comment-15409260 ] Aseem Bansal commented on SPARK-16893: -- Yes. I would expect it to work without the u

[jira] [Updated] (SPARK-16913) [SQL] Better codegen where querying nested struct

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16913: --- Summary: [SQL] Better codegen where querying nested struct (was: Better codegen where queryi

[jira] [Updated] (SPARK-16913) [SQL] Better codegen where querying nested struct

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-16913: --- Issue Type: Improvement (was: Bug) > [SQL] Better codegen where querying nested struct > ---

[jira] [Commented] (SPARK-16893) Spark CSV Provider option is not documented

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409270#comment-15409270 ] Sean Owen commented on SPARK-16893: --- Just omit the .format() call. I'm saying that is t

[jira] [Created] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread cen yuhai (JIRA)
cen yuhai created SPARK-16914: - Summary: NodeManager crash when spark are registering executor infomartion into leveldb Key: SPARK-16914 URL: https://issues.apache.org/jira/browse/SPARK-16914 Project: Spa

[jira] [Updated] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-16914: -- Description: Stack: [0x7fb5b53de000,0x7fb5b54df000], sp=0x7fb5b54dcba8, free space=1018k

[jira] [Updated] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Tian updated SPARK-16914: Description: {noformat} Stack: [0x7fb5b53de000,0x7fb5b54df000], sp=0x7fb5b54dcba8, free spac

[jira] [Updated] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-16914: -- Description: Stack: [0x7fb5b53de000,0x7fb5b54df000], sp=0x7fb5b54dcba8, free space=1018k

[jira] [Updated] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread Yi Tian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Tian updated SPARK-16914: Description: {noformat} Stack: [0x7fb5b53de000,0x7fb5b54df000], sp=0x7fb5b54dcba8, free spac

[jira] [Updated] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-16914: -- Description: {noformat} Stack: [0x7fb5b53de000,0x7fb5b54df000], sp=0x7fb5b54dcba8, free

[jira] [Closed] (SPARK-16912) Wrong import in Machine Learning documentation

2016-08-05 Thread Ganesh Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ganesh Krishnan closed SPARK-16912. --- Already fixed in master > Wrong import in Machine Learning documentation >

[jira] [Created] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-16915: -- Summary: broadcast var cause Task not serializable exception when broadcast var is a class member Key: SPARK-16915 URL: https://issues.apache.org/jira/browse/SPARK-16915

[jira] [Updated] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16915: --- Description: --- import org.apache.spark.Spar

[jira] [Updated] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16915: --- Description: import org.apache.spark.SparkContext import org.apache.spark.rdd.RDD class C1(val rdd1

[jira] [Updated] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16915: --- Description: import org.apache.spark.SparkContext import org.apache.spark.rdd.RDD class C1(val rdd1:

[jira] [Updated] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16915: --- Description: import org.apache.spark.SparkContext import org.apache.spark.rdd.RDD class C1(val rdd1:

[jira] [Updated] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16915: --- Description: import org.apache.spark.SparkContext import org.apache.spark.rdd.RDD class C1(val rdd1:

[jira] [Updated] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16915: --- Description: import org.apache.spark.SparkContext import org.apache.spark.rdd.RDD class C1(val rdd1:

[jira] [Updated] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16915: --- Description: import org.apache.spark.SparkContext import org.apache.spark.rdd.RDD class C1(val rdd1:

[jira] [Closed] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu closed SPARK-16915. -- Resolution: Not A Bug > broadcast var cause Task not serializable exception when broadcast var is a >

[jira] [Commented] (SPARK-16915) broadcast var cause Task not serializable exception when broadcast var is a class member

2016-08-05 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409409#comment-15409409 ] Weichen Xu commented on SPARK-16915: I know the reason, not a bug,.. it will serializ

[jira] [Created] (SPARK-16916) serde/storage properties should not have limitations

2016-08-05 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-16916: --- Summary: serde/storage properties should not have limitations Key: SPARK-16916 URL: https://issues.apache.org/jira/browse/SPARK-16916 Project: Spark Issue Type

[jira] [Assigned] (SPARK-16916) serde/storage properties should not have limitations

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16916: Assignee: Apache Spark (was: Wenchen Fan) > serde/storage properties should not have limi

[jira] [Assigned] (SPARK-16916) serde/storage properties should not have limitations

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16916: Assignee: Wenchen Fan (was: Apache Spark) > serde/storage properties should not have limi

[jira] [Commented] (SPARK-16916) serde/storage properties should not have limitations

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409467#comment-15409467 ] Apache Spark commented on SPARK-16916: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-16917) Spark streaming kafka version compatibility.

2016-08-05 Thread Sudev (JIRA)
Sudev created SPARK-16917: - Summary: Spark streaming kafka version compatibility. Key: SPARK-16917 URL: https://issues.apache.org/jira/browse/SPARK-16917 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-16917) Spark streaming kafka version compatibility.

2016-08-05 Thread Sudev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudev updated SPARK-16917: -- Description: It would be nice to have Kafka version compatibility information in the official documentation.

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-08-05 Thread Laurent Hoss (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409502#comment-15409502 ] Laurent Hoss commented on SPARK-16522: -- Is this gonna be fixed soon (2.0.1) ?! I jus

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-08-05 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409514#comment-15409514 ] Sun Rui commented on SPARK-16522: - sure. The PR is under review > [MESOS] Spark applicat

[jira] [Created] (SPARK-16918) Weird error when selecting more than 100 spark udf columns

2016-08-05 Thread Phi Hung LE (JIRA)
Phi Hung LE created SPARK-16918: --- Summary: Weird error when selecting more than 100 spark udf columns Key: SPARK-16918 URL: https://issues.apache.org/jira/browse/SPARK-16918 Project: Spark Issu

[jira] [Commented] (SPARK-14151) Propose to refactor and expose Metrics Sink and Source interface

2016-08-05 Thread G Lingle (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409535#comment-15409535 ] G Lingle commented on SPARK-14151: -- Hi, This is quite an important Jira for us, as we ha

[jira] [Created] (SPARK-16919) Configurable update interval for console progress bar

2016-08-05 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-16919: --- Summary: Configurable update interval for console progress bar Key: SPARK-16919 URL: https://issues.apache.org/jira/browse/SPARK-16919 Project: Spark Issue Typ

[jira] [Commented] (SPARK-16919) Configurable update interval for console progress bar

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409540#comment-15409540 ] Apache Spark commented on SPARK-16919: -- User 'tejasapatil' has created a pull reques

[jira] [Assigned] (SPARK-16919) Configurable update interval for console progress bar

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16919: Assignee: (was: Apache Spark) > Configurable update interval for console progress bar

[jira] [Assigned] (SPARK-16919) Configurable update interval for console progress bar

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16919: Assignee: Apache Spark > Configurable update interval for console progress bar > -

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-08-05 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409556#comment-15409556 ] Michael Gummelt commented on SPARK-16522: - How did the job fail? Return non-zero

[jira] [Updated] (SPARK-16804) Correlated subqueries containing non-deterministic operators return incorrect results

2016-08-05 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-16804: Summary: Correlated subqueries containing non-deterministic operators return incorr

[jira] [Resolved] (SPARK-16625) Oracle JDBC table creation fails with ORA-00902: invalid datatype

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16625. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14377 [https://github.co

[jira] [Updated] (SPARK-16625) Oracle JDBC table creation fails with ORA-00902: invalid datatype

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16625: -- Assignee: Yuming Wang > Oracle JDBC table creation fails with ORA-00902: invalid datatype > ---

[jira] [Commented] (SPARK-16917) Spark streaming kafka version compatibility.

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409570#comment-15409570 ] Sean Owen commented on SPARK-16917: --- Yes I think the new "0.10" integration supports th

[jira] [Updated] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-16914: -- Description: {noformat} Stack: [0x7fb5b53de000,0x7fb5b54df000], sp=0x7fb5b54dcba8, free

[jira] [Updated] (SPARK-16914) NodeManager crash when spark are registering executor infomartion into leveldb

2016-08-05 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-16914: -- Description: {noformat} Stack: [0x7fb5b53de000,0x7fb5b54df000], sp=0x7fb5b54dcba8, free

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409615#comment-15409615 ] Mikael Ståldal commented on SPARK-6305: --- What is the idea behind the {{org.apache.sp

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409613#comment-15409613 ] Mikael Ståldal commented on SPARK-6305: --- I don't really understand why standalone ex

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409626#comment-15409626 ] Mikael Ståldal commented on SPARK-6305: --- What is {{TestHive}} used for? > Add suppo

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-08-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409629#comment-15409629 ] Yanbo Liang commented on SPARK-3181: [~dbtsai] Yes, we can have {{HuberAggregator}} in

[jira] [Commented] (SPARK-16750) ML GaussianMixture training failed due to feature column type mistake

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409632#comment-15409632 ] Apache Spark commented on SPARK-16750: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-16917) Spark streaming kafka version compatibility.

2016-08-05 Thread Sudev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudev updated SPARK-16917: -- Description: It would be nice to have Kafka version compatibility information in the official documentation.

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409646#comment-15409646 ] Mikael Ståldal commented on SPARK-6305: --- It might not be necessary to load logging c

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409655#comment-15409655 ] Mikael Ståldal commented on SPARK-6305: --- It should not be necessary to do explicit l

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-08-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409660#comment-15409660 ] Mikael Ståldal commented on SPARK-6305: --- For unit tests, you can put a logging confi

[jira] [Commented] (SPARK-16883) SQL decimal type is not properly cast to number when collecting SparkDataFrame

2016-08-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409691#comment-15409691 ] Shivaram Venkataraman commented on SPARK-16883: --- The thing to check then is

[jira] [Created] (SPARK-16920) Investigate and fix issues introduced in SPARK-15858

2016-08-05 Thread Vladimir Feinberg (JIRA)
Vladimir Feinberg created SPARK-16920: - Summary: Investigate and fix issues introduced in SPARK-15858 Key: SPARK-16920 URL: https://issues.apache.org/jira/browse/SPARK-16920 Project: Spark

[jira] [Updated] (SPARK-16920) Investigate and fix issues introduced in SPARK-15858

2016-08-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16920: -- Issue Type: Improvement (was: Bug) > Investigate and fix issues introduced in SPARK-15

[jira] [Commented] (SPARK-5312) Use sbt to detect new or changed public classes in PRs

2016-08-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409767#comment-15409767 ] Nicholas Chammas commented on SPARK-5312: - [~boyork] - Shall we close this? It doe

[jira] [Closed] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

2016-08-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas closed SPARK-7505. --- Resolution: Invalid Closing this as invalid as I believe these issues are no longer important.

[jira] [Created] (SPARK-16921) RDD/DataFrame persist() and cache() should return Python context managers

2016-08-05 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-16921: Summary: RDD/DataFrame persist() and cache() should return Python context managers Key: SPARK-16921 URL: https://issues.apache.org/jira/browse/SPARK-16921 Pro

[jira] [Resolved] (SPARK-5312) Use sbt to detect new or changed public classes in PRs

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5312. -- Resolution: Won't Fix > Use sbt to detect new or changed public classes in PRs > ---

[jira] [Commented] (SPARK-16610) When writing ORC files, orc.compress should not be overridden if users do not set "compression" in the options

2016-08-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409801#comment-15409801 ] Yin Huai commented on SPARK-16610: -- Sure. For ORC, {{orc.compression}} is the actual con

[jira] [Created] (SPARK-16922) Query failure due to executor OOM in Spark 2.0

2016-08-05 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-16922: --- Summary: Query failure due to executor OOM in Spark 2.0 Key: SPARK-16922 URL: https://issues.apache.org/jira/browse/SPARK-16922 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16922) Query failure due to executor OOM in Spark 2.0

2016-08-05 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409813#comment-15409813 ] Sital Kedia commented on SPARK-16922: - cc - [~rxin] > Query failure due to executor

[jira] [Commented] (SPARK-16905) Support SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409830#comment-15409830 ] Apache Spark commented on SPARK-16905: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-16905) Support SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16905: Assignee: Davies Liu (was: Apache Spark) > Support SQL DDL: MSCK REPAIR TABLE > -

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409829#comment-15409829 ] Sean Owen commented on SPARK-6305: -- The problem, I think, is that then this would not tak

[jira] [Assigned] (SPARK-16905) Support SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16905: Assignee: Apache Spark (was: Davies Liu) > Support SQL DDL: MSCK REPAIR TABLE > -

[jira] [Commented] (SPARK-16922) Query failure due to executor OOM in Spark 2.0

2016-08-05 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409878#comment-15409878 ] Sital Kedia commented on SPARK-16922: - PS - Rerunning the query with spark.sql.codege

[jira] [Resolved] (SPARK-16826) java.util.Hashtable limits the throughput of PARSE_URL()

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16826. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14488 [https://github.co

[jira] [Resolved] (SPARK-16421) Improve output from ML examples

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16421. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14308 [https://github.co

[jira] [Resolved] (SPARK-16260) PySpark ML Example Improvements and Cleanup

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16260. --- Resolution: Done Assignee: Bryan Cutler > PySpark ML Example Improvements and Cleanup > ---

[jira] [Updated] (SPARK-16826) java.util.Hashtable limits the throughput of PARSE_URL()

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16826: -- Assignee: Sylvain Zimmer > java.util.Hashtable limits the throughput of PARSE_URL() > -

[jira] [Updated] (SPARK-16421) Improve output from ML examples

2016-08-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16421: -- Assignee: Bryan Cutler Priority: Major (was: Trivial) > Improve output from ML examples >

  1   2   >