[jira] [Updated] (SPARK-15775) Spark 2.0 thrift server not starting in hadoop cluster.

[ https://issues.apache.org/jira/browse/SPARK-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Churchill updated SPARK-15775: -- Description: Hi There, Built the spark 2.0.0-preview version and started the thrift server in local m

[jira] [Updated] (SPARK-15775) Spark 2.0 thrift server not starting in hadoop cluster.

[ https://issues.apache.org/jira/browse/SPARK-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Churchill updated SPARK-15775: -- Summary: Spark 2.0 thrift server not starting in hadoop cluster. (was: Spark 2.0 thrift server not sta

[jira] [Updated] (SPARK-15775) Spark 2.0 thrift server not starting in cluster mode.

[ https://issues.apache.org/jira/browse/SPARK-15775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Churchill updated SPARK-15775: -- Attachment: screenshot-1.png > Spark 2.0 thrift server not starting in cluster mode. >

[jira] [Created] (SPARK-15775) Spark 2.0 thrift server not starting in cluster mode.

Churchill created SPARK-15775: - Summary: Spark 2.0 thrift server not starting in cluster mode. Key: SPARK-15775 URL: https://issues.apache.org/jira/browse/SPARK-15775 Project: Spark Issue Type: B

[jira] [Closed] (SPARK-15774) Spark 2.0 thrift server not starting in cluster mode.

[ https://issues.apache.org/jira/browse/SPARK-15774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Churchill closed SPARK-15774. - Resolution: Fixed Duplicate task > Spark 2.0 thrift server not starting in cluster mode. > -

[jira] [Created] (SPARK-15774) Spark 2.0 thrift server not starting in cluster mode.

Churchill created SPARK-15774: - Summary: Spark 2.0 thrift server not starting in cluster mode. Key: SPARK-15774 URL: https://issues.apache.org/jira/browse/SPARK-15774 Project: Spark Issue Type: B

[jira] [Closed] (SPARK-15183) Adding outputMode to structure Streaming Experimental Api

[ https://issues.apache.org/jira/browse/SPARK-15183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Aggarwal closed SPARK-15183. --- Resolution: Duplicate > Adding outputMode to structure Streaming Experimental Api > -

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316222#comment-15316222 ] Gaurav Shah commented on SPARK-2984: seeing similar errors with spark 1.6 {noformat}

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316187#comment-15316187 ] menda venugopal commented on SPARK-13525: - Hi, We have problem with similar kind

[jira] [Commented] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc file

[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316170#comment-15316170 ] marymwu commented on SPARK-15757: - Actually, Field "inv_date_sk" does exist! We have exec

[jira] [Issue Comment Deleted] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc

[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] marymwu updated SPARK-15757: Comment: was deleted (was: Actually, Field "inv_date_sk" does exist! We have executed "desc inventory", t

[jira] [Updated] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc file

[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] marymwu updated SPARK-15757: Attachment: Result.png > Error occurs when using Spark sql "select" statement on orc file after hive > sql

[jira] [Commented] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc file

[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316168#comment-15316168 ] marymwu commented on SPARK-15757: - Actually, Field "inv_date_sk" does exist! We have exe

[jira] [Commented] (SPARK-15046) When running hive-thriftserver with yarn on a secure cluster the workers fail with java.lang.NumberFormatException

[ https://issues.apache.org/jira/browse/SPARK-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316163#comment-15316163 ] Jie Huang commented on SPARK-15046: --- But the interesting thing is that the bug is not r

[jira] [Commented] (SPARK-15046) When running hive-thriftserver with yarn on a secure cluster the workers fail with java.lang.NumberFormatException

[ https://issues.apache.org/jira/browse/SPARK-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316162#comment-15316162 ] Jie Huang commented on SPARK-15046: --- Yes. I met the similar issue. And after that patch

[jira] [Updated] (SPARK-15704) TungstenAggregate crashes

[ https://issues.apache.org/jira/browse/SPARK-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15704: Assignee: (was: Koert Kuipers) > TungstenAggregate crashes > -- > >

[jira] [Updated] (SPARK-15704) TungstenAggregate crashes

[ https://issues.apache.org/jira/browse/SPARK-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15704: Assignee: Koert Kuipers > TungstenAggregate crashes > -- > >

[jira] [Resolved] (SPARK-15704) TungstenAggregate crashes

[ https://issues.apache.org/jira/browse/SPARK-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15704. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13446 [https://githu

[jira] [Resolved] (SPARK-15748) Replace inefficient foldLeft() call in PartitionStatistics

[ https://issues.apache.org/jira/browse/SPARK-15748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15748. - Resolution: Fixed Fix Version/s: 2.0.0 > Replace inefficient foldLeft() call in PartitionS

[jira] [Resolved] (SPARK-15657) RowEncoder should validate the data type of input object

[ https://issues.apache.org/jira/browse/SPARK-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-15657. Resolution: Fixed Fix Version/s: 2.0.0 Resolved by https://github.com/apache/spark/pull/1340

[jira] [Commented] (SPARK-12923) Optimize successive dapply() calls in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316062#comment-15316062 ] Shivaram Venkataraman commented on SPARK-12923: --- [~sunrui] Can we move this

[jira] [Commented] (SPARK-15521) Add high level APIs based on dapply and gapply for easier usage

[ https://issues.apache.org/jira/browse/SPARK-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316060#comment-15316060 ] Shivaram Venkataraman commented on SPARK-15521: --- [~sunrui] Can we move this

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316050#comment-15316050 ] Yan Chen commented on SPARK-15716: -- We think the behavior of using local directory is du

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316045#comment-15316045 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 10:11 PM: --- The

[jira] [Updated] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Environment: Oracle Java 1.8.0_51, 1.8.0_85, 1.8.0_91 and 1.8.0_92 SUSE Linux, CentOS 6 and CentOS 7 w

[jira] [Updated] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Affects Version/s: 1.5.0 > Memory usage of driver keeps growing up in Spark Streaming > -

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316045#comment-15316045 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 10:07 PM: --- The

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316047#comment-15316047 ] Yan Chen commented on SPARK-15716: -- The memory usage goes up, and finally will make the

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316045#comment-15316045 ] Yan Chen commented on SPARK-15716: -- The same thing happens on 1.6.0, 1.6.1, 2.0.0 previe

[jira] [Updated] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Affects Version/s: 2.0.0 1.6.0 1.6.1 > Memory usage of driv

[jira] [Commented] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316040#comment-15316040 ] Apache Spark commented on SPARK-15773: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15773: Assignee: (was: Apache Spark) > Avoid creating local variable `sc` in examples if poss

[jira] [Assigned] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15773: Assignee: Apache Spark > Avoid creating local variable `sc` in examples if possible >

[jira] [Commented] (SPARK-13480) Regression with percentile() + function in GROUP BY

[ https://issues.apache.org/jira/browse/SPARK-13480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316037#comment-15316037 ] Abhinit Kumar Sinha commented on SPARK-13480: - Can I work on this issue? > R

[jira] [Updated] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15773: -- Summary: Avoid creating local variable `sc` in examples if possible (was: Avoid creating local

[jira] [Created] (SPARK-15773) Avoid creating local variable `sc` in examples

Dongjoon Hyun created SPARK-15773: - Summary: Avoid creating local variable `sc` in examples Key: SPARK-15773 URL: https://issues.apache.org/jira/browse/SPARK-15773 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15159) SparkSession R API

[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316031#comment-15316031 ] Shivaram Venkataraman commented on SPARK-15159: --- [~felixcheung] Are you wor

[jira] [Created] (SPARK-15772) Improve Scala API docs

nirav patel created SPARK-15772: --- Summary: Improve Scala API docs Key: SPARK-15772 URL: https://issues.apache.org/jira/browse/SPARK-15772 Project: Spark Issue Type: Improvement Compo

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316017#comment-15316017 ] Xiao Li commented on SPARK-15691: - Sure, will follow your suggestions. Thanks! > Refacto

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316010#comment-15316010 ] Reynold Xin commented on SPARK-15691: - [~smilegator] -- do you mind using google docs

[jira] [Issue Comment Deleted] (SPARK-14761) PySpark DataFrame.join should reject invalid join methods even when join columns are not specified

[ https://issues.apache.org/jira/browse/SPARK-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bijay Kumar Pathak updated SPARK-14761: --- Comment: was deleted (was: Hi [~joshrosen], how do we handle the on=None while passin

[jira] [Commented] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315991#comment-15315991 ] Shivaram Venkataraman commented on SPARK-15545: --- That discussion was before

[jira] [Resolved] (SPARK-15770) annotation audit for Experimental and DeveloperApi

[ https://issues.apache.org/jira/browse/SPARK-15770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15770. - Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.0.0 > annotation audit

[jira] [Issue Comment Deleted] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Comment: was deleted (was: Actually I tried in another environment with version 1.6.1, memory leak showe

[jira] [Issue Comment Deleted] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Comment: was deleted (was: We already tried 1.6.0, it does not happen. Could I know what happens if the

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315972#comment-15315972 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 6:29 PM: -- Actua

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315972#comment-15315972 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 6:25 PM: -- Actua

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315972#comment-15315972 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 6:19 PM: -- Actua

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315972#comment-15315972 ] Yan Chen commented on SPARK-15716: -- Actually I tried in another environment with version

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315964#comment-15315964 ] Xiao Li commented on SPARK-15691: - In the PDF document, all the underlined text is are hy

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315960#comment-15315960 ] Xiao Li commented on SPARK-15691: - For refactoring {{HiveMetastoreCatalog.scala}}, I just

[jira] [Commented] (SPARK-15723) SimpleDateParamSuite test is locale-fragile and relies on deprecated short TZ name

[ https://issues.apache.org/jira/browse/SPARK-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315938#comment-15315938 ] Brett Randall commented on SPARK-15723: --- Thanks for merging. And thanks for the Sc

[jira] [Updated] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15771: Description: Since SPARK-15617 deprecated {{precision}} in {{MulticlassClassificationEvaluator}},

[jira] [Comment Edited] (SPARK-9834) Normal equation solver for ordinary least squares

[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315935#comment-15315935 ] Debasish Das edited comment on SPARK-9834 at 6/5/16 4:49 PM: -

[jira] [Updated] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15771: Description: Since SPARK-15617 deprecated {{precision}} in {{MulticlassClassificationEvaluator}}, m

[jira] [Assigned] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15771: Assignee: Apache Spark > Many ML examples broken since we deprecated `precision` in > Mul

[jira] [Assigned] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15771: Assignee: (was: Apache Spark) > Many ML examples broken since we deprecated `precision

[jira] [Commented] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315936#comment-15315936 ] Apache Spark commented on SPARK-15771: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-9834) Normal equation solver for ordinary least squares

[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315935#comment-15315935 ] Debasish Das commented on SPARK-9834: - Do you have runtime comparisons that when featu

[jira] [Created] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

Yanbo Liang created SPARK-15771: --- Summary: Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator Key: SPARK-15771 URL: https://issues.apache.org/jira/browse/SPARK-15771

[jira] [Resolved] (SPARK-15723) SimpleDateParamSuite test is locale-fragile and relies on deprecated short TZ name

[ https://issues.apache.org/jira/browse/SPARK-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15723. --- Resolution: Fixed Assignee: Brett Randall Fix Version/s: 2.0.0 1.6.

[jira] [Commented] (SPARK-15723) SimpleDateParamSuite test is locale-fragile and relies on deprecated short TZ name

[ https://issues.apache.org/jira/browse/SPARK-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315898#comment-15315898 ] Sean Owen commented on SPARK-15723: --- Yeah I get the ambiguity problem. OK, so you're sa

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315895#comment-15315895 ] Sean Owen commented on SPARK-15716: --- [~HalfVim] are you experiencing out of memory erro

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15314190#comment-15314190 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 2:05 PM: -- I als

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315890#comment-15315890 ] Yan Chen commented on SPARK-15716: -- We already tried 1.6.0, it does not happen. Could I

[jira] [Commented] (SPARK-15731) orc writer directory permissions

[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315887#comment-15315887 ] Ran Haim commented on SPARK-15731: -- Fine, you can close it - if it works. I will use a w

[jira] [Commented] (SPARK-15731) orc writer directory permissions

[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315885#comment-15315885 ] Sean Owen commented on SPARK-15731: --- [~ran.h...@optimalplus.com] no, I removed "Target

[jira] [Commented] (SPARK-15731) orc writer directory permissions

[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315884#comment-15315884 ] Ran Haim commented on SPARK-15731: -- I am using Mapr distribution and they provide spark

[jira] [Updated] (SPARK-15731) orc writer directory permissions

[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15731: -- Affects Version/s: 1.5.1 [~ran.h...@optimalplus.com] best to indicate that in the JIRA then. Can you tr

[jira] [Commented] (SPARK-15472) Add partitioned `csv`, `json`, `text` format support for FileStreamSink

[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315842#comment-15315842 ] Apache Spark commented on SPARK-15472: -- User 'lw-lin' has created a pull request for

[jira] [Commented] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

[ https://issues.apache.org/jira/browse/SPARK-15433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315797#comment-15315797 ] Liang-Chi Hsieh commented on SPARK-15433: - [~davies] Can you set the assignee to

[jira] [Assigned] (SPARK-14839) Support for other types as option in OPTIONS clause

[ https://issues.apache.org/jira/browse/SPARK-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14839: Assignee: (was: Apache Spark) > Support for other types as option in OPTIONS clause >

[jira] [Commented] (SPARK-14839) Support for other types as option in OPTIONS clause

[ https://issues.apache.org/jira/browse/SPARK-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315783#comment-15315783 ] Apache Spark commented on SPARK-14839: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-14839) Support for other types as option in OPTIONS clause

[ https://issues.apache.org/jira/browse/SPARK-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14839: Assignee: Apache Spark > Support for other types as option in OPTIONS clause > ---

[jira] [Commented] (SPARK-15731) orc writer directory permissions

[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15315782#comment-15315782 ] Ran Haim commented on SPARK-15731: -- Hi Kevin. it is pretty much the same, the only diff