[jira] [Closed] (SPARK-15183) Adding outputMode to structure Streaming Experimental Api

2016-06-05 Thread Sachin Aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Aggarwal closed SPARK-15183. --- Resolution: Duplicate > Adding outputMode to structure Streaming Experimental Api >

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

2016-06-05 Thread Gaurav Shah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316222#comment-15316222 ] Gaurav Shah commented on SPARK-2984: seeing similar errors with spark 1.6 {noformat} App > Caused

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-06-05 Thread menda venugopal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316187#comment-15316187 ] menda venugopal commented on SPARK-13525: - Hi, We have problem with similar kind of issue where

[jira] [Commented] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc file

2016-06-05 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316170#comment-15316170 ] marymwu commented on SPARK-15757: - Actually, Field "inv_date_sk" does exist! We have executed "desc

[jira] [Issue Comment Deleted] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc

2016-06-05 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] marymwu updated SPARK-15757: Comment: was deleted (was: Actually, Field "inv_date_sk" does exist! We have executed "desc inventory",

[jira] [Updated] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc file

2016-06-05 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] marymwu updated SPARK-15757: Attachment: Result.png > Error occurs when using Spark sql "select" statement on orc file after hive >

[jira] [Commented] (SPARK-15757) Error occurs when using Spark sql "select" statement on orc file after hive sql "insert overwrite tb1 select * from sourcTb" has been executed on this orc file

2016-06-05 Thread marymwu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316168#comment-15316168 ] marymwu commented on SPARK-15757: - Actually, Field "inv_date_sk" does exist! We have executed "desc

[jira] [Commented] (SPARK-15046) When running hive-thriftserver with yarn on a secure cluster the workers fail with java.lang.NumberFormatException

2016-06-05 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316163#comment-15316163 ] Jie Huang commented on SPARK-15046: --- But the interesting thing is that the bug is not reproducing while

[jira] [Commented] (SPARK-15046) When running hive-thriftserver with yarn on a secure cluster the workers fail with java.lang.NumberFormatException

2016-06-05 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316162#comment-15316162 ] Jie Huang commented on SPARK-15046: --- Yes. I met the similar issue. And after that patch applied, it

[jira] [Updated] (SPARK-15704) TungstenAggregate crashes

2016-06-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15704: Assignee: (was: Koert Kuipers) > TungstenAggregate crashes > -- > >

[jira] [Updated] (SPARK-15704) TungstenAggregate crashes

2016-06-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15704: Assignee: Koert Kuipers > TungstenAggregate crashes > -- > >

[jira] [Resolved] (SPARK-15704) TungstenAggregate crashes

2016-06-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15704. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13446

[jira] [Resolved] (SPARK-15748) Replace inefficient foldLeft() call in PartitionStatistics

2016-06-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15748. - Resolution: Fixed Fix Version/s: 2.0.0 > Replace inefficient foldLeft() call in

[jira] [Resolved] (SPARK-15657) RowEncoder should validate the data type of input object

2016-06-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-15657. Resolution: Fixed Fix Version/s: 2.0.0 Resolved by

[jira] [Commented] (SPARK-12923) Optimize successive dapply() calls in SparkR

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316062#comment-15316062 ] Shivaram Venkataraman commented on SPARK-12923: --- [~sunrui] Can we move this from the UDFs

[jira] [Commented] (SPARK-15521) Add high level APIs based on dapply and gapply for easier usage

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316060#comment-15316060 ] Shivaram Venkataraman commented on SPARK-15521: --- [~sunrui] Can we move this from the UDFs

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316050#comment-15316050 ] Yan Chen commented on SPARK-15716: -- We think the behavior of using local directory is due to this piece

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316045#comment-15316045 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 10:11 PM: --- The same thing

[jira] [Updated] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Environment: Oracle Java 1.8.0_51, 1.8.0_85, 1.8.0_91 and 1.8.0_92 SUSE Linux, CentOS 6 and CentOS 7

[jira] [Updated] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Affects Version/s: 1.5.0 > Memory usage of driver keeps growing up in Spark Streaming >

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316045#comment-15316045 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 10:07 PM: --- The same thing

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316047#comment-15316047 ] Yan Chen commented on SPARK-15716: -- The memory usage goes up, and finally will make the whole streaming

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316045#comment-15316045 ] Yan Chen commented on SPARK-15716: -- The same thing happens on 1.6.0, 1.6.1, 2.0.0 preview. However, if I

[jira] [Updated] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Affects Version/s: 2.0.0 1.6.0 1.6.1 > Memory usage of

[jira] [Commented] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316040#comment-15316040 ] Apache Spark commented on SPARK-15773: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15773: Assignee: (was: Apache Spark) > Avoid creating local variable `sc` in examples if

[jira] [Assigned] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15773: Assignee: Apache Spark > Avoid creating local variable `sc` in examples if possible >

[jira] [Commented] (SPARK-13480) Regression with percentile() + function in GROUP BY

2016-06-05 Thread Abhinit Kumar Sinha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316037#comment-15316037 ] Abhinit Kumar Sinha commented on SPARK-13480: - Can I work on this issue? > Regression with

[jira] [Updated] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

2016-06-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15773: -- Summary: Avoid creating local variable `sc` in examples if possible (was: Avoid creating

[jira] [Created] (SPARK-15773) Avoid creating local variable `sc` in examples

2016-06-05 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-15773: - Summary: Avoid creating local variable `sc` in examples Key: SPARK-15773 URL: https://issues.apache.org/jira/browse/SPARK-15773 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15159) SparkSession R API

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316031#comment-15316031 ] Shivaram Venkataraman commented on SPARK-15159: --- [~felixcheung] Are you working on this ?

[jira] [Created] (SPARK-15772) Improve Scala API docs

2016-06-05 Thread nirav patel (JIRA)
nirav patel created SPARK-15772: --- Summary: Improve Scala API docs Key: SPARK-15772 URL: https://issues.apache.org/jira/browse/SPARK-15772 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

2016-06-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316017#comment-15316017 ] Xiao Li commented on SPARK-15691: - Sure, will follow your suggestions. Thanks! > Refactor and improve

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

2016-06-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316010#comment-15316010 ] Reynold Xin commented on SPARK-15691: - [~smilegator] -- do you mind using google docs for the design

[jira] [Issue Comment Deleted] (SPARK-14761) PySpark DataFrame.join should reject invalid join methods even when join columns are not specified

2016-06-05 Thread Bijay Kumar Pathak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bijay Kumar Pathak updated SPARK-14761: --- Comment: was deleted (was: Hi [~joshrosen], how do we handle the on=None while

[jira] [Commented] (SPARK-15545) R remove non-exported unused methods, like jsonRDD

2016-06-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315991#comment-15315991 ] Shivaram Venkataraman commented on SPARK-15545: --- That discussion was before we had UDFs

[jira] [Resolved] (SPARK-15770) annotation audit for Experimental and DeveloperApi

2016-06-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15770. - Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.0.0 > annotation audit

[jira] [Issue Comment Deleted] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Comment: was deleted (was: Actually I tried in another environment with version 1.6.1, memory leak

[jira] [Issue Comment Deleted] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Chen updated SPARK-15716: - Comment: was deleted (was: We already tried 1.6.0, it does not happen. Could I know what happens if the

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315972#comment-15315972 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 6:29 PM: -- Actually I tried in

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315972#comment-15315972 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 6:25 PM: -- Actually I tried in

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315972#comment-15315972 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 6:19 PM: -- Actually I tried in

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315972#comment-15315972 ] Yan Chen commented on SPARK-15716: -- Actually I tried in another environment with version 1.6.1, the same

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

2016-06-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315964#comment-15315964 ] Xiao Li commented on SPARK-15691: - In the PDF document, all the underlined text is are hyperlinks that

[jira] [Commented] (SPARK-15691) Refactor and improve Hive support

2016-06-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315960#comment-15315960 ] Xiao Li commented on SPARK-15691: - For refactoring {{HiveMetastoreCatalog.scala}}, I just finished the

[jira] [Commented] (SPARK-15723) SimpleDateParamSuite test is locale-fragile and relies on deprecated short TZ name

2016-06-05 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315938#comment-15315938 ] Brett Randall commented on SPARK-15723: --- Thanks for merging. And thanks for the Scala repl test -

[jira] [Updated] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

2016-06-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15771: Description: Since SPARK-15617 deprecated {{precision}} in {{MulticlassClassificationEvaluator}},

[jira] [Comment Edited] (SPARK-9834) Normal equation solver for ordinary least squares

2016-06-05 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315935#comment-15315935 ] Debasish Das edited comment on SPARK-9834 at 6/5/16 4:49 PM: - Do you have

[jira] [Updated] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

2016-06-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15771: Description: Since SPARK-15617 deprecated {{precision}} in {{MulticlassClassificationEvaluator}},

[jira] [Assigned] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15771: Assignee: Apache Spark > Many ML examples broken since we deprecated `precision` in >

[jira] [Commented] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315936#comment-15315936 ] Apache Spark commented on SPARK-15771: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15771: Assignee: (was: Apache Spark) > Many ML examples broken since we deprecated

[jira] [Commented] (SPARK-9834) Normal equation solver for ordinary least squares

2016-06-05 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315935#comment-15315935 ] Debasish Das commented on SPARK-9834: - Do you have runtime comparisons that when features <= 4096, OLS

[jira] [Created] (SPARK-15771) Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator

2016-06-05 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-15771: --- Summary: Many ML examples broken since we deprecated `precision` in MulticlassClassificationEvaluator Key: SPARK-15771 URL: https://issues.apache.org/jira/browse/SPARK-15771

[jira] [Resolved] (SPARK-15723) SimpleDateParamSuite test is locale-fragile and relies on deprecated short TZ name

2016-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15723. --- Resolution: Fixed Assignee: Brett Randall Fix Version/s: 2.0.0

[jira] [Commented] (SPARK-15723) SimpleDateParamSuite test is locale-fragile and relies on deprecated short TZ name

2016-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315898#comment-15315898 ] Sean Owen commented on SPARK-15723: --- Yeah I get the ambiguity problem. OK, so you're saying it doesn't

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315895#comment-15315895 ] Sean Owen commented on SPARK-15716: --- [~HalfVim] are you experiencing out of memory errors? it's normal

[jira] [Comment Edited] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314190#comment-15314190 ] Yan Chen edited comment on SPARK-15716 at 6/5/16 2:05 PM: -- I also tried to run

[jira] [Commented] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-05 Thread Yan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315890#comment-15315890 ] Yan Chen commented on SPARK-15716: -- We already tried 1.6.0, it does not happen. Could I know what

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-05 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315887#comment-15315887 ] Ran Haim commented on SPARK-15731: -- Fine, you can close it - if it works. I will use a work around. >

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315885#comment-15315885 ] Sean Owen commented on SPARK-15731: --- [~ran.h...@optimalplus.com] no, I removed "Target Version". Only

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-05 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315884#comment-15315884 ] Ran Haim commented on SPARK-15731: -- I am using Mapr distribution and they provide spark 1.5.1 :/ - so

[jira] [Updated] (SPARK-15731) orc writer directory permissions

2016-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15731: -- Affects Version/s: 1.5.1 [~ran.h...@optimalplus.com] best to indicate that in the JIRA then. Can you

[jira] [Commented] (SPARK-15472) Add partitioned `csv`, `json`, `text` format support for FileStreamSink

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315842#comment-15315842 ] Apache Spark commented on SPARK-15472: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Commented] (SPARK-15433) PySpark core test should not use SerDe from PythonMLLibAPI

2016-06-05 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315797#comment-15315797 ] Liang-Chi Hsieh commented on SPARK-15433: - [~davies] Can you set the assignee to me? Thanks. >

[jira] [Assigned] (SPARK-14839) Support for other types as option in OPTIONS clause

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14839: Assignee: (was: Apache Spark) > Support for other types as option in OPTIONS clause >

[jira] [Commented] (SPARK-14839) Support for other types as option in OPTIONS clause

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315783#comment-15315783 ] Apache Spark commented on SPARK-14839: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-14839) Support for other types as option in OPTIONS clause

2016-06-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14839: Assignee: Apache Spark > Support for other types as option in OPTIONS clause >

[jira] [Commented] (SPARK-15731) orc writer directory permissions

2016-06-05 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315782#comment-15315782 ] Ran Haim commented on SPARK-15731: -- Hi Kevin. it is pretty much the same, the only difference I see is

[jira] [Commented] (SPARK-15720) MLLIB Word2Vec loading large number of vectors in the model results in java.lang.NegativeArraySizeException

2016-06-05 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315776#comment-15315776 ] yuhao yang commented on SPARK-15720: Thanks for the feedback. I'd try to investigate possible