[jira] [Assigned] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

2015-12-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12395: -- Assignee: Davies Liu > Result of DataFrame.join(usingColumns) could be wrong for outer join >

[jira] [Created] (SPARK-12401) Add support for enums in postgres

2015-12-17 Thread Jaka Jancar (JIRA)
Jaka Jancar created SPARK-12401: --- Summary: Add support for enums in postgres Key: SPARK-12401 URL: https://issues.apache.org/jira/browse/SPARK-12401 Project: Spark Issue Type: New Feature

[jira] [Closed] (SPARK-10852) DataFrame aggregated column cannot be accessed properly

2015-12-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-10852. --- Resolution: Won't Fix As discussed in https://github.com/apache/spark/pull/8934 > DataFrame

[jira] [Commented] (SPARK-10500) sparkr.zip cannot be created if $SPARK_HOME/R/lib is unwritable

2015-12-17 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061730#comment-15061730 ] Saisai Shao commented on SPARK-10500: - [~sunrui] It would be better to back port to 1.5 if possible,

[jira] [Commented] (SPARK-12377) Wrong implementation for Row.__call__ in pyspark

2015-12-17 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061749#comment-15061749 ] somil deshmukh commented on SPARK-12377: I would like to work on this issue > Wrong

[jira] [Assigned] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12395: Assignee: (was: Apache Spark) > Result of DataFrame.join(usingColumns) could be wrong

[jira] [Assigned] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12395: Assignee: Apache Spark > Result of DataFrame.join(usingColumns) could be wrong for outer

[jira] [Created] (SPARK-12402) Memory leak in broadcast hash join

2015-12-17 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12402: -- Summary: Memory leak in broadcast hash join Key: SPARK-12402 URL: https://issues.apache.org/jira/browse/SPARK-12402 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061761#comment-15061761 ] Yanbo Liang commented on SPARK-12363: - {quote} Does it improve if you increase the number of

[jira] [Commented] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061764#comment-15061764 ] Apache Spark commented on SPARK-7425: - User 'BenFradet' has created a pull request for this issue:

[jira] [Assigned] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7425: --- Assignee: Apache Spark > spark.ml Predictor should support other numeric types for label >

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061761#comment-15061761 ] Yanbo Liang edited comment on SPARK-12363 at 12/17/15 9:19 AM: --- {quote}

[jira] [Commented] (SPARK-12377) Wrong implementation for Row.__call__ in pyspark

2015-12-17 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061817#comment-15061817 ] somil deshmukh commented on SPARK-12377: https://github.com/apache/spark/pull/10356 > Wrong

[jira] [Updated] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2015-12-17 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12404: --- Description: Now `StaticInvoke` receives Any as a object and StaticInvoke can be serialized

[jira] [Assigned] (SPARK-7425) spark.ml Predictor should support other numeric types for label

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7425: --- Assignee: (was: Apache Spark) > spark.ml Predictor should support other numeric types

[jira] [Created] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2015-12-17 Thread Lunen (JIRA)
Lunen created SPARK-12403: - Summary: "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore Key: SPARK-12403 URL: https://issues.apache.org/jira/browse/SPARK-12403 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12377) Wrong implementation for Row.__call__ in pyspark

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12377: Assignee: Apache Spark > Wrong implementation for Row.__call__ in pyspark >

[jira] [Assigned] (SPARK-12377) Wrong implementation for Row.__call__ in pyspark

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12377: Assignee: (was: Apache Spark) > Wrong implementation for Row.__call__ in pyspark >

[jira] [Commented] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061827#comment-15061827 ] Apache Spark commented on SPARK-12404: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12404: Assignee: Apache Spark (was: Kousuke Saruta) > Ensure objects passed to StaticInvoke is

[jira] [Commented] (SPARK-12384) Allow -Xms to be set differently then -Xmx

2015-12-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061835#comment-15061835 ] Jeff Zhang commented on SPARK-12384: Correct, the memory is controlled by cluster manager, set

[jira] [Commented] (SPARK-12262) describe extended doesn't return table on detail info tabled stored as PARQUET format

2015-12-17 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061863#comment-15061863 ] Jayadevan M commented on SPARK-12262: - I was able to replicate this issue. I would like to work on

[jira] [Comment Edited] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

2015-12-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061761#comment-15061761 ] Yanbo Liang edited comment on SPARK-12363 at 12/17/15 9:20 AM: --- {quote}

[jira] [Created] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2015-12-17 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-12404: -- Summary: Ensure objects passed to StaticInvoke is Serializable Key: SPARK-12404 URL: https://issues.apache.org/jira/browse/SPARK-12404 Project: Spark

[jira] [Updated] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2015-12-17 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12404: --- Description: Now `StaticInvoke` receives Any as a object and StaticInvoke can be serialized

[jira] [Updated] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2015-12-17 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-12404: --- Description: Now `StaticInvoke` receives Any as a object and StaticInvoke can be serialized

[jira] [Commented] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2015-12-17 Thread Lunen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062062#comment-15062062 ] Lunen commented on SPARK-12403: --- Something must have changed on the Thriftserver side because test DB and

[jira] [Commented] (SPARK-12384) Allow -Xms to be set differently then -Xmx

2015-12-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062069#comment-15062069 ] Jeff Zhang commented on SPARK-12384: OK, get it. You mean the driver side. > Allow -Xms to be set

[jira] [Created] (SPARK-12406) Simple join query throws exception that complains generated classes are not found

2015-12-17 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12406: -- Summary: Simple join query throws exception that complains generated classes are not found Key: SPARK-12406 URL: https://issues.apache.org/jira/browse/SPARK-12406

[jira] [Commented] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2015-12-17 Thread Lunen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062104#comment-15062104 ] Lunen commented on SPARK-12403: --- I've tried all available driver versions on 1.5.2 I don't know much on

[jira] [Updated] (SPARK-12406) Simple join query throws exception that complains generated classes are not found

2015-12-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12406: --- Description: This should be a regression of [PR #9923|https://github.com/apache/spark/pull/9923].

[jira] [Assigned] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12366: Assignee: (was: Apache Spark) > IllegalArgumentException: requirement failed: File

[jira] [Assigned] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12366: Assignee: Apache Spark > IllegalArgumentException: requirement failed: File not found: >

[jira] [Commented] (SPARK-12407) ClassCast Exception when restarting spark streaming from checkpoint

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062066#comment-15062066 ] Sean Owen commented on SPARK-12407: --- Is it the exact same version of your app, or did you deploy a

[jira] [Commented] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2015-12-17 Thread Lunen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062114#comment-15062114 ] Lunen commented on SPARK-12403: --- Sorry, which driver are you referring to? ODBC? If it's the Databricks

[jira] [Commented] (SPARK-12406) Simple join query throws exception that complains generated classes are not found

2015-12-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061994#comment-15061994 ] Cheng Lian commented on SPARK-12406: cc [~vanzin] > Simple join query throws exception that

[jira] [Updated] (SPARK-12406) Simple join query throws exception that complains generated classes are not found

2015-12-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12406: --- Description: This should be a regression of [PR #9923|https://github.com/apache/spark/pull/9923].

[jira] [Updated] (SPARK-12406) Simple join query throws exception that complains generated classes are not found

2015-12-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12406: --- Description: This should be a regression of [PR #9923|https://github.com/apache/spark/pull/9923].

[jira] [Resolved] (SPARK-12406) Codegen'd classes can't be found under REPL

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12406. --- Resolution: Duplicate > Codegen'd classes can't be found under REPL >

[jira] [Commented] (SPARK-12407) ClassCast Exception when restarting spark streaming from checkpoint

2015-12-17 Thread Bartlomiej Alberski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062091#comment-15062091 ] Bartlomiej Alberski commented on SPARK-12407: - Project on github was created specially for

[jira] [Updated] (SPARK-12406) Codegen'd classes can't be found under REPL

2015-12-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12406: --- Summary: Codegen'd classes can't be found under REPL (was: Simple join query throws exception that

[jira] [Commented] (SPARK-12384) Allow -Xms to be set differently then -Xmx

2015-12-17 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062068#comment-15062068 ] Thomas Graves commented on SPARK-12384: --- Yes and that is why this change it meant for the gateway

[jira] [Created] (SPARK-12407) ClassCast Exception when restarting spark streaming from checkpoint

2015-12-17 Thread Bartlomiej Alberski (JIRA)
Bartlomiej Alberski created SPARK-12407: --- Summary: ClassCast Exception when restarting spark streaming from checkpoint Key: SPARK-12407 URL: https://issues.apache.org/jira/browse/SPARK-12407

[jira] [Updated] (SPARK-12406) Simple join query throws exception that complains generated classes are not found

2015-12-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12406: --- Priority: Blocker (was: Major) > Simple join query throws exception that complains generated

[jira] [Updated] (SPARK-12406) Codegen'd classes can't be found under REPL

2015-12-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12406: --- Description: This should be a regression of [PR #9923|https://github.com/apache/spark/pull/9923].

[jira] [Commented] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062049#comment-15062049 ] Sean Owen commented on SPARK-12403: --- This sounds like a problem with the DB or driver, right? > "Simba

[jira] [Commented] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062064#comment-15062064 ] Sean Owen commented on SPARK-12403: --- That still doesn't imply it's a Spark problem, but I take your

[jira] [Commented] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

2015-12-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062203#comment-15062203 ] Yin Huai commented on SPARK-12366: -- Based on [~lian cheng]'s investigation, seems it is introduced by

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: (was: Apache Spark) > wrong output for countByValue and

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2015-12-17 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062313#comment-15062313 ] Cody Koeninger commented on SPARK-12177: Honestly SSL / auth is the only compelling thing about

[jira] [Resolved] (SPARK-12395) Result of DataFrame.join(usingColumns) could be wrong for outer join

2015-12-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12395. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Created] (SPARK-12408) Spark 1.6 with tachyon 0.8.2 uses deprecated client

2015-12-17 Thread Rares Mirica (JIRA)
Rares Mirica created SPARK-12408: Summary: Spark 1.6 with tachyon 0.8.2 uses deprecated client Key: SPARK-12408 URL: https://issues.apache.org/jira/browse/SPARK-12408 Project: Spark Issue

[jira] [Commented] (SPARK-10854) MesosExecutorBackend: Received launchTask but executor was null

2015-12-17 Thread Dmitry Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062247#comment-15062247 ] Dmitry Romanenko commented on SPARK-10854: -- Any update on this? Maybe some suggestions? I keep

[jira] [Resolved] (SPARK-12389) In Cluster RDD Action results are not consistent

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12389. --- Resolution: Not A Problem This doesn't work as expected since your tasks are not even agreeing on

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-17 Thread Tim Preece (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062175#comment-15062175 ] Tim Preece commented on SPARK-12319: Hi Sean, Yin I've started to ( and continue to ) investigate

[jira] [Assigned] (SPARK-12353) wrong output for countByValue and countByValueAndWindow

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12353: Assignee: Apache Spark > wrong output for countByValue and countByValueAndWindow >

[jira] [Commented] (SPARK-11164) Add InSet pushdown filter back for Parquet

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062319#comment-15062319 ] Apache Spark commented on SPARK-11164: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Updated] (SPARK-12408) Spark 1.6 with tachyon 0.8.2 uses deprecated client

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12408: -- Priority: Minor (was: Major) [~calvin] yeah I had the same question. The Tachyon updates tend to

[jira] [Updated] (SPARK-12384) Allow -Xms to be set differently then -Xmx

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12384: -- Priority: Minor (was: Major) I tend to think it's not useful to set -Xms to anything non-trivially

[jira] [Resolved] (SPARK-12405) Expose featureImportances on org.apache.spark.mllib.tree.RandomForest

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12405. --- Resolution: Duplicate Fix Version/s: (was: 1.5.0) Don't set fix version, and have a look

[jira] [Resolved] (SPARK-12366) IllegalArgumentException: requirement failed: File not found: ...sql/catalyst/expressions/GeneratedClass.class when df.show

2015-12-17 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12366. Resolution: Duplicate > IllegalArgumentException: requirement failed: File not found: >

[jira] [Commented] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

2015-12-17 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062527#comment-15062527 ] Dilip Biswal commented on SPARK-12398: -- [~rxin] Hi Reynold, are you working on this ? If not, i

[jira] [Resolved] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

2015-12-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12220. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0

[jira] [Updated] (SPARK-12220) Make Utils.fetchFile support files that contain special characters

2015-12-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12220: - Affects Version/s: 1.6.0 > Make Utils.fetchFile support files that contain special characters >

[jira] [Commented] (SPARK-12404) Ensure objects passed to StaticInvoke is Serializable

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062628#comment-15062628 ] Apache Spark commented on SPARK-12404: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Created] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-12410: Summary: "." and "|" used for String.split directly Key: SPARK-12410 URL: https://issues.apache.org/jira/browse/SPARK-12410 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12390: -- Fix Version/s: 1.6.1 > Clean up unused serializer parameter in BlockManager >

[jira] [Resolved] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12390. --- Resolution: Fixed > Clean up unused serializer parameter in BlockManager >

[jira] [Assigned] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12390: - Assignee: Andrew Or (was: Apache Spark) > Clean up unused serializer parameter in BlockManager

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-12-17 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062766#comment-15062766 ] Alex Bozarth commented on SPARK-10873: -- [~zhuoliu] are you currently working on this? The idea of

[jira] [Commented] (SPARK-12409) JDBC AND operator push down

2015-12-17 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062612#comment-15062612 ] Huaxin Gao commented on SPARK-12409: I will submit a PR soon. > JDBC AND operator push down >

[jira] [Created] (SPARK-12409) JDBC AND operator push down

2015-12-17 Thread Huaxin Gao (JIRA)
Huaxin Gao created SPARK-12409: -- Summary: JDBC AND operator push down Key: SPARK-12409 URL: https://issues.apache.org/jira/browse/SPARK-12409 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12410: Assignee: Apache Spark > "." and "|" used for String.split directly >

[jira] [Created] (SPARK-12411) Reconsider executor heartbeats rpc timeout

2015-12-17 Thread Nong Li (JIRA)
Nong Li created SPARK-12411: --- Summary: Reconsider executor heartbeats rpc timeout Key: SPARK-12411 URL: https://issues.apache.org/jira/browse/SPARK-12411 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12402) Memory leak in pyspark

2015-12-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12402: --- Description: After run some SQL query in PySpark, the DataFrame are still referenced by py4j

[jira] [Commented] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062768#comment-15062768 ] Apache Spark commented on SPARK-12410: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-12402) Memory leak in pyspark

2015-12-17 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12402: --- Summary: Memory leak in pyspark (was: Memory leak in broadcast hash join) > Memory leak in pyspark

[jira] [Assigned] (SPARK-12387) JDBC IN operator push down

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12387: Assignee: Apache Spark > JDBC IN operator push down > --- > >

[jira] [Assigned] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12410: Assignee: (was: Apache Spark) > "." and "|" used for String.split directly >

[jira] [Updated] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12410: - Component/s: (was: Spark Core) Streaming > "." and "|" used for

[jira] [Commented] (SPARK-10873) can't sort columns on history page

2015-12-17 Thread Zhuo Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062794#comment-15062794 ] Zhuo Liu commented on SPARK-10873: -- Hi Alex, I started working on this, hopefully I will have a pull

[jira] [Updated] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

2015-12-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12218: - Summary: Invalid splitting of nested AND expressions in Data Source filter API (was: Boolean logic in

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: Apache Spark > Add read.text and write.text for SparkR >

[jira] [Assigned] (SPARK-12393) Add read.text and write.text for SparkR

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12393: Assignee: (was: Apache Spark) > Add read.text and write.text for SparkR >

[jira] [Updated] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

2015-12-17 Thread Gobinathan SP (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gobinathan SP updated SPARK-12313: -- Description: When enabled spark.sql.hive.metastorePartitionPruning, the getPartitionsByFilter

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a

2015-12-17 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-12413: Summary: Mesos ZK persistence throws a (was: Mesos ZK persistence is broken) > Mesos ZK

[jira] [Comment Edited] (SPARK-10873) can't sort columns on history page

2015-12-17 Thread Zhuo Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062794#comment-15062794 ] Zhuo Liu edited comment on SPARK-10873 at 12/17/15 8:58 PM: Hi Alex, I

[jira] [Commented] (SPARK-12218) Invalid splitting of nested AND expressions in Data Source filter API

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062835#comment-15062835 ] Apache Spark commented on SPARK-12218: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-12413) Mesos ZK persistence is broken

2015-12-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062990#comment-15062990 ] Sean Owen commented on SPARK-12413: --- [~mgummelt] I realize you linked to the issue but "is broken"

[jira] [Assigned] (SPARK-12413) Mesos ZK persistence is broken

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12413: Assignee: Apache Spark > Mesos ZK persistence is broken > --

[jira] [Assigned] (SPARK-12413) Mesos ZK persistence is broken

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12413: Assignee: (was: Apache Spark) > Mesos ZK persistence is broken >

[jira] [Created] (SPARK-12412) Support LIKE in the JDBCRDD

2015-12-17 Thread Bo Meng (JIRA)
Bo Meng created SPARK-12412: --- Summary: Support LIKE in the JDBCRDD Key: SPARK-12412 URL: https://issues.apache.org/jira/browse/SPARK-12412 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12412) Support LIKE in the JDBCRDD

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12412: Assignee: (was: Apache Spark) > Support LIKE in the JDBCRDD >

[jira] [Assigned] (SPARK-12412) Support LIKE in the JDBCRDD

2015-12-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12412: Assignee: Apache Spark > Support LIKE in the JDBCRDD > --- > >

[jira] [Resolved] (SPARK-12397) Improve error messages for data sources when they are not found

2015-12-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12397. -- Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved

[jira] [Resolved] (SPARK-12376) Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method

2015-12-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12376. -- Resolution: Fixed Assignee: Evan Chen Fix Version/s: 2.0.0

[jira] [Created] (SPARK-12413) Mesos ZK persistence is broken

2015-12-17 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-12413: --- Summary: Mesos ZK persistence is broken Key: SPARK-12413 URL: https://issues.apache.org/jira/browse/SPARK-12413 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12410: - Fix Version/s: (was: 1.5.2) (was: 1.6.0) 2.0.0

[jira] [Resolved] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12410. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.2

[jira] [Updated] (SPARK-12410) "." and "|" used for String.split directly

2015-12-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12410: - Affects Version/s: 1.4.1 1.5.2 > "." and "|" used for String.split

  1   2   >