[jira] [Assigned] (SPARK-14399) Remove unnecessary excludes from POMs

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14399: Assignee: Josh Rosen (was: Apache Spark) > Remove unnecessary excludes from POMs > --

[jira] [Commented] (SPARK-14399) Remove unnecessary excludes from POMs

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225793#comment-15225793 ] Apache Spark commented on SPARK-14399: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-14370) Avoid creating duplicate ids in OnlineLDAOptimizer

2016-04-04 Thread Pravin Gadakh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225786#comment-15225786 ] Pravin Gadakh commented on SPARK-14370: --- I can work on it if no one has already tak

[jira] [Updated] (SPARK-14400) ScriptTransformation does not fail the job for bad user command

2016-04-04 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-14400: Description: If the `script` to be ran is an incorrect command, Spark does not catch the failure in

[jira] [Created] (SPARK-14400) ScriptTransformation does not fail the job for bad user command

2016-04-04 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-14400: --- Summary: ScriptTransformation does not fail the job for bad user command Key: SPARK-14400 URL: https://issues.apache.org/jira/browse/SPARK-14400 Project: Spark

[jira] [Commented] (SPARK-14398) Audit non-reserved keyword list in ANTLR4 parser.

2016-04-04 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225767#comment-15225767 ] Bo Meng commented on SPARK-14398: - Not a problem. I will work on it tomorrow. Thanks. >

[jira] [Created] (SPARK-14399) Remove unnecessary excludes from POMs

2016-04-04 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14399: -- Summary: Remove unnecessary excludes from POMs Key: SPARK-14399 URL: https://issues.apache.org/jira/browse/SPARK-14399 Project: Spark Issue Type: Improvement

[jira] [Closed] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-04 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell closed SPARK-14348. - Resolution: Resolved Assignee: Dilip Biswal Target Version/s: 2.0.0

[jira] [Commented] (SPARK-14398) Audit non-reserved keyword list in ANTLR4 parser.

2016-04-04 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225765#comment-15225765 ] Herman van Hovell commented on SPARK-14398: --- cc [~bomeng] want to take a look a

[jira] [Issue Comment Deleted] (SPARK-14397) and tags are nested in LogPage

2016-04-04 Thread Maarten Kesselaers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maarten Kesselaers updated SPARK-14397: --- Comment: was deleted (was: Can I try this one, please?) > and tags are nested in L

[jira] [Commented] (SPARK-14397) and tags are nested in LogPage

2016-04-04 Thread Maarten Kesselaers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225762#comment-15225762 ] Maarten Kesselaers commented on SPARK-14397: Can I try this one, please? >

[jira] [Commented] (SPARK-14397) and tags are nested in LogPage

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225760#comment-15225760 ] Apache Spark commented on SPARK-14397: -- User 'sarutak' has created a pull request fo

[jira] [Assigned] (SPARK-14397) and tags are nested in LogPage

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14397: Assignee: Apache Spark > and tags are nested in LogPage > --

[jira] [Assigned] (SPARK-14397) and tags are nested in LogPage

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14397: Assignee: (was: Apache Spark) > and tags are nested in LogPage > ---

[jira] [Created] (SPARK-14398) Audit non-reserved keyword list in ANTLR4 parser.

2016-04-04 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-14398: - Summary: Audit non-reserved keyword list in ANTLR4 parser. Key: SPARK-14398 URL: https://issues.apache.org/jira/browse/SPARK-14398 Project: Spark I

[jira] [Created] (SPARK-14397) and tags are nested in LogPage

2016-04-04 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-14397: -- Summary: and tags are nested in LogPage Key: SPARK-14397 URL: https://issues.apache.org/jira/browse/SPARK-14397 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225722#comment-15225722 ] Apache Spark commented on SPARK-14396: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14396: Assignee: Apache Spark > Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and A

[jira] [Assigned] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14396: Assignee: (was: Apache Spark) > Throw Exceptions for DDLs of Partitioned Views (CREATE

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the su

[jira] [Updated] (SPARK-14362) DDL Native Support: Drop View

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14362: Description: Native parsing and native analysis of DDL command: Drop View. Based on the HIVE DDL document

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the su

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the su

[jira] [Created] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-14396: --- Summary: Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW) Key: SPARK-14396 URL: https://issues.apache.org/jira/browse/SPARK-14396 Project: Spark

[jira] [Commented] (SPARK-14240) PySpark Standalone Application hangs without any Error message

2016-04-04 Thread Sayak Ghosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225704#comment-15225704 ] Sayak Ghosh commented on SPARK-14240: - The issue has been resolved. Its a GC issue as

[jira] [Commented] (SPARK-14125) View related commands

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225675#comment-15225675 ] Xiao Li commented on SPARK-14125: - Now, working on TOK_ALTERVIEW_ADDPARTS/TOK_ALTERVIEW_D

[jira] [Updated] (SPARK-14298) LDA should support disable checkpoint

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14298: -- Issue Type: Bug (was: Improvement) > LDA should support disable checkpoint > -

[jira] [Updated] (SPARK-14298) LDA should support disable checkpoint

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14298: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Affects Vers

[jira] [Assigned] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14359: Assignee: Apache Spark > Improve user experience for typed aggregate functions in Java > -

[jira] [Commented] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225599#comment-15225599 ] Apache Spark commented on SPARK-14359: -- User 'ericl' has created a pull request for

[jira] [Assigned] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14359: Assignee: (was: Apache Spark) > Improve user experience for typed aggregate functions

[jira] [Updated] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-14368: --- Fix Version/s: 2.0.0 1.6.2 > Support python.spark.worker.memory with upper

[jira] [Resolved] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-14368. Resolution: Fixed > Support python.spark.worker.memory with upper-case unit > -

[jira] [Updated] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-14368: --- Assignee: Yong Tang > Support python.spark.worker.memory with upper-case unit > -

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225593#comment-15225593 ] Apache Spark commented on SPARK-13211: -- User 'srowen' has created a pull request for

[jira] [Resolved] (SPARK-14386) spark.ml DecisionTreeModel abstraction should not be exposed

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14386. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12158 [h

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-04-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225525#comment-15225525 ] Yanbo Liang commented on SPARK-13783: - [~josephkb] I will work on this. > Model expo

[jira] [Resolved] (SPARK-14287) Method to determine if Dataset is bounded or not

2016-04-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14287. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12080 [htt

[jira] [Resolved] (SPARK-14240) PySpark Standalone Application hangs without any Error message

2016-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14240. --- Resolution: Not A Problem Yeah all of this indicates you are not giving your job enough memory. It's

[jira] [Updated] (SPARK-12425) DStream union optimisation

2016-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12425: -- Assignee: Guillaume Poulin > DStream union optimisation > -- > >

[jira] [Resolved] (SPARK-12425) DStream union optimisation

2016-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12425. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10382 [https://github.co

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225506#comment-15225506 ] Joseph K. Bradley commented on SPARK-13048: --- [~jvstein] Would you be able to te

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13048: Assignee: Apache Spark (was: Joseph K. Bradley) > EMLDAOptimizer deletes dependent checkp

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225502#comment-15225502 ] Apache Spark commented on SPARK-13048: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13048: Assignee: Joseph K. Bradley (was: Apache Spark) > EMLDAOptimizer deletes dependent checkp

[jira] [Assigned] (SPARK-14395) remove some unused code in REPL module

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14395: Assignee: Wenchen Fan (was: Apache Spark) > remove some unused code in REPL module >

[jira] [Assigned] (SPARK-14395) remove some unused code in REPL module

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14395: Assignee: Apache Spark (was: Wenchen Fan) > remove some unused code in REPL module >

[jira] [Commented] (SPARK-14395) remove some unused code in REPL module

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225494#comment-15225494 ] Apache Spark commented on SPARK-14395: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14347: Assignee: (was: Apache Spark) > Require Java 8 for Spark 2.x > ---

[jira] [Assigned] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14347: Assignee: Apache Spark > Require Java 8 for Spark 2.x > > >

[jira] [Commented] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225495#comment-15225495 ] Apache Spark commented on SPARK-14347: -- User 'srowen' has created a pull request for

[jira] [Created] (SPARK-14395) remove some unused code in REPL module

2016-04-04 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-14395: --- Summary: remove some unused code in REPL module Key: SPARK-14395 URL: https://issues.apache.org/jira/browse/SPARK-14395 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14368: Assignee: Apache Spark > Support python.spark.worker.memory with upper-case unit > ---

[jira] [Assigned] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14368: Assignee: (was: Apache Spark) > Support python.spark.worker.memory with upper-case uni

[jira] [Commented] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225486#comment-15225486 ] Apache Spark commented on SPARK-14368: -- User 'yongtang' has created a pull request f

[jira] [Commented] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225471#comment-15225471 ] Yong Tang commented on SPARK-14368: --- That is like an easy fix. Will create a pull reque

[jira] [Updated] (SPARK-14289) Support multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Yuanzhen Geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanzhen Geng updated SPARK-14289: -- Summary: Support multiple eviction strategies for cached RDD partitions (was: Add support to m

[jira] [Assigned] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14289: Assignee: (was: Apache Spark) > Add support to multiple eviction strategies for cached

[jira] [Assigned] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14289: Assignee: Apache Spark > Add support to multiple eviction strategies for cached RDD partit

[jira] [Commented] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225469#comment-15225469 ] Apache Spark commented on SPARK-14289: -- User 'Earne' has created a pull request for

[jira] [Resolved] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-13456. - Resolution: Fixed > Cannot create encoders for case classes defined in Spark shell after > upgra

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225468#comment-15225468 ] Wenchen Fan commented on SPARK-13456: - This is a scala bug: https://issues.scala-lang

[jira] [Updated] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Yuanzhen Geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanzhen Geng updated SPARK-14289: -- Summary: Add support to multiple eviction strategies for cached RDD partitions (was: Add suppo

[jira] [Commented] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225450#comment-15225450 ] Apache Spark commented on SPARK-14394: -- User 'sameeragarwal' has created a pull requ

[jira] [Assigned] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14394: Assignee: (was: Apache Spark) > Generate AggregateHashMap class during TungstenAggrega

[jira] [Assigned] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14394: Assignee: Apache Spark > Generate AggregateHashMap class during TungstenAggregate codegen

[jira] [Created] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-14394: -- Summary: Generate AggregateHashMap class during TungstenAggregate codegen Key: SPARK-14394 URL: https://issues.apache.org/jira/browse/SPARK-14394 Project: Spark

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every parti

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every parti

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every parti

[jira] [Created] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
Jason Piper created SPARK-14393: --- Summary: monotonicallyIncreasingId not monotonically increasing with downstream coalesce Key: SPARK-14393 URL: https://issues.apache.org/jira/browse/SPARK-14393 Project

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/5/16 12:45 AM:

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225389#comment-15225389 ] Yin Huai commented on SPARK-13456: -- [~rxin] This is the repl issue. > Cannot create enc

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225390#comment-15225390 ] Yin Huai commented on SPARK-13456: -- The original jira for this should be https://issues

[jira] [Comment Edited] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15223758#comment-15223758 ] Wenchen Fan edited comment on SPARK-13456 at 4/5/16 12:20 AM: -

[jira] [Updated] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14087: -- Target Version/s: (was: 2.0.0) > PySpark ML JavaModel does not properly own params af

[jira] [Updated] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13048: -- Target Version/s: 2.0.0 I'll send a PR for this. I'd prefer to fix this in 2.0 only si

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-13048: - Assignee: Joseph K. Bradley > EMLDAOptimizer deletes dependent checkpoint of Dis

[jira] [Resolved] (SPARK-13326) Dataset in spark 2.0.0-SNAPSHOT missing columns

2016-04-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13326. - Resolution: Later See SPARK-14155. We will re-introduce UDT in Spark 2.1 to make it work with Da

[jira] [Commented] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

2016-04-04 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225326#comment-15225326 ] Bryan Cutler commented on SPARK-14087: -- I don't think this would completely solve it

[jira] [Resolved] (SPARK-14366) Remove SBT-Idea plugin

2016-04-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14366. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12151 [https://github.

[jira] [Updated] (SPARK-14366) Remove SBT-Idea plugin

2016-04-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14366: --- Assignee: Luciano Resende > Remove SBT-Idea plugin > -- > > Key:

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

2016-04-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225322#comment-15225322 ] Josh Rosen commented on SPARK-11157: I just merged the final patch for this, so I'm m

[jira] [Resolved] (SPARK-13808) Don't build assembly in dev/run-tests

2016-04-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13808. Resolution: Fixed Assignee: Marcelo Vanzin (was: Josh Rosen) Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-11157) Allow Spark to be built without assemblies

2016-04-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11157. Resolution: Fixed Fix Version/s: 2.0.0 > Allow Spark to be built without assemblies > --

[jira] [Resolved] (SPARK-13579) Stop building assemblies for Spark

2016-04-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13579. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11796 [https://github.

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225305#comment-15225305 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/4/16 11:52 PM:

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225305#comment-15225305 ] Hyukjin Kwon commented on SPARK-14103: -- Just to cut it short, the input is being rea

[jira] [Commented] (SPARK-14256) Remove parameter sqlContext from as.DataFrame

2016-04-04 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225296#comment-15225296 ] Felix Cheung commented on SPARK-14256: -- This was discussed previously and was sugges

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/4/16 11:37 PM:

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/4/16 11:34 PM:

[jira] [Commented] (SPARK-14392) CountVectorizer Estimator should include binary toggle Param

2016-04-04 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225277#comment-15225277 ] Miao Wang commented on SPARK-14392: --- I will on this one. Thanks! Miao > CountVector

[jira] [Updated] (SPARK-14388) Create Table and Drop table

2016-04-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14388: - Description: For now, we still ask Hive to handle creating hive tables and dropping a table. We should ha

[jira] [Commented] (SPARK-14389) OOM during BroadcastNestedLoopJoin

2016-04-04 Thread Steve Johnston (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225268#comment-15225268 ] Steve Johnston commented on SPARK-14389: Related to [What influences the space co

[jira] [Commented] (SPARK-14389) OOM during BroadcastNestedLoopJoin

2016-04-04 Thread Steve Johnston (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225265#comment-15225265 ] Steve Johnston commented on SPARK-14389: The sample script, data, etc is contrive

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225263#comment-15225263 ] Hyukjin Kwon commented on SPARK-14103: -- Oh, sorry I should have mentioned that it re

[jira] [Comment Edited] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225254#comment-15225254 ] Joseph K. Bradley edited comment on SPARK-13629 at 4/4/16 11:29 PM: ---

[jira] [Commented] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225260#comment-15225260 ] Joseph K. Bradley commented on SPARK-14087: --- I believe [SPARK-14392] is the rig

[jira] [Created] (SPARK-14392) CountVectorizer Estimator should include binary toggle Param

2016-04-04 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14392: - Summary: CountVectorizer Estimator should include binary toggle Param Key: SPARK-14392 URL: https://issues.apache.org/jira/browse/SPARK-14392 Project: Spark

[jira] [Commented] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225254#comment-15225254 ] Joseph K. Bradley commented on SPARK-13629: --- I just realized that we should hav

  1   2   3   >