[jira] [Commented] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225722#comment-15225722 ] Apache Spark commented on SPARK-14396: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14396: Assignee: Apache Spark > Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and

[jira] [Assigned] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14396: Assignee: (was: Apache Spark) > Throw Exceptions for DDLs of Partitioned Views

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the

[jira] [Updated] (SPARK-14362) DDL Native Support: Drop View

[ https://issues.apache.org/jira/browse/SPARK-14362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14362: Description: Native parsing and native analysis of DDL command: Drop View. Based on the HIVE DDL document

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the

[jira] [Created] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

Xiao Li created SPARK-14396: --- Summary: Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW) Key: SPARK-14396 URL: https://issues.apache.org/jira/browse/SPARK-14396 Project: Spark

[jira] [Commented] (SPARK-14240) PySpark Standalone Application hangs without any Error message

[ https://issues.apache.org/jira/browse/SPARK-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225704#comment-15225704 ] Sayak Ghosh commented on SPARK-14240: - The issue has been resolved. Its a GC issue as you mentioned

[jira] [Commented] (SPARK-14125) View related commands

[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225675#comment-15225675 ] Xiao Li commented on SPARK-14125: - Now, working on TOK_ALTERVIEW_ADDPARTS/TOK_ALTERVIEW_DROPPARTS. will

[jira] [Updated] (SPARK-14298) LDA should support disable checkpoint

[ https://issues.apache.org/jira/browse/SPARK-14298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14298: -- Issue Type: Bug (was: Improvement) > LDA should support disable checkpoint >

[jira] [Updated] (SPARK-14298) LDA should support disable checkpoint

[ https://issues.apache.org/jira/browse/SPARK-14298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14298: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Affects

[jira] [Assigned] (SPARK-14359) Improve user experience for typed aggregate functions in Java

[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14359: Assignee: Apache Spark > Improve user experience for typed aggregate functions in Java >

[jira] [Commented] (SPARK-14359) Improve user experience for typed aggregate functions in Java

[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225599#comment-15225599 ] Apache Spark commented on SPARK-14359: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14359) Improve user experience for typed aggregate functions in Java

[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14359: Assignee: (was: Apache Spark) > Improve user experience for typed aggregate functions

[jira] [Updated] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-14368: --- Fix Version/s: 2.0.0 1.6.2 > Support python.spark.worker.memory with

[jira] [Resolved] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-14368. Resolution: Fixed > Support python.spark.worker.memory with upper-case unit >

[jira] [Updated] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-14368: --- Assignee: Yong Tang > Support python.spark.worker.memory with upper-case unit >

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225593#comment-15225593 ] Apache Spark commented on SPARK-13211: -- User 'srowen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-14386) spark.ml DecisionTreeModel abstraction should not be exposed

[ https://issues.apache.org/jira/browse/SPARK-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14386. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12158

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225525#comment-15225525 ] Yanbo Liang commented on SPARK-13783: - [~josephkb] I will work on this. > Model export/import for

[jira] [Resolved] (SPARK-14287) Method to determine if Dataset is bounded or not

[ https://issues.apache.org/jira/browse/SPARK-14287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14287. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12080

[jira] [Resolved] (SPARK-14240) PySpark Standalone Application hangs without any Error message

[ https://issues.apache.org/jira/browse/SPARK-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14240. --- Resolution: Not A Problem Yeah all of this indicates you are not giving your job enough memory. It's

[jira] [Updated] (SPARK-12425) DStream union optimisation

[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12425: -- Assignee: Guillaume Poulin > DStream union optimisation > -- > >

[jira] [Resolved] (SPARK-12425) DStream union optimisation

[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12425. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10382

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225506#comment-15225506 ] Joseph K. Bradley commented on SPARK-13048: --- [~jvstein] Would you be able to test whether the

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13048: Assignee: Apache Spark (was: Joseph K. Bradley) > EMLDAOptimizer deletes dependent

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225502#comment-15225502 ] Apache Spark commented on SPARK-13048: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13048: Assignee: Joseph K. Bradley (was: Apache Spark) > EMLDAOptimizer deletes dependent

[jira] [Assigned] (SPARK-14395) remove some unused code in REPL module

[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14395: Assignee: Wenchen Fan (was: Apache Spark) > remove some unused code in REPL module >

[jira] [Assigned] (SPARK-14395) remove some unused code in REPL module

[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14395: Assignee: Apache Spark (was: Wenchen Fan) > remove some unused code in REPL module >

[jira] [Assigned] (SPARK-14347) Require Java 8 for Spark 2.x

[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14347: Assignee: (was: Apache Spark) > Require Java 8 for Spark 2.x >

[jira] [Assigned] (SPARK-14347) Require Java 8 for Spark 2.x

[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14347: Assignee: Apache Spark > Require Java 8 for Spark 2.x > > >

[jira] [Commented] (SPARK-14347) Require Java 8 for Spark 2.x

[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225495#comment-15225495 ] Apache Spark commented on SPARK-14347: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-14395) remove some unused code in REPL module

Wenchen Fan created SPARK-14395: --- Summary: remove some unused code in REPL module Key: SPARK-14395 URL: https://issues.apache.org/jira/browse/SPARK-14395 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14368: Assignee: Apache Spark > Support python.spark.worker.memory with upper-case unit >

[jira] [Commented] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225486#comment-15225486 ] Apache Spark commented on SPARK-14368: -- User 'yongtang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14368: Assignee: (was: Apache Spark) > Support python.spark.worker.memory with upper-case

[jira] [Commented] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225471#comment-15225471 ] Yong Tang commented on SPARK-14368: --- That is like an easy fix. Will create a pull request shortly. >

[jira] [Updated] (SPARK-14289) Support multiple eviction strategies for cached RDD partitions

[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanzhen Geng updated SPARK-14289: -- Summary: Support multiple eviction strategies for cached RDD partitions (was: Add support to

[jira] [Assigned] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14289: Assignee: (was: Apache Spark) > Add support to multiple eviction strategies for

[jira] [Assigned] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14289: Assignee: Apache Spark > Add support to multiple eviction strategies for cached RDD

[jira] [Commented] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225469#comment-15225469 ] Apache Spark commented on SPARK-14289: -- User 'Earne' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-13456. - Resolution: Fixed > Cannot create encoders for case classes defined in Spark shell after >

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225468#comment-15225468 ] Wenchen Fan commented on SPARK-13456: - This is a scala bug:

[jira] [Updated] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanzhen Geng updated SPARK-14289: -- Summary: Add support to multiple eviction strategies for cached RDD partitions (was: Add

[jira] [Commented] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225450#comment-15225450 ] Apache Spark commented on SPARK-14394: -- User 'sameeragarwal' has created a pull request for this

[jira] [Assigned] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14394: Assignee: (was: Apache Spark) > Generate AggregateHashMap class during

[jira] [Assigned] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14394: Assignee: Apache Spark > Generate AggregateHashMap class during TungstenAggregate codegen

[jira] [Created] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

Sameer Agarwal created SPARK-14394: -- Summary: Generate AggregateHashMap class during TungstenAggregate codegen Key: SPARK-14394 URL: https://issues.apache.org/jira/browse/SPARK-14394 Project: Spark

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every

[jira] [Created] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

Jason Piper created SPARK-14393: --- Summary: monotonicallyIncreasingId not monotonically increasing with downstream coalesce Key: SPARK-14393 URL: https://issues.apache.org/jira/browse/SPARK-14393

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/5/16 12:45 AM: --- Oh, sorry I

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225389#comment-15225389 ] Yin Huai commented on SPARK-13456: -- [~rxin] This is the repl issue. > Cannot create encoders for case

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225390#comment-15225390 ] Yin Huai commented on SPARK-13456: -- The original jira for this should be

[jira] [Comment Edited] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223758#comment-15223758 ] Wenchen Fan edited comment on SPARK-13456 at 4/5/16 12:20 AM: -- I found a

[jira] [Updated] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14087: -- Target Version/s: (was: 2.0.0) > PySpark ML JavaModel does not properly own params

[jira] [Updated] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13048: -- Target Version/s: 2.0.0 I'll send a PR for this. I'd prefer to fix this in 2.0 only

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-13048: - Assignee: Joseph K. Bradley > EMLDAOptimizer deletes dependent checkpoint of

[jira] [Resolved] (SPARK-13326) Dataset in spark 2.0.0-SNAPSHOT missing columns

[ https://issues.apache.org/jira/browse/SPARK-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13326. - Resolution: Later See SPARK-14155. We will re-introduce UDT in Spark 2.1 to make it work with

[jira] [Commented] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225326#comment-15225326 ] Bryan Cutler commented on SPARK-14087: -- I don't think this would completely solve it, please see my

[jira] [Resolved] (SPARK-14366) Remove SBT-Idea plugin

[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14366. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12151

[jira] [Updated] (SPARK-14366) Remove SBT-Idea plugin

[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14366: --- Assignee: Luciano Resende > Remove SBT-Idea plugin > -- > > Key:

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225322#comment-15225322 ] Josh Rosen commented on SPARK-11157: I just merged the final patch for this, so I'm marking this as

[jira] [Resolved] (SPARK-13808) Don't build assembly in dev/run-tests

[ https://issues.apache.org/jira/browse/SPARK-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13808. Resolution: Fixed Assignee: Marcelo Vanzin (was: Josh Rosen) Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-11157) Allow Spark to be built without assemblies

[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11157. Resolution: Fixed Fix Version/s: 2.0.0 > Allow Spark to be built without assemblies >

[jira] [Resolved] (SPARK-13579) Stop building assemblies for Spark

[ https://issues.apache.org/jira/browse/SPARK-13579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13579. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11796

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225305#comment-15225305 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/4/16 11:52 PM: --- Just to cut

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225305#comment-15225305 ] Hyukjin Kwon commented on SPARK-14103: -- Just to cut it short, the input is being read as a byte

[jira] [Commented] (SPARK-14256) Remove parameter sqlContext from as.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225296#comment-15225296 ] Felix Cheung commented on SPARK-14256: -- This was discussed previously and was suggested not to omit

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/4/16 11:37 PM: --- Oh, sorry I

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/4/16 11:34 PM: --- Oh, sorry I

[jira] [Commented] (SPARK-14392) CountVectorizer Estimator should include binary toggle Param

[ https://issues.apache.org/jira/browse/SPARK-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225277#comment-15225277 ] Miao Wang commented on SPARK-14392: --- I will on this one. Thanks! Miao > CountVectorizer Estimator

[jira] [Updated] (SPARK-14388) Create Table and Drop table

[ https://issues.apache.org/jira/browse/SPARK-14388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14388: - Description: For now, we still ask Hive to handle creating hive tables and dropping a table. We should

[jira] [Commented] (SPARK-14389) OOM during BroadcastNestedLoopJoin

[ https://issues.apache.org/jira/browse/SPARK-14389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225268#comment-15225268 ] Steve Johnston commented on SPARK-14389: Related to [What influences the space complexity of

[jira] [Commented] (SPARK-14389) OOM during BroadcastNestedLoopJoin

[ https://issues.apache.org/jira/browse/SPARK-14389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225265#comment-15225265 ] Steve Johnston commented on SPARK-14389: The sample script, data, etc is contrived in order to

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225263#comment-15225263 ] Hyukjin Kwon commented on SPARK-14103: -- Oh, sorry I should have mentioned that it reads all the data

[jira] [Comment Edited] (SPARK-13629) Add binary toggle Param to CountVectorizer

[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225254#comment-15225254 ] Joseph K. Bradley edited comment on SPARK-13629 at 4/4/16 11:29 PM: I

[jira] [Commented] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225260#comment-15225260 ] Joseph K. Bradley commented on SPARK-14087: --- I believe [SPARK-14392] is the right way to solve

[jira] [Created] (SPARK-14392) CountVectorizer Estimator should include binary toggle Param

Joseph K. Bradley created SPARK-14392: - Summary: CountVectorizer Estimator should include binary toggle Param Key: SPARK-14392 URL: https://issues.apache.org/jira/browse/SPARK-14392 Project:

[jira] [Commented] (SPARK-13629) Add binary toggle Param to CountVectorizer

[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225254#comment-15225254 ] Joseph K. Bradley commented on SPARK-13629: --- I just realized that we should have added the

[jira] [Commented] (SPARK-14391) Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication

[ https://issues.apache.org/jira/browse/SPARK-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225251#comment-15225251 ] Marcelo Vanzin commented on SPARK-14391: I made an internal change to increase timeouts for those

[jira] [Commented] (SPARK-14155) Hide UserDefinedType in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225248#comment-15225248 ] Reynold Xin commented on SPARK-14155: - Yes let's close that one. Can you link it to this one when you

[jira] [Created] (SPARK-14391) Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication

Burak Yavuz created SPARK-14391: --- Summary: Flaky Test org.apache.spark.launcher.LauncherServerSuite.testCommunication Key: SPARK-14391 URL: https://issues.apache.org/jira/browse/SPARK-14391 Project:

[jira] [Assigned] (SPARK-14390) Make initialization step in Pregel optional.

[ https://issues.apache.org/jira/browse/SPARK-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14390: Assignee: Apache Spark > Make initialization step in Pregel optional. >

[jira] [Commented] (SPARK-14390) Make initialization step in Pregel optional.

[ https://issues.apache.org/jira/browse/SPARK-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225235#comment-15225235 ] Apache Spark commented on SPARK-14390: -- User 'adeandrade' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14390) Make initialization step in Pregel optional.

[ https://issues.apache.org/jira/browse/SPARK-14390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14390: Assignee: (was: Apache Spark) > Make initialization step in Pregel optional. >

[jira] [Created] (SPARK-14390) Make initialization step in Pregel optional.

Anderson de Andrade created SPARK-14390: --- Summary: Make initialization step in Pregel optional. Key: SPARK-14390 URL: https://issues.apache.org/jira/browse/SPARK-14390 Project: Spark

[jira] [Updated] (SPARK-14389) OOM during BroadcastNestedLoopJoin

[ https://issues.apache.org/jira/browse/SPARK-14389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Johnston updated SPARK-14389: --- Attachment: sample_script.py lineitem.tbl stdout.txt > OOM

[jira] [Created] (SPARK-14389) OOM during BroadcastNestedLoopJoin

Steve Johnston created SPARK-14389: -- Summary: OOM during BroadcastNestedLoopJoin Key: SPARK-14389 URL: https://issues.apache.org/jira/browse/SPARK-14389 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14388) Create Table and Drop table

Yin Huai created SPARK-14388: Summary: Create Table and Drop table Key: SPARK-14388 URL: https://issues.apache.org/jira/browse/SPARK-14388 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-14155) Hide UserDefinedType in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225210#comment-15225210 ] Koert Kuipers commented on SPARK-14155: --- got it. i was running into issues with UDTs and Datasets

[jira] [Created] (SPARK-14387) Exceptions thrown when querying ORC tables

Rajesh Balamohan created SPARK-14387: Summary: Exceptions thrown when querying ORC tables Key: SPARK-14387 URL: https://issues.apache.org/jira/browse/SPARK-14387 Project: Spark Issue

[jira] [Assigned] (SPARK-14386) spark.ml DecisionTreeModel abstraction should not be exposed

[ https://issues.apache.org/jira/browse/SPARK-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14386: Assignee: Apache Spark (was: Joseph K. Bradley) > spark.ml DecisionTreeModel abstraction

[jira] [Assigned] (SPARK-14386) spark.ml DecisionTreeModel abstraction should not be exposed

[ https://issues.apache.org/jira/browse/SPARK-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14386: Assignee: Joseph K. Bradley (was: Apache Spark) > spark.ml DecisionTreeModel abstraction

[jira] [Commented] (SPARK-14386) spark.ml DecisionTreeModel abstraction should not be exposed

[ https://issues.apache.org/jira/browse/SPARK-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225196#comment-15225196 ] Apache Spark commented on SPARK-14386: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Created] (SPARK-14386) spark.ml DecisionTreeModel abstraction should not be exposed

Joseph K. Bradley created SPARK-14386: - Summary: spark.ml DecisionTreeModel abstraction should not be exposed Key: SPARK-14386 URL: https://issues.apache.org/jira/browse/SPARK-14386 Project:

[jira] [Created] (SPARK-14385) Use FunctionIdentifier in FunctionRegistry/SessionCatalog

Andrew Or created SPARK-14385: - Summary: Use FunctionIdentifier in FunctionRegistry/SessionCatalog Key: SPARK-14385 URL: https://issues.apache.org/jira/browse/SPARK-14385 Project: Spark Issue

  1   2   3   >