[jira] [Updated] (SPARK-14361) Support EXCLUDE clause in Window function framing

2016-04-04 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-14361: --- Description: The current Spark SQL does not support the *exclude* clause in Window function framing clause,

[jira] [Commented] (SPARK-14361) Support EXCLUDE clause in Window function framing

2016-04-04 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223702#comment-15223702 ] Xin Wu commented on SPARK-14361: [~smilegator][~dkbiswal] > Support EXCLUDE clause in Window function

[jira] [Commented] (SPARK-7179) Add pattern after "show tables" to filter desire tablename

2016-04-04 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223704#comment-15223704 ] Herman van Hovell commented on SPARK-7179: -- I think this one has been fixed in

[jira] [Resolved] (SPARK-7179) Add pattern after "show tables" to filter desire tablename

2016-04-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7179. Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Add pattern

[jira] [Comment Edited] (SPARK-14361) Support EXCLUDE clause in Window function framing

2016-04-04 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223702#comment-15223702 ] Xin Wu edited comment on SPARK-14361 at 4/4/16 6:06 AM: [~hvanhovell] Since you

[jira] [Assigned] (SPARK-14361) Support EXCLUDE clause in Window function framing

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14361: Assignee: Apache Spark > Support EXCLUDE clause in Window function framing >

[jira] [Assigned] (SPARK-14361) Support EXCLUDE clause in Window function framing

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14361: Assignee: (was: Apache Spark) > Support EXCLUDE clause in Window function framing >

[jira] [Commented] (SPARK-14361) Support EXCLUDE clause in Window function framing

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223708#comment-15223708 ] Apache Spark commented on SPARK-14361: -- User 'xwu0226' has created a pull request for this issue:

[jira] [Updated] (SPARK-14361) Support EXCLUDE clause in Window function framing

2016-04-04 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-14361: --- Description: The current Spark SQL does not support the exclusion clause in Window function framing, which

[jira] [Created] (SPARK-14364) HeartbeatReceiver object should be private[spark]

2016-04-04 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14364: --- Summary: HeartbeatReceiver object should be private[spark] Key: SPARK-14364 URL: https://issues.apache.org/jira/browse/SPARK-14364 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14364) HeartbeatReceiver object should be private[spark]

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14364: Assignee: Reynold Xin (was: Apache Spark) > HeartbeatReceiver object should be

[jira] [Commented] (SPARK-14364) HeartbeatReceiver object should be private[spark]

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223726#comment-15223726 ] Apache Spark commented on SPARK-14364: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14364) HeartbeatReceiver object should be private[spark]

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14364: Assignee: Apache Spark (was: Reynold Xin) > HeartbeatReceiver object should be

[jira] [Updated] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

2016-04-04 Thread Jurriaan Pruis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jurriaan Pruis updated SPARK-14343: --- Description: When reading a dataset using {{sqlContext.read.text()}} queries on the

[jira] [Closed] (SPARK-11611) Python API for bisecting k-means

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-11611. - Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: (was: ) >

[jira] [Issue Comment Deleted] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-13456: Comment: was deleted (was: This may be related to

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223758#comment-15223758 ] Wenchen Fan commented on SPARK-13456: - I found a minimal case to reproduce this issue: {code} scala>

[jira] [Commented] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223780#comment-15223780 ] Reynold Xin commented on SPARK-14359: - cc [~ekhliang] can you give this a shot? > Improve user

[jira] [Updated] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14359: Description: See the Scala version in SPARK-14285. The main problem we'd need to work around is

[jira] [Resolved] (SPARK-14360) Allow using df.queryExecution.debug.codegen() to dump codegen

2016-04-04 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-14360. --- Resolution: Resolved > Allow using df.queryExecution.debug.codegen() to dump codegen

[jira] [Assigned] (SPARK-13929) Use Scala reflection for UDFs

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13929: Assignee: Apache Spark > Use Scala reflection for UDFs > - >

[jira] [Created] (SPARK-14365) Repartition by column

2016-04-04 Thread Dmitriy Selivanov (JIRA)
Dmitriy Selivanov created SPARK-14365: - Summary: Repartition by column Key: SPARK-14365 URL: https://issues.apache.org/jira/browse/SPARK-14365 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223758#comment-15223758 ] Wenchen Fan edited comment on SPARK-13456 at 4/4/16 9:52 AM: - I found a

[jira] [Assigned] (SPARK-13929) Use Scala reflection for UDFs

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13929: Assignee: (was: Apache Spark) > Use Scala reflection for UDFs >

[jira] [Commented] (SPARK-13929) Use Scala reflection for UDFs

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223838#comment-15223838 ] Apache Spark commented on SPARK-13929: -- User 'joan38' has created a pull request for this issue:

[jira] [Commented] (SPARK-14243) updatedBlockStatuses does not update correctly when removing blocks

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224283#comment-15224283 ] Apache Spark commented on SPARK-14243: -- User 'jeanlyn' has created a pull request for this issue:

[jira] [Created] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Masahiro TANAKA (JIRA)
Masahiro TANAKA created SPARK-14368: --- Summary: Support python.spark.worker.memory with upper-case unit Key: SPARK-14368 URL: https://issues.apache.org/jira/browse/SPARK-14368 Project: Spark

[jira] [Updated] (SPARK-14366) Remove SBT-Idea plugin

2016-04-04 Thread Joan Goyeau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joan Goyeau updated SPARK-14366: Description: We should remove this deprecated sbt-idea plugin as this is generating outdated Idea

[jira] [Updated] (SPARK-14366) Remove SBT-Idea plugin

2016-04-04 Thread Joan Goyeau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joan Goyeau updated SPARK-14366: Description: We should remove this deprecated sbt-idea plugin as this is generating outdated Idea

[jira] [Created] (SPARK-14366) Remove SBT-Idea plugin

2016-04-04 Thread Joan Goyeau (JIRA)
Joan Goyeau created SPARK-14366: --- Summary: Remove SBT-Idea plugin Key: SPARK-14366 URL: https://issues.apache.org/jira/browse/SPARK-14366 Project: Spark Issue Type: Task Components:

[jira] [Updated] (SPARK-14366) Remove SBT-Idea plugin

2016-04-04 Thread Joan Goyeau (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joan Goyeau updated SPARK-14366: Description: We should remove this deprecated sbt-idea plugin as this is generating outdated Idea

[jira] [Created] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as in 1.3

2016-04-04 Thread Tom Hubregtsen (JIRA)
Tom Hubregtsen created SPARK-14367: -- Summary: spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as in 1.3 Key: SPARK-14367 URL: https://issues.apache.org/jira/browse/SPARK-14367

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every

[jira] [Created] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-14394: -- Summary: Generate AggregateHashMap class during TungstenAggregate codegen Key: SPARK-14394 URL: https://issues.apache.org/jira/browse/SPARK-14394 Project: Spark

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225506#comment-15225506 ] Joseph K. Bradley commented on SPARK-13048: --- [~jvstein] Would you be able to test whether the

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13048: Assignee: Apache Spark (was: Joseph K. Bradley) > EMLDAOptimizer deletes dependent

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225593#comment-15225593 ] Apache Spark commented on SPARK-13211: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-14298) LDA should support disable checkpoint

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14298: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Affects

[jira] [Updated] (SPARK-14298) LDA should support disable checkpoint

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14298: -- Issue Type: Bug (was: Improvement) > LDA should support disable checkpoint >

[jira] [Created] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
Jason Piper created SPARK-14393: --- Summary: monotonicallyIncreasingId not monotonically increasing with downstream coalesce Key: SPARK-14393 URL: https://issues.apache.org/jira/browse/SPARK-14393

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every

[jira] [Updated] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

2016-04-04 Thread Jason Piper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Piper updated SPARK-14393: Description: When utilising monotonicallyIncreasingId with a coalesce, it appears that every

[jira] [Commented] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225471#comment-15225471 ] Yong Tang commented on SPARK-14368: --- That is like an easy fix. Will create a pull request shortly. >

[jira] [Created] (SPARK-14395) remove some unused code in REPL module

2016-04-04 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-14395: --- Summary: remove some unused code in REPL module Key: SPARK-14395 URL: https://issues.apache.org/jira/browse/SPARK-14395 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-04-04 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225525#comment-15225525 ] Yanbo Liang commented on SPARK-13783: - [~josephkb] I will work on this. > Model export/import for

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225390#comment-15225390 ] Yin Huai commented on SPARK-13456: -- The original jira for this should be

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225389#comment-15225389 ] Yin Huai commented on SPARK-13456: -- [~rxin] This is the repl issue. > Cannot create encoders for case

[jira] [Assigned] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14368: Assignee: Apache Spark > Support python.spark.worker.memory with upper-case unit >

[jira] [Commented] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225486#comment-15225486 ] Apache Spark commented on SPARK-14368: -- User 'yongtang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14368: Assignee: (was: Apache Spark) > Support python.spark.worker.memory with upper-case

[jira] [Updated] (SPARK-12425) DStream union optimisation

2016-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12425: -- Assignee: Guillaume Poulin > DStream union optimisation > -- > >

[jira] [Resolved] (SPARK-12425) DStream union optimisation

2016-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12425. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10382

[jira] [Resolved] (SPARK-14240) PySpark Standalone Application hangs without any Error message

2016-04-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14240. --- Resolution: Not A Problem Yeah all of this indicates you are not giving your job enough memory. It's

[jira] [Resolved] (SPARK-14386) spark.ml DecisionTreeModel abstraction should not be exposed

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14386. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12158

[jira] [Updated] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13048: -- Target Version/s: 2.0.0 I'll send a PR for this. I'd prefer to fix this in 2.0 only

[jira] [Updated] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14087: -- Target Version/s: (was: 2.0.0) > PySpark ML JavaModel does not properly own params

[jira] [Commented] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225450#comment-15225450 ] Apache Spark commented on SPARK-14394: -- User 'sameeragarwal' has created a pull request for this

[jira] [Assigned] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14394: Assignee: Apache Spark > Generate AggregateHashMap class during TungstenAggregate codegen

[jira] [Assigned] (SPARK-14394) Generate AggregateHashMap class during TungstenAggregate codegen

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14394: Assignee: (was: Apache Spark) > Generate AggregateHashMap class during

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225502#comment-15225502 ] Apache Spark commented on SPARK-13048: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13048: Assignee: Joseph K. Bradley (was: Apache Spark) > EMLDAOptimizer deletes dependent

[jira] [Assigned] (SPARK-14395) remove some unused code in REPL module

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14395: Assignee: Wenchen Fan (was: Apache Spark) > remove some unused code in REPL module >

[jira] [Assigned] (SPARK-14395) remove some unused code in REPL module

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14395: Assignee: Apache Spark (was: Wenchen Fan) > remove some unused code in REPL module >

[jira] [Updated] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-14368: --- Fix Version/s: 2.0.0 1.6.2 > Support python.spark.worker.memory with

[jira] [Resolved] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-14368. Resolution: Fixed > Support python.spark.worker.memory with upper-case unit >

[jira] [Updated] (SPARK-14368) Support python.spark.worker.memory with upper-case unit

2016-04-04 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-14368: --- Assignee: Yong Tang > Support python.spark.worker.memory with upper-case unit >

[jira] [Commented] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225599#comment-15225599 ] Apache Spark commented on SPARK-14359: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14359: Assignee: (was: Apache Spark) > Improve user experience for typed aggregate functions

[jira] [Commented] (SPARK-14125) View related commands

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225675#comment-15225675 ] Xiao Li commented on SPARK-14125: - Now, working on TOK_ALTERVIEW_ADDPARTS/TOK_ALTERVIEW_DROPPARTS. will

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

2016-04-04 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225263#comment-15225263 ] Hyukjin Kwon edited comment on SPARK-14103 at 4/5/16 12:45 AM: --- Oh, sorry I

[jira] [Updated] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Yuanzhen Geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanzhen Geng updated SPARK-14289: -- Summary: Add support to multiple eviction strategies for cached RDD partitions (was: Add

[jira] [Resolved] (SPARK-14287) Method to determine if Dataset is bounded or not

2016-04-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14287. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12080

[jira] [Assigned] (SPARK-14359) Improve user experience for typed aggregate functions in Java

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14359: Assignee: Apache Spark > Improve user experience for typed aggregate functions in Java >

[jira] [Comment Edited] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15223758#comment-15223758 ] Wenchen Fan edited comment on SPARK-13456 at 4/5/16 12:20 AM: -- I found a

[jira] [Assigned] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14289: Assignee: (was: Apache Spark) > Add support to multiple eviction strategies for

[jira] [Commented] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225469#comment-15225469 ] Apache Spark commented on SPARK-14289: -- User 'Earne' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-13456. - Resolution: Fixed > Cannot create encoders for case classes defined in Spark shell after >

[jira] [Assigned] (SPARK-14289) Add support to multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14289: Assignee: Apache Spark > Add support to multiple eviction strategies for cached RDD

[jira] [Commented] (SPARK-14240) PySpark Standalone Application hangs without any Error message

2016-04-04 Thread Sayak Ghosh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225704#comment-15225704 ] Sayak Ghosh commented on SPARK-14240: - The issue has been resolved. Its a GC issue as you mentioned

[jira] [Assigned] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-13048: - Assignee: Joseph K. Bradley > EMLDAOptimizer deletes dependent checkpoint of

[jira] [Commented] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-04-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225468#comment-15225468 ] Wenchen Fan commented on SPARK-13456: - This is a scala bug:

[jira] [Updated] (SPARK-14289) Support multiple eviction strategies for cached RDD partitions

2016-04-04 Thread Yuanzhen Geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanzhen Geng updated SPARK-14289: -- Summary: Support multiple eviction strategies for cached RDD partitions (was: Add support to

[jira] [Commented] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225495#comment-15225495 ] Apache Spark commented on SPARK-14347: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14347: Assignee: (was: Apache Spark) > Require Java 8 for Spark 2.x >

[jira] [Assigned] (SPARK-14347) Require Java 8 for Spark 2.x

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14347: Assignee: Apache Spark > Require Java 8 for Spark 2.x > > >

[jira] [Created] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-14396: --- Summary: Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW) Key: SPARK-14396 URL: https://issues.apache.org/jira/browse/SPARK-14396 Project: Spark

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the

[jira] [Updated] (SPARK-14362) DDL Native Support: Drop View

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14362: Description: Native parsing and native analysis of DDL command: Drop View. Based on the HIVE DDL document

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the

[jira] [Updated] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-14396: Description: Because the concept of partitioning is associated with physical tables, we disable all the

[jira] [Assigned] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14396: Assignee: (was: Apache Spark) > Throw Exceptions for DDLs of Partitioned Views

[jira] [Commented] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225722#comment-15225722 ] Apache Spark commented on SPARK-14396: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14396) Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and ALTER VIEW)

2016-04-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14396: Assignee: Apache Spark > Throw Exceptions for DDLs of Partitioned Views (CREATE VIEW and

[jira] [Updated] (SPARK-13784) Model export/import for spark.ml: RandomForests

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13784: -- Assignee: Gayathri Murali > Model export/import for spark.ml: RandomForests >

[jira] [Commented] (SPARK-14245) webUI should display the user

2016-04-04 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224589#comment-15224589 ] Thomas Graves commented on SPARK-14245: --- ok, personally I would prefer people to assign jira to

[jira] [Resolved] (SPARK-14176) Add processing time trigger

2016-04-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-14176. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11976

[jira] [Resolved] (SPARK-12981) Dataframe distinct() followed by a filter(udf) in pyspark throws a casting error

2016-04-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12981. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12127

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-04 Thread Bo Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224503#comment-15224503 ] Bo Liu commented on SPARK-4105: --- This happened in Spark Streaming 1.3.1 by using direct kafka api {code}

[jira] [Updated] (SPARK-14087) PySpark ML JavaModel does not properly own params after being fit

2016-04-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14087: -- Shepherd: Joseph K. Bradley Assignee: Bryan Cutler > PySpark ML JavaModel does not

[jira] [Commented] (SPARK-14245) webUI should display the user

2016-04-04 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224288#comment-15224288 ] Thomas Graves commented on SPARK-14245: --- [~ajbozarth] Please go ahead and assign yourself the jira

  1   2   3   >