[jira] [Commented] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2017-07-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097166#comment-16097166 ] Sean Owen commented on SPARK-14643: --- [~joshrosen] so we've always assumed that Scala ve

[jira] [Updated] (SPARK-21506) The description of "spark.executor.cores" may be not correct

2017-07-22 Thread liuxian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-21506: Description: The description for "spark.executor.cores" :"The number of cores assigned to each executor is

[jira] [Created] (SPARK-21506) The description of "spark.executor.cores" may be not correct

2017-07-22 Thread liuxian (JIRA)
liuxian created SPARK-21506: --- Summary: The description of "spark.executor.cores" may be not correct Key: SPARK-21506 URL: https://issues.apache.org/jira/browse/SPARK-21506 Project: Spark Issue Ty

[jira] [Commented] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2017-07-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097169#comment-16097169 ] Josh Rosen commented on SPARK-14643: [~srowen], I just posted a comment about this ov

[jira] [Assigned] (SPARK-21506) The description of "spark.executor.cores" may be not correct

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21506: Assignee: Apache Spark > The description of "spark.executor.cores" may be not correct > -

[jira] [Assigned] (SPARK-21506) The description of "spark.executor.cores" may be not correct

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21506: Assignee: (was: Apache Spark) > The description of "spark.executor.cores" may be not

[jira] [Commented] (SPARK-21506) The description of "spark.executor.cores" may be not correct

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097171#comment-16097171 ] Apache Spark commented on SPARK-21506: -- User '10110346' has created a pull request f

[jira] [Commented] (SPARK-21498) quick start -> one py demo have some bug in code

2017-07-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097172#comment-16097172 ] Sean Owen commented on SPARK-21498: --- http://spark.apache.org/contributing.html > quick

[jira] [Commented] (SPARK-19471) [SQL]A confusing NullPointerException when creating table

2017-07-22 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097221#comment-16097221 ] cen yuhai commented on SPARK-19471: --- I try this pr, it works well. > [SQL]A confusing

[jira] [Created] (SPARK-21507) Exception when using spark.jars.packages

2017-07-22 Thread JIRA
Maciej Bryński created SPARK-21507: -- Summary: Exception when using spark.jars.packages Key: SPARK-21507 URL: https://issues.apache.org/jira/browse/SPARK-21507 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17528) data should be copied properly before saving into InternalRow

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097293#comment-16097293 ] Apache Spark commented on SPARK-17528: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-16599) java.util.NoSuchElementException: None.get at at org.apache.spark.storage.BlockInfoManager.releaseAllLocksForTask(BlockInfoManager.scala:343)

2017-07-22 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097302#comment-16097302 ] Ryan Williams commented on SPARK-16599: --- Update: I think the real story here is the

[jira] [Created] (SPARK-21508) Documentation on 'Spark Streaming Custom Receivers' has error in example code

2017-07-22 Thread Remis Haroon (JIRA)
Remis Haroon created SPARK-21508: Summary: Documentation on 'Spark Streaming Custom Receivers' has error in example code Key: SPARK-21508 URL: https://issues.apache.org/jira/browse/SPARK-21508 Project

[jira] [Commented] (SPARK-16599) java.util.NoSuchElementException: None.get at at org.apache.spark.storage.BlockInfoManager.releaseAllLocksForTask(BlockInfoManager.scala:343)

2017-07-22 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097318#comment-16097318 ] Ryan Williams commented on SPARK-16599: --- Seems like the second {{SparkContext}}'s

[jira] [Comment Edited] (SPARK-16599) java.util.NoSuchElementException: None.get at at org.apache.spark.storage.BlockInfoManager.releaseAllLocksForTask(BlockInfoManager.scala:343)

2017-07-22 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097318#comment-16097318 ] Ryan Williams edited comment on SPARK-16599 at 7/22/17 1:23 PM: ---

[jira] [Updated] (SPARK-21508) Documentation on 'Spark Streaming Custom Receivers' has error in example code

2017-07-22 Thread Remis Haroon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remis Haroon updated SPARK-21508: - Priority: Minor (was: Major) > Documentation on 'Spark Streaming Custom Receivers' has error in

[jira] [Updated] (SPARK-21508) Documentation on 'Spark Streaming Custom Receivers' has error in example code

2017-07-22 Thread Remis Haroon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remis Haroon updated SPARK-21508: - Labels: (was: newbie) > Documentation on 'Spark Streaming Custom Receivers' has error in exampl

[jira] [Commented] (SPARK-21498) quick start -> one py demo have some bug in code

2017-07-22 Thread LiZhaochuan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097340#comment-16097340 ] LiZhaochuan commented on SPARK-21498: - OK,let me try! -- 原始邮件 --

[jira] [Created] (SPARK-21509) Add a config to enable adaptive query execution only for the last query execution.

2017-07-22 Thread jin xing (JIRA)
jin xing created SPARK-21509: Summary: Add a config to enable adaptive query execution only for the last query execution. Key: SPARK-21509 URL: https://issues.apache.org/jira/browse/SPARK-21509 Project:

[jira] [Assigned] (SPARK-21509) Add a config to enable adaptive query execution only for the last query execution.

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21509: Assignee: Apache Spark > Add a config to enable adaptive query execution only for the las

[jira] [Assigned] (SPARK-21509) Add a config to enable adaptive query execution only for the last query execution.

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21509: Assignee: (was: Apache Spark) > Add a config to enable adaptive query execution only

[jira] [Commented] (SPARK-21509) Add a config to enable adaptive query execution only for the last query execution.

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097353#comment-16097353 ] Apache Spark commented on SPARK-21509: -- User 'jinxing64' has created a pull request

[jira] [Commented] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097376#comment-16097376 ] Apache Spark commented on SPARK-20236: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20236: Assignee: Apache Spark > Overwrite a partitioned data source table should only overwrite r

[jira] [Assigned] (SPARK-20236) Overwrite a partitioned data source table should only overwrite related partitions

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20236: Assignee: (was: Apache Spark) > Overwrite a partitioned data source table should only

[jira] [Commented] (SPARK-21508) Documentation on 'Spark Streaming Custom Receivers' has error in example code

2017-07-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097387#comment-16097387 ] Sean Owen commented on SPARK-21508: --- Seems OK [~remisharoon], you can make a pull reque

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097479#comment-16097479 ] Apache Spark commented on SPARK-10063: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-21510) Add isMaterialized() and eager persist() to Dataset APIs

2017-07-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-21510: --- Summary: Add isMaterialized() and eager persist() to Dataset APIs Key: SPARK-21510 URL: https://issues.apache.org/jira/browse/SPARK-21510 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-21510) Add isMaterialized() and eager persist() to Dataset APIs

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21510: Assignee: Apache Spark (was: Xiao Li) > Add isMaterialized() and eager persist() to Datas

[jira] [Commented] (SPARK-21510) Add isMaterialized() and eager persist() to Dataset APIs

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097498#comment-16097498 ] Apache Spark commented on SPARK-21510: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-21510) Add isMaterialized() and eager persist() to Dataset APIs

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21510: Assignee: Xiao Li (was: Apache Spark) > Add isMaterialized() and eager persist() to Datas

[jira] [Assigned] (SPARK-21357) FileInputDStream not remove out of date RDD

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21357: Assignee: Apache Spark > FileInputDStream not remove out of date RDD > ---

[jira] [Assigned] (SPARK-21357) FileInputDStream not remove out of date RDD

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21357: Assignee: (was: Apache Spark) > FileInputDStream not remove out of date RDD >

[jira] [Commented] (SPARK-21357) FileInputDStream not remove out of date RDD

2017-07-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097519#comment-16097519 ] Apache Spark commented on SPARK-21357: -- User 'shaofei007' has created a pull request

[jira] [Commented] (SPARK-21443) Very long planning duration for queries with lots of operations

2017-07-22 Thread Eyal Zituny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097521#comment-16097521 ] Eyal Zituny commented on SPARK-21443: - Disabling this options indeed, fixed my proble

[jira] [Created] (SPARK-21511) Unable to load Pipeline or Pipeline model

2017-07-22 Thread Saif Addin (JIRA)
Saif Addin created SPARK-21511: -- Summary: Unable to load Pipeline or Pipeline model Key: SPARK-21511 URL: https://issues.apache.org/jira/browse/SPARK-21511 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21511) Unable to load Pipeline or PipelineModel

2017-07-22 Thread Saif Addin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saif Addin updated SPARK-21511: --- Summary: Unable to load Pipeline or PipelineModel (was: Unable to load Pipeline or Pipeline model)

[jira] [Created] (SPARK-21512) DatasetCacheSuite need to execute unpersistent after executing peristent

2017-07-22 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-21512: Summary: DatasetCacheSuite need to execute unpersistent after executing peristent Key: SPARK-21512 URL: https://issues.apache.org/jira/browse/SPARK-21512 Proj