[jira] [Comment Edited] (SPARK-23904) Big execution plan cause OOM

2018-06-02 Thread Izek Greenfield (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499315#comment-16499315 ] Izek Greenfield edited comment on SPARK-23904 at 6/3/18 6:11 AM: -

[jira] [Commented] (SPARK-23904) Big execution plan cause OOM

2018-06-02 Thread Izek Greenfield (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499315#comment-16499315 ] Izek Greenfield commented on SPARK-23904: - [~RBerenguel] Did you remember to run

[jira] [Updated] (SPARK-24441) Expose total estimated size of states in HDFSBackedStateStoreProvider

2018-06-02 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-24441: - Summary: Expose total estimated size of states in HDFSBackedStateStoreProvider (was: Expose tot

[jira] [Updated] (SPARK-24441) Expose total size of states in HDFSBackedStateStoreProvider

2018-06-02 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-24441: - Description: While Spark exposes state metrics for single state, Spark still doesn't expose ove

[jira] [Updated] (SPARK-24356) Duplicate strings in File.path managed by FileSegmentManagedBuffer

2018-06-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24356: -- Fix Version/s: (was: 3.0.0) 2.4.0 > Duplicate strings in File.path managed by F

[jira] [Assigned] (SPARK-24356) Duplicate strings in File.path managed by FileSegmentManagedBuffer

2018-06-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24356: - Assignee: Misha Dmitriev > Duplicate strings in File.path managed by FileSegmentManagedBuffer >

[jira] [Resolved] (SPARK-24356) Duplicate strings in File.path managed by FileSegmentManagedBuffer

2018-06-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24356. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21456 [https://github.c

[jira] [Commented] (SPARK-24369) A bug when having multiple distinct aggregations

2018-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499292#comment-16499292 ] Apache Spark commented on SPARK-24369: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-23390) Flaky test: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

2018-06-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23390: -- Description: We're seeing multiple failures in {{FileBasedDataSourceSuite}} in {{spark-branch

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Yinan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499220#comment-16499220 ] Yinan Li commented on SPARK-24434: -- [~skonto] Thanks for the detailed thoughts! I agree

[jira] [Commented] (SPARK-15784) Add Power Iteration Clustering to spark.ml

2018-06-02 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499143#comment-16499143 ] Miao Wang commented on SPARK-15784: --- [~josephkb] Just saw your comments. Let me try fi

[jira] [Comment Edited] (SPARK-24431) wrong areaUnderPR calculation in BinaryClassificationEvaluator

2018-06-02 Thread Teng Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499109#comment-16499109 ] Teng Peng edited comment on SPARK-24431 at 6/2/18 6:48 PM: --- I

[jira] [Comment Edited] (SPARK-24431) wrong areaUnderPR calculation in BinaryClassificationEvaluator

2018-06-02 Thread Teng Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499109#comment-16499109 ] Teng Peng edited comment on SPARK-24431 at 6/2/18 6:47 PM: --- I

[jira] [Comment Edited] (SPARK-24431) wrong areaUnderPR calculation in BinaryClassificationEvaluator

2018-06-02 Thread Teng Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499109#comment-16499109 ] Teng Peng edited comment on SPARK-24431 at 6/2/18 6:47 PM: --- I

[jira] [Comment Edited] (SPARK-24431) wrong areaUnderPR calculation in BinaryClassificationEvaluator

2018-06-02 Thread Teng Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499109#comment-16499109 ] Teng Peng edited comment on SPARK-24431 at 6/2/18 6:46 PM: --- I

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499140#comment-16499140 ] Stavros Kontopoulos edited comment on SPARK-24434 at 6/2/18 6:22 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499140#comment-16499140 ] Stavros Kontopoulos edited comment on SPARK-24434 at 6/2/18 6:20 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499140#comment-16499140 ] Stavros Kontopoulos edited comment on SPARK-24434 at 6/2/18 6:19 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499140#comment-16499140 ] Stavros Kontopoulos edited comment on SPARK-24434 at 6/2/18 6:17 PM: -

[jira] [Comment Edited] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499140#comment-16499140 ] Stavros Kontopoulos edited comment on SPARK-24434 at 6/2/18 6:12 PM: -

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-02 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499140#comment-16499140 ] Stavros Kontopoulos commented on SPARK-24434: - I agree with [~felixcheung] a

[jira] [Commented] (SPARK-24431) wrong areaUnderPR calculation in BinaryClassificationEvaluator

2018-06-02 Thread Teng Peng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499109#comment-16499109 ] Teng Peng commented on SPARK-24431: --- I am trying to understand this description. What'

[jira] [Assigned] (SPARK-24387) Heartbeat-timeout executor is added back and used again

2018-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24387: Assignee: (was: Apache Spark) > Heartbeat-timeout executor is added back and used aga

[jira] [Commented] (SPARK-24387) Heartbeat-timeout executor is added back and used again

2018-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498942#comment-16498942 ] Apache Spark commented on SPARK-24387: -- User 'lirui-apache' has created a pull requ

[jira] [Assigned] (SPARK-24387) Heartbeat-timeout executor is added back and used again

2018-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24387: Assignee: Apache Spark > Heartbeat-timeout executor is added back and used again > --

[jira] [Assigned] (SPARK-24455) fix typo in TaskSchedulerImpl's comments

2018-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24455: Assignee: Apache Spark > fix typo in TaskSchedulerImpl's comments > -

[jira] [Commented] (SPARK-24455) fix typo in TaskSchedulerImpl's comments

2018-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498919#comment-16498919 ] Apache Spark commented on SPARK-24455: -- User 'xueyumusic' has created a pull reques

[jira] [Assigned] (SPARK-24455) fix typo in TaskSchedulerImpl's comments

2018-06-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24455: Assignee: (was: Apache Spark) > fix typo in TaskSchedulerImpl's comments > --

[jira] [Updated] (SPARK-24455) fix typo in TaskSchedulerImpl's comments

2018-06-02 Thread xueyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xueyu updated SPARK-24455: -- External issue URL: https://github.com/apache/spark/pull/21485 > fix typo in TaskSchedulerImpl's comments > --

[jira] [Created] (SPARK-24455) fix typo in TaskSchedulerImpl's comments

2018-06-02 Thread xueyu (JIRA)
xueyu created SPARK-24455: - Summary: fix typo in TaskSchedulerImpl's comments Key: SPARK-24455 URL: https://issues.apache.org/jira/browse/SPARK-24455 Project: Spark Issue Type: Improvement