[jira] [Updated] (SPARK-22793) Memory leak in Spark Thrift Server

2017-12-20 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-22793: Affects Version/s: 2.2.1 > Memory leak in Spark Thrift Server > --

[jira] [Commented] (SPARK-22793) Memory leak in Spark Thrift Server

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298043#comment-16298043 ] Apache Spark commented on SPARK-22793: -- User 'zuotingbing' has created a pull reques

[jira] [Commented] (SPARK-10496) Efficient DataFrame cumulative sum

2017-12-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298089#comment-16298089 ] zhengruifeng commented on SPARK-10496: -- According to the prefix scan (https://en.wik

[jira] [Commented] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298134#comment-16298134 ] Marco Gaido commented on SPARK-22841: - I am not able to reproduce on current master.

[jira] [Created] (SPARK-22842) Support consuming oauth token and certs through environment variables

2017-12-20 Thread Anirudh Ramanathan (JIRA)
Anirudh Ramanathan created SPARK-22842: -- Summary: Support consuming oauth token and certs through environment variables Key: SPARK-22842 URL: https://issues.apache.org/jira/browse/SPARK-22842 Pro

[jira] [Updated] (SPARK-22842) Support consuming oauth token and certs through environment variables

2017-12-20 Thread Anirudh Ramanathan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan updated SPARK-22842: --- Priority: Minor (was: Critical) > Support consuming oauth token and certs through en

[jira] [Created] (SPARK-22843) R localCheckpoint API

2017-12-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-22843: Summary: R localCheckpoint API Key: SPARK-22843 URL: https://issues.apache.org/jira/browse/SPARK-22843 Project: Spark Issue Type: Bug Components: S

[jira] [Commented] (SPARK-10496) Efficient DataFrame cumulative sum

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298191#comment-16298191 ] Apache Spark commented on SPARK-10496: -- User 'zhengruifeng' has created a pull reque

[jira] [Created] (SPARK-22844) R date_trunc API

2017-12-20 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-22844: Summary: R date_trunc API Key: SPARK-22844 URL: https://issues.apache.org/jira/browse/SPARK-22844 Project: Spark Issue Type: Improvement Components

[jira] [Commented] (SPARK-22844) R date_trunc API

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298204#comment-16298204 ] Apache Spark commented on SPARK-22844: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-22844) R date_trunc API

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22844: Assignee: Apache Spark > R date_trunc API > > > Key: SPAR

[jira] [Assigned] (SPARK-22844) R date_trunc API

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22844: Assignee: (was: Apache Spark) > R date_trunc API > > >

[jira] [Created] (SPARK-22845) Modify spark.kubernetes.allocation.batch.delay to take time instead of int

2017-12-20 Thread Anirudh Ramanathan (JIRA)
Anirudh Ramanathan created SPARK-22845: -- Summary: Modify spark.kubernetes.allocation.batch.delay to take time instead of int Key: SPARK-22845 URL: https://issues.apache.org/jira/browse/SPARK-22845

[jira] [Commented] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Jatin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298290#comment-16298290 ] Jatin commented on SPARK-22841: --- I have tried the same on spark 2.1 and i have directly run

[jira] [Created] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread bruce xu (JIRA)
bruce xu created SPARK-22846: Summary: table's owner property in hive metastore is null Key: SPARK-22846 URL: https://issues.apache.org/jira/browse/SPARK-22846 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread bruce xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce xu updated SPARK-22846: - Description: I met this issue after upgrading from spark 2.0.1 to spark 2.2.1. when creating table using

[jira] [Updated] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread bruce xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce xu updated SPARK-22846: - Attachment: talbe_owner_null.png select info from hive metastore > table's owner property in hive metast

[jira] [Updated] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread bruce xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce xu updated SPARK-22846: - Description: I met this issue after upgrading from spark 2.0.1 to spark 2.2.1. when creating table using

[jira] [Issue Comment Deleted] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread bruce xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bruce xu updated SPARK-22846: - Comment: was deleted (was: select info from hive metastore) > table's owner property in hive metastore i

[jira] [Assigned] (SPARK-22845) Modify spark.kubernetes.allocation.batch.delay to take time instead of int

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22845: Assignee: (was: Apache Spark) > Modify spark.kubernetes.allocation.batch.delay to take

[jira] [Assigned] (SPARK-22845) Modify spark.kubernetes.allocation.batch.delay to take time instead of int

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22845: Assignee: Apache Spark > Modify spark.kubernetes.allocation.batch.delay to take time inste

[jira] [Commented] (SPARK-22845) Modify spark.kubernetes.allocation.batch.delay to take time instead of int

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298385#comment-16298385 ] Apache Spark commented on SPARK-22845: -- User 'foxish' has created a pull request for

[jira] [Created] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread wuyi (JIRA)
wuyi created SPARK-22847: Summary: Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage Key: SPARK-22847 URL: https://issues.apache.org/jira/browse/SPARK-22847 Project: Spa

[jira] [Commented] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298456#comment-16298456 ] Wenchen Fan commented on SPARK-17647: - {{spark.sql("select '' like '%\\%'").show}

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:05 PM:

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:05 PM:

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:05 PM:

[jira] [Comment Edited] (SPARK-17647) SQL LIKE does not handle backslashes correctly

2017-12-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298456#comment-16298456 ] Wenchen Fan edited comment on SPARK-17647 at 12/20/17 1:06 PM:

[jira] [Assigned] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22847: Assignee: Apache Spark > Remove the duplicate code in AppStatusListener while assigning sc

[jira] [Assigned] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22847: Assignee: (was: Apache Spark) > Remove the duplicate code in AppStatusListener while a

[jira] [Commented] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298461#comment-16298461 ] Apache Spark commented on SPARK-22847: -- User 'Ngone51' has created a pull request fo

[jira] [Commented] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298474#comment-16298474 ] Apache Spark commented on SPARK-22846: -- User 'BruceXu1991' has created a pull reques

[jira] [Assigned] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22846: Assignee: (was: Apache Spark) > table's owner property in hive metastore is null > ---

[jira] [Assigned] (SPARK-22846) table's owner property in hive metastore is null

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22846: Assignee: Apache Spark > table's owner property in hive metastore is null > --

[jira] [Created] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22848: Summary: Do not execute generated code of functions in Generator Key: SPARK-22848 URL: https://issues.apache.org/jira/browse/SPARK-22848 Project: Spark

[jira] [Commented] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298553#comment-16298553 ] Apache Spark commented on SPARK-22848: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22848: Assignee: Apache Spark > Do not execute generated code of functions in Generator > ---

[jira] [Assigned] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22848: Assignee: (was: Apache Spark) > Do not execute generated code of functions in Generato

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

2017-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298589#comment-16298589 ] Thomas Graves commented on SPARK-22765: --- ok so at least based on this one experimen

[jira] [Updated] (SPARK-22848) Do not execute generated code of functions in Generator

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-22692 > Do not execute gen

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Summary: Avoid the generation of useless mutable states by Stack function (was: Do not e

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Description: Current Spark generates two mutable states in generated code for {{Stack}}.

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Description: Current Spark generates two mutable states in generated code for {Stack}. (

[jira] [Updated] (SPARK-22848) Avoid the generation of useless mutable states by Stack function

2017-12-20 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22848: - Description: Current Spark generates two mutable states in generated code for {{{Stack}}}

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

2017-12-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298634#comment-16298634 ] Xuefu Zhang commented on SPARK-22765: - bq: at least based on this one experiment up

[jira] [Resolved] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22841. --- Resolution: Invalid As the error says, there's no matching group in your regex, so this fails. Becau

[jira] [Reopened] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Chetan Bhat (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat reopened SPARK-22841: - Exception should not be thrown in any scenario. Instead proper error message can be displayed. > Se

[jira] [Commented] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298667#comment-16298667 ] Sean Owen commented on SPARK-22841: --- Well, an error is displayed. As I say, exceptions

[jira] [Updated] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22847: -- Priority: Trivial (was: Minor) Fix Version/s: (was: 2.2.1) Issue Type: Improvement

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298696#comment-16298696 ] Apache Spark commented on SPARK-18016: -- User 'kiszk' has created a pull request for

[jira] [Created] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22849: --- Summary: ivy.retrieve pattern should also consider `classifier` Key: SPARK-22849 URL: https://issues.apache.org/jira/browse/SPARK-22849 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298731#comment-16298731 ] Sean Owen commented on SPARK-22849: --- I think this is the same, or closely related to, a

[jira] [Commented] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

2017-12-20 Thread Fernando Pereira (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298735#comment-16298735 ] Fernando Pereira commented on SPARK-21172: -- I'm getting the same problem, even t

[jira] [Commented] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298745#comment-16298745 ] Apache Spark commented on SPARK-22849: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22849: Assignee: Xiao Li (was: Apache Spark) > ivy.retrieve pattern should also consider `classi

[jira] [Assigned] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22849: Assignee: Apache Spark (was: Xiao Li) > ivy.retrieve pattern should also consider `classi

[jira] [Commented] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298749#comment-16298749 ] Xiao Li commented on SPARK-22849: - Not sure whether they are related, but my fix is very

[jira] [Assigned] (SPARK-22788) HdfsUtils.getOutputStream uses non-existent Hadoop conf "hdfs.append.support"

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-22788: Assignee: Marcelo Vanzin > HdfsUtils.getOutputStream uses non-existent Hadoop conf "hdfs.a

[jira] [Resolved] (SPARK-22788) HdfsUtils.getOutputStream uses non-existent Hadoop conf "hdfs.append.support"

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-22788. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19983 [https://git

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298838#comment-16298838 ] Imran Rashid commented on SPARK-22577: -- [~tgraves] what exactly were you thinking?

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298854#comment-16298854 ] Thomas Graves commented on SPARK-22577: --- Yes I was thinking the stage UI (and perha

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298869#comment-16298869 ] Imran Rashid commented on SPARK-22577: -- OK that sounds reasonable. I'd be happy to

[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

2017-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298874#comment-16298874 ] Thomas Graves commented on SPARK-22577: --- correct (unfortunately don't time), anyone

[jira] [Commented] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298885#comment-16298885 ] Apache Spark commented on SPARK-22836: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22836: Assignee: Apache Spark > Executors page is not showing driver logs links > ---

[jira] [Assigned] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22836: Assignee: (was: Apache Spark) > Executors page is not showing driver logs links >

[jira] [Resolved] (SPARK-22824) Spark Structured Streaming Source trait breaking change

2017-12-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22824. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20012 [https://git

[jira] [Resolved] (SPARK-22804) Using a window function inside of an aggregation causes StackOverflowError

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22804. --- Resolution: Duplicate Provisionally resolving this > Using a window function inside of an aggregatio

[jira] [Assigned] (SPARK-22832) BisectingKMeans unpersist unused datasets

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22832: - Assignee: zhengruifeng Fix Version/s: (was: 3.0.0) 2.3.0 > Bisec

[jira] [Resolved] (SPARK-22832) BisectingKMeans unpersist unused datasets

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22832. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20017 [https://github.co

[jira] [Commented] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298935#comment-16298935 ] Marcelo Vanzin commented on SPARK-22836: I posted a patch for 2.3. For 2.2, it s

[jira] [Commented] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298952#comment-16298952 ] Marcelo Vanzin commented on SPARK-22836: The 2.2 issue is different (and also aff

[jira] [Updated] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22836: --- Affects Version/s: (was: 2.1.0) 2.3.0 > Executors page is not show

[jira] [Created] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-22850: -- Summary: Executor page in SHS does not show driver Key: SPARK-22850 URL: https://issues.apache.org/jira/browse/SPARK-22850 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-22849) ivy.retrieve pattern should also consider `classifier`

2017-12-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22849. - Resolution: Fixed Fix Version/s: 2.3.0 > ivy.retrieve pattern should also consider `classifier` >

[jira] [Updated] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22850: --- Affects Version/s: (was: 2.2.0) 2.3.0 > Executor page in SHS does

[jira] [Commented] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298991#comment-16298991 ] Marcelo Vanzin commented on SPARK-22850: Sorry for the noise, this is actually a

[jira] [Created] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

2017-12-20 Thread John Brock (JIRA)
John Brock created SPARK-22851: -- Summary: Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum Key: SPARK-22851 URL: https://issues.apache.org/jira/browse/SPARK-22851 Projec

[jira] [Assigned] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22850: Assignee: (was: Apache Spark) > Executor page in SHS does not show driver > --

[jira] [Assigned] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22850: Assignee: Apache Spark > Executor page in SHS does not show driver > -

[jira] [Commented] (SPARK-22850) Executor page in SHS does not show driver

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299039#comment-16299039 ] Apache Spark commented on SPARK-22850: -- User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299059#comment-16299059 ] Sean Owen commented on SPARK-22851: --- I see the same thing. The source release seems fin

[jira] [Resolved] (SPARK-22830) Scala Coding style has been improved in Spark Examples

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22830. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20016 [https://github.co

[jira] [Assigned] (SPARK-22830) Scala Coding style has been improved in Spark Examples

2017-12-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22830: - Assignee: Chetan Khatri > Scala Coding style has been improved in Spark Examples > -

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

2017-12-20 Thread John Brock (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299109#comment-16299109 ] John Brock commented on SPARK-22851: Some colleagues claimed to have specifically dow

[jira] [Commented] (SPARK-5594) SparkException: Failed to get broadcast (TorrentBroadcast)

2017-12-20 Thread Swathi Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299149#comment-16299149 ] Swathi Subramanian commented on SPARK-5594: --- Any update on this issue? I have a

[jira] [Updated] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-22739: - Target Version/s: 2.3.0 > Additional Expression Support for Objects > ---

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299167#comment-16299167 ] Michael Armbrust commented on SPARK-22739: -- Any progress on this? Branch cut is

[jira] [Updated] (SPARK-22836) Executors page is not showing driver logs links

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22836: --- Description: -I think this was mainly caused by SPARK-15951; that changed modified the execu

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Aleksander Eskilson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299177#comment-16299177 ] Aleksander Eskilson commented on SPARK-22739: - Yes. I've got a branch with th

[jira] [Updated] (SPARK-22839) Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner abstraction

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-22839: --- Description: As discussed in https://github.com/apache/spark/pull/19954, the current code for

[jira] [Created] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Erik LaBianca (JIRA)
Erik LaBianca created SPARK-22852: - Summary: sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc Key: SPARK-22852 URL: https://issues.apache.org/jira/browse/SPARK-22852 Project: Spar

[jira] [Resolved] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22847. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20033 [https:/

[jira] [Assigned] (SPARK-22847) Remove the duplicate code in AppStatusListener while assigning schedulingPool for stage

2017-12-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22847: -- Assignee: wuyi > Remove the duplicate code in AppStatusListener while assigning schedu

[jira] [Commented] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299191#comment-16299191 ] Apache Spark commented on SPARK-22852: -- User 'easel' has created a pull request for

[jira] [Assigned] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22852: Assignee: (was: Apache Spark) > sbt publishLocal fails due to -Xlint:unchecked flag pa

[jira] [Assigned] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22852: Assignee: Apache Spark > sbt publishLocal fails due to -Xlint:unchecked flag passed to jav

[jira] [Commented] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Erik LaBianca (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299192#comment-16299192 ] Erik LaBianca commented on SPARK-22852: --- There's a one-liner PR to resolve this at

[jira] [Commented] (SPARK-22852) sbt publishLocal fails due to -Xlint:unchecked flag passed to javadoc

2017-12-20 Thread Erik LaBianca (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299193#comment-16299193 ] Erik LaBianca commented on SPARK-22852: --- With the fix: {noformat} > launcher/publi

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

2017-12-20 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299232#comment-16299232 ] Michael Armbrust commented on SPARK-22739: -- Sounds good to me. I'm happy to pro

  1   2   >