[jira] [Commented] (SPARK-32523) Override alter table in JDBC dialects

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187138#comment-17187138 ] Apache Spark commented on SPARK-32523: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-32523) Override alter table in JDBC dialects

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32523: Assignee: (was: Apache Spark) > Override alter table in JDBC dialects > -

[jira] [Assigned] (SPARK-32523) Override alter table in JDBC dialects

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32523: Assignee: Apache Spark > Override alter table in JDBC dialects >

[jira] [Assigned] (SPARK-32738) thread safe endpoints may hang due to fatal exception

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32738: Assignee: Apache Spark > thread safe endpoints may hang due to fatal exception >

[jira] [Assigned] (SPARK-32738) thread safe endpoints may hang due to fatal exception

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32738: Assignee: (was: Apache Spark) > thread safe endpoints may hang due to fatal exception

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal exception

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187136#comment-17187136 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for

[jira] [Created] (SPARK-32738) thread safe endpoints may hang due to fatal exception

2020-08-29 Thread Zhenhua Wang (Jira)
Zhenhua Wang created SPARK-32738: Summary: thread safe endpoints may hang due to fatal exception Key: SPARK-32738 URL: https://issues.apache.org/jira/browse/SPARK-32738 Project: Spark Issue T

[jira] [Updated] (SPARK-32310) ML params default value parity

2020-08-29 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-32310: --- Fix Version/s: 3.1.0 > ML params default value parity > -- > >

[jira] [Updated] (SPARK-32310) ML params default value parity

2020-08-29 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-32310: --- Fix Version/s: 3.0.1 > ML params default value parity > -- > >

[jira] [Updated] (SPARK-32676) Fix double caching in KMeans/BiKMeans

2020-08-29 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-32676: --- Fix Version/s: 3.0.1 > Fix double caching in KMeans/BiKMeans > -

[jira] [Updated] (SPARK-32726) Filter by column alias in where clause

2020-08-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32726: Description: {{group by}} and {{order by}} clause support it. but {{where}} does not support it:

[jira] [Created] (SPARK-32737) readResolve() in BlockManagerId

2020-08-29 Thread Armin Primadi (Jira)
Armin Primadi created SPARK-32737: - Summary: readResolve() in BlockManagerId Key: SPARK-32737 URL: https://issues.apache.org/jira/browse/SPARK-32737 Project: Spark Issue Type: Question

[jira] [Resolved] (SPARK-32629) Record metrics of extra BitSet/HashSet in full outer shuffled hash join

2020-08-29 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32629. -- Fix Version/s: 3.1.0 Assignee: Cheng Su Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-32693) Compare two dataframes with same schema except nullable property

2020-08-29 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187111#comment-17187111 ] Takeshi Yamamuro commented on SPARK-32693: -- Since the release vote for v3.0.1 (

[jira] [Updated] (SPARK-32693) Compare two dataframes with same schema except nullable property

2020-08-29 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32693: - Fix Version/s: 2.4.7 3.0.2 > Compare two dataframes with same schema

[jira] [Resolved] (SPARK-32718) remove unnecessary keywords for interval units

2020-08-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32718. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29560 [https://

[jira] [Commented] (SPARK-32726) Filter by column alias in where clause

2020-08-29 Thread Greg Rahn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187083#comment-17187083 ] Greg Rahn commented on SPARK-32726: --- Standard SQL disallows references to column alias

[jira] [Updated] (SPARK-32712) Support writing Hive non-ORC/Parquet bucketed table

2020-08-29 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32712: - Affects Version/s: (was: 3.0.0) 3.1.0 > Support writing Hive non-ORC/Parquet

[jira] [Updated] (SPARK-26164) [SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2020-08-29 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-26164: - Affects Version/s: 3.1.0 > [SQL] Allow FileFormatWriter to write multiple partitions/buckets without sor

[jira] [Updated] (SPARK-32709) Write Hive ORC/Parquet bucketed table with hivehash (for Hive 1,2)

2020-08-29 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32709: - Affects Version/s: (was: 3.0.0) 3.1.0 > Write Hive ORC/Parquet bucketed table

[jira] [Updated] (SPARK-32710) Add Hive Murmur3Hash expression

2020-08-29 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32710: - Affects Version/s: (was: 3.0.0) 3.1.0 > Add Hive Murmur3Hash expression > ---

[jira] [Updated] (SPARK-32711) Write Hive ORC/Parquet bucketed table with hive murmur3hash (for Hive 3)

2020-08-29 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-32711: - Affects Version/s: (was: 3.0.0) 3.1.0 > Write Hive ORC/Parquet bucketed table

[jira] [Assigned] (SPARK-32736) Avoid caching the removed decommissioned executors in TaskSchedulerImpl

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32736: Assignee: Apache Spark > Avoid caching the removed decommissioned executors in TaskSchedu

[jira] [Assigned] (SPARK-32736) Avoid caching the removed decommissioned executors in TaskSchedulerImpl

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32736: Assignee: Apache Spark > Avoid caching the removed decommissioned executors in TaskSchedu

[jira] [Assigned] (SPARK-32736) Avoid caching the removed decommissioned executors in TaskSchedulerImpl

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32736: Assignee: (was: Apache Spark) > Avoid caching the removed decommissioned executors in

[jira] [Commented] (SPARK-32736) Avoid caching the removed decommissioned executors in TaskSchedulerImpl

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187023#comment-17187023 ] Apache Spark commented on SPARK-32736: -- User 'Ngone51' has created a pull request f

[jira] [Updated] (SPARK-32734) RDD actions in DStream.transfrom delays batch submission

2020-08-29 Thread Liechuan Ou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liechuan Ou updated SPARK-32734: Labels: pull-request-available (was: ) > RDD actions in DStream.transfrom delays batch submission

[jira] [Updated] (SPARK-32735) RDD actions in DStream.transfrom don't show at batch page

2020-08-29 Thread Liechuan Ou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liechuan Ou updated SPARK-32735: Labels: pull-request-available (was: ) > RDD actions in DStream.transfrom don't show at batch pag

[jira] [Created] (SPARK-32736) Avoid caching the removed decommissioned executors in TaskSchedulerImpl

2020-08-29 Thread wuyi (Jira)
wuyi created SPARK-32736: Summary: Avoid caching the removed decommissioned executors in TaskSchedulerImpl Key: SPARK-32736 URL: https://issues.apache.org/jira/browse/SPARK-32736 Project: Spark Issu

[jira] [Created] (SPARK-32735) RDD actions in DStream.transfrom don't show at batch page

2020-08-29 Thread Liechuan Ou (Jira)
Liechuan Ou created SPARK-32735: --- Summary: RDD actions in DStream.transfrom don't show at batch page Key: SPARK-32735 URL: https://issues.apache.org/jira/browse/SPARK-32735 Project: Spark Issue

[jira] [Created] (SPARK-32734) RDD actions in DStream.transfrom delays batch submission

2020-08-29 Thread Liechuan Ou (Jira)
Liechuan Ou created SPARK-32734: --- Summary: RDD actions in DStream.transfrom delays batch submission Key: SPARK-32734 URL: https://issues.apache.org/jira/browse/SPARK-32734 Project: Spark Issue

[jira] [Resolved] (SPARK-32727) replace CaseWhen with If when there is only one case

2020-08-29 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis resolved SPARK-32727. Resolution: Duplicate > replace CaseWhen with If when there is only one case > ---

[jira] [Commented] (SPARK-32733) Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186920#comment-17186920 ] Apache Spark commented on SPARK-32733: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-32733) Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186919#comment-17186919 ] Apache Spark commented on SPARK-32733: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-32733) Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32733: Assignee: Apache Spark > Add extended information - arguments/examples/since/notes of exp

[jira] [Assigned] (SPARK-32733) Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation

2020-08-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32733: Assignee: (was: Apache Spark) > Add extended information - arguments/examples/since/n

[jira] [Created] (SPARK-32733) Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation

2020-08-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-32733: Summary: Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation Key: SPARK-32733 URL: https://issues.apache.org/jira/browse