[jira] [Commented] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641128#comment-17641128 ] Apache Spark commented on SPARK-41328: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641126#comment-17641126 ] Apache Spark commented on SPARK-41328: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41282. -- Resolution: Fixed > Feature parity: Column API in Spark Connect >

[jira] [Reopened] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-41282: -- > Feature parity: Column API in Spark Connect > --- > >

[jira] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282 ] Hyukjin Kwon deleted comment on SPARK-41282: -- was (Author: apachespark): User 'grundprinzip' has created a pull request for this issue: https://github.com/apache/spark/pull/38839 > Feature

[jira] [Resolved] (SPARK-41315) Implement `DataFrame.replace ` and `DataFrame.na.replace `

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41315. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38836

[jira] [Commented] (SPARK-41335) Support IsNull and IsNotNull in Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641115#comment-17641115 ] Apache Spark commented on SPARK-41335: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41335) Support IsNull and IsNotNull in Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641114#comment-17641114 ] Apache Spark commented on SPARK-41335: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41335) Support IsNull and IsNotNull in Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41335: Assignee: Apache Spark (was: Rui Wang) > Support IsNull and IsNotNull in Column >

[jira] [Assigned] (SPARK-41335) Support IsNull and IsNotNull in Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41335: Assignee: Rui Wang (was: Apache Spark) > Support IsNull and IsNotNull in Column >

[jira] [Assigned] (SPARK-41334) move SortField from relations.proto to expressions.proto

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41334: - Assignee: (was: Ruifeng Zheng) > move SortField from relations.proto to

[jira] [Created] (SPARK-41335) Support IsNull and IsNotNull in Column

2022-11-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-41335: Summary: Support IsNull and IsNotNull in Column Key: SPARK-41335 URL: https://issues.apache.org/jira/browse/SPARK-41335 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41334) move SortField from relations.proto to expressions.proto

2022-11-29 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41334: - Summary: move SortField from relations.proto to expressions.proto Key: SPARK-41334 URL: https://issues.apache.org/jira/browse/SPARK-41334 Project: Spark

[jira] [Resolved] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41323. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38840

[jira] [Assigned] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-41323: --- Assignee: Serge Rielau > Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE() >

[jira] [Resolved] (SPARK-41331) Add orderBy and drop_duplicates

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41331. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38846

[jira] [Assigned] (SPARK-41331) Add orderBy and drop_duplicates

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41331: - Assignee: Ruifeng Zheng > Add orderBy and drop_duplicates >

[jira] [Created] (SPARK-41333) Make `Groupby.{min, max, sum, avg, mean}` compatible with PySpark

2022-11-29 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41333: - Summary: Make `Groupby.{min, max, sum, avg, mean}` compatible with PySpark Key: SPARK-41333 URL: https://issues.apache.org/jira/browse/SPARK-41333 Project: Spark

[jira] [Resolved] (SPARK-41330) Improve Documentation for Take,Tail, Limit and Offset

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41330. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38845

[jira] [Assigned] (SPARK-41332) Fix `nullOrdering` in `SortOrder`

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41332: Assignee: (was: Apache Spark) > Fix `nullOrdering` in `SortOrder` >

[jira] [Commented] (SPARK-41332) Fix `nullOrdering` in `SortOrder`

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641076#comment-17641076 ] Apache Spark commented on SPARK-41332: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41332) Fix `nullOrdering` in `SortOrder`

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41332: Assignee: Apache Spark > Fix `nullOrdering` in `SortOrder` >

[jira] [Created] (SPARK-41332) Fix `nullOrdering` in `SortOrder`

2022-11-29 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41332: - Summary: Fix `nullOrdering` in `SortOrder` Key: SPARK-41332 URL: https://issues.apache.org/jira/browse/SPARK-41332 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41290) Support GENERATED ALWAYS AS syntax in create/replace table to create a generated column

2022-11-29 Thread Allison Portis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Portis updated SPARK-41290: --- Description: Support GENERATED ALWAYS AS syntax for defining generated columns in create

[jira] [Updated] (SPARK-41290) Support GENERATED ALWAYS AS syntax in create/replace table to create a generated column

2022-11-29 Thread Allison Portis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Portis updated SPARK-41290: --- Description: Support GENERATED ALWAYS AS syntax for defining generated columns in create

[jira] [Updated] (SPARK-41290) Support GENERATED ALWAYS AS syntax in create/replace table to create a generated column

2022-11-29 Thread Allison Portis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Portis updated SPARK-41290: --- Summary: Support GENERATED ALWAYS AS syntax in create/replace table to create a generated

[jira] [Updated] (SPARK-41290) Support GENERATED ALWAYS AS in create/replace table

2022-11-29 Thread Allison Portis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Portis updated SPARK-41290: --- Description: Support GENERATED ALWAYS AS syntax for defining generated columns in create

[jira] [Assigned] (SPARK-41331) Add orderBy and drop_duplicates

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41331: Assignee: Apache Spark > Add orderBy and drop_duplicates >

[jira] [Commented] (SPARK-41331) Add orderBy and drop_duplicates

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641059#comment-17641059 ] Apache Spark commented on SPARK-41331: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41331) Add orderBy and drop_duplicates

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41331: Assignee: (was: Apache Spark) > Add orderBy and drop_duplicates >

[jira] [Updated] (SPARK-41290) Support GENERATED ALWAYS AS in create/replace table

2022-11-29 Thread Allison Portis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Portis updated SPARK-41290: --- Description: Support GENERATED ALWAYS AS syntax for defining generated columns in create

[jira] [Updated] (SPARK-41290) Support GENERATED ALWAYS AS in create/replace table

2022-11-29 Thread Allison Portis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Portis updated SPARK-41290: --- Summary: Support GENERATED ALWAYS AS in create/replace table (was: Support GENERATED

[jira] [Updated] (SPARK-41290) Support GENERATED ALWAYS AS in create and replace table

2022-11-29 Thread Allison Portis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Portis updated SPARK-41290: --- Summary: Support GENERATED ALWAYS AS in create and replace table (was: Support GENERATED

[jira] [Resolved] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41328. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38844

[jira] [Assigned] (SPARK-41330) Improve Documentation for Take,Tail, Limit and Offset

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41330: Assignee: Apache Spark (was: Rui Wang) > Improve Documentation for Take,Tail, Limit and

[jira] [Assigned] (SPARK-41330) Improve Documentation for Take,Tail, Limit and Offset

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41330: Assignee: Rui Wang (was: Apache Spark) > Improve Documentation for Take,Tail, Limit and

[jira] [Commented] (SPARK-41330) Improve Documentation for Take,Tail, Limit and Offset

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641054#comment-17641054 ] Apache Spark commented on SPARK-41330: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-41331) Add orderBy and drop_duplicates

2022-11-29 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41331: - Summary: Add orderBy and drop_duplicates Key: SPARK-41331 URL: https://issues.apache.org/jira/browse/SPARK-41331 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41330) Improve Documentation for Take,Tail, Limit and Offset

2022-11-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-41330: Summary: Improve Documentation for Take,Tail, Limit and Offset Key: SPARK-41330 URL: https://issues.apache.org/jira/browse/SPARK-41330 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40987) Avoid creating a directory when deleting a block, causing DAGScheduler to not work

2022-11-29 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40987: --- Assignee: dzcxzl > Avoid creating a directory when deleting a block,

[jira] [Resolved] (SPARK-40987) Avoid creating a directory when deleting a block, causing DAGScheduler to not work

2022-11-29 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40987. - Fix Version/s: 3.3.2 3.2.3 3.4.0

[jira] [Commented] (SPARK-41299) OOM when filter pushdown `last_day` function

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641048#comment-17641048 ] Hyukjin Kwon commented on SPARK-41299: -- Would be great if we have a minimal reproducer > OOM when

[jira] [Commented] (SPARK-41294) Assign a name to the error class _LEGACY_ERROR_TEMP_1203

2022-11-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641044#comment-17641044 ] BingKun Pan commented on SPARK-41294: - I work on it. > Assign a name to the error class

[jira] [Created] (SPARK-41329) Solve circular import between Column and _typing/functions

2022-11-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-41329: Summary: Solve circular import between Column and _typing/functions Key: SPARK-41329 URL: https://issues.apache.org/jira/browse/SPARK-41329 Project: Spark Issue

[jira] [Commented] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641027#comment-17641027 ] Apache Spark commented on SPARK-41328: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641026#comment-17641026 ] Apache Spark commented on SPARK-41328: -- User 'grundprinzip' has created a pull request for this

[jira] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282 ] Hyukjin Kwon deleted comment on SPARK-41282: -- was (Author: apachespark): User 'grundprinzip' has created a pull request for this issue: https://github.com/apache/spark/pull/38839 > Feature

[jira] [Commented] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641025#comment-17641025 ] Apache Spark commented on SPARK-41282: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641024#comment-17641024 ] Apache Spark commented on SPARK-41282: -- User 'grundprinzip' has created a pull request for this

[jira] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282 ] Hyukjin Kwon deleted comment on SPARK-41282: -- was (Author: apachespark): User 'grundprinzip' has created a pull request for this issue: https://github.com/apache/spark/pull/38839 > Feature

[jira] [Assigned] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41328: Assignee: Apache Spark (was: Rui Wang) > Add logical and string API to Column >

[jira] [Assigned] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41328: Assignee: Rui Wang (was: Apache Spark) > Add logical and string API to Column >

[jira] [Commented] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641018#comment-17641018 ] Apache Spark commented on SPARK-41328: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641017#comment-17641017 ] Apache Spark commented on SPARK-41328: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-41328) Add logical and string API to Column

2022-11-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-41328: Summary: Add logical and string API to Column Key: SPARK-41328 URL: https://issues.apache.org/jira/browse/SPARK-41328 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41326) Bug in Deduplicate Python transformation

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41326: Assignee: Martin Grund > Bug in Deduplicate Python transformation >

[jira] [Resolved] (SPARK-41326) Bug in Deduplicate Python transformation

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41326. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38842

[jira] [Resolved] (SPARK-41268) Refactor "Column" for API Compatibility

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41268. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38806

[jira] [Updated] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41282: - Reporter: Hyukjin Kwon (was: Hyukjin Kwon) > Feature parity: Column API in Spark Connect >

[jira] [Assigned] (SPARK-41327) Fix SparkStatusTracker.getExecutorInfos by switch On/OffHeapStorageMemory info

2022-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41327: - Assignee: Ling Yuan > Fix SparkStatusTracker.getExecutorInfos by switch

[jira] [Updated] (SPARK-41327) Fix SparkStatusTracker.getExecutorInfos by switch On/OffHeapStorageMemory info

2022-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41327: -- Reporter: Ling Yuan (was: Dongjoon Hyun) > Fix SparkStatusTracker.getExecutorInfos by switch

[jira] [Assigned] (SPARK-41327) Fix SparkStatusTracker.getExecutorInfos by switch On/OffHeapStorageMemory info

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41327: Assignee: (was: Apache Spark) > Fix SparkStatusTracker.getExecutorInfos by switch

[jira] [Assigned] (SPARK-41327) Fix SparkStatusTracker.getExecutorInfos by switch On/OffHeapStorageMemory info

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41327: Assignee: Apache Spark > Fix SparkStatusTracker.getExecutorInfos by switch

[jira] [Commented] (SPARK-41327) Fix SparkStatusTracker.getExecutorInfos by switch On/OffHeapStorageMemory info

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640968#comment-17640968 ] Apache Spark commented on SPARK-41327: -- User 'ylybest' has created a pull request for this issue:

[jira] [Created] (SPARK-41327) Fix SparkStatusTracker.getExecutorInfos by switch On/OffHeapStorageMemory info

2022-11-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-41327: - Summary: Fix SparkStatusTracker.getExecutorInfos by switch On/OffHeapStorageMemory info Key: SPARK-41327 URL: https://issues.apache.org/jira/browse/SPARK-41327

[jira] [Commented] (SPARK-41326) Bug in Deduplicate Python transformation

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640933#comment-17640933 ] Apache Spark commented on SPARK-41326: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41326) Bug in Deduplicate Python transformation

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41326: Assignee: (was: Apache Spark) > Bug in Deduplicate Python transformation >

[jira] [Assigned] (SPARK-41326) Bug in Deduplicate Python transformation

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41326: Assignee: Apache Spark > Bug in Deduplicate Python transformation >

[jira] [Created] (SPARK-41326) Bug in Deduplicate Python transformation

2022-11-29 Thread Martin Grund (Jira)
Martin Grund created SPARK-41326: Summary: Bug in Deduplicate Python transformation Key: SPARK-41326 URL: https://issues.apache.org/jira/browse/SPARK-41326 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41325) Add missing avg() to DF group

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640931#comment-17640931 ] Apache Spark commented on SPARK-41325: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-41325) Add missing avg() to DF group

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640930#comment-17640930 ] Apache Spark commented on SPARK-41325: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41325) Add missing avg() to DF group

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41325: Assignee: Apache Spark > Add missing avg() to DF group > - >

[jira] [Assigned] (SPARK-41325) Add missing avg() to DF group

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41325: Assignee: (was: Apache Spark) > Add missing avg() to DF group >

[jira] [Created] (SPARK-41325) Add missing avg() to DF group

2022-11-29 Thread Martin Grund (Jira)
Martin Grund created SPARK-41325: Summary: Add missing avg() to DF group Key: SPARK-41325 URL: https://issues.apache.org/jira/browse/SPARK-41325 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-41297) Support string sql expressions in DF.where()

2022-11-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-41297. --- Fix Version/s: 3.4.0 Resolution: Fixed > Support string sql expressions in

[jira] [Commented] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640909#comment-17640909 ] Apache Spark commented on SPARK-41323: -- User 'srielau' has created a pull request for this issue:

[jira] [Commented] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640908#comment-17640908 ] Apache Spark commented on SPARK-41323: -- User 'srielau' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41323: Assignee: Apache Spark > Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE() >

[jira] [Assigned] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41323: Assignee: (was: Apache Spark) > Support CURRENT_SCHEMA() as alias for

[jira] [Updated] (SPARK-41324) Follow-up on JDK-8180450

2022-11-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-41324: -- Description: Per [https://twitter.com/forked_franz/status/1597468851968831489] We

[jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450

2022-11-29 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640891#comment-17640891 ] Herman van Hövell commented on SPARK-41324: --- Upgrade to Netty 4.1.84 landed in SPARK-40794. We

[jira] [Created] (SPARK-41324) Follow-up on JDK-8180450

2022-11-29 Thread Jira
Herman van Hövell created SPARK-41324: - Summary: Follow-up on JDK-8180450 Key: SPARK-41324 URL: https://issues.apache.org/jira/browse/SPARK-41324 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-41323) Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE()

2022-11-29 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-41323: Summary: Support CURRENT_SCHEMA() as alias for CURRENT_DATABASE() Key: SPARK-41323 URL: https://issues.apache.org/jira/browse/SPARK-41323 Project: Spark

[jira] [Updated] (SPARK-41313) Combine fixes for SPARK-3900 and SPARK-21138

2022-11-29 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated SPARK-41313: - Description: spark-3900 fixed the illegalStateException in cleanupStagingDir in ApplicationMaster's

[jira] [Resolved] (SPARK-41309) Assign a name to the error class _LEGACY_ERROR_TEMP_1093

2022-11-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41309. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38830

[jira] [Assigned] (SPARK-41309) Assign a name to the error class _LEGACY_ERROR_TEMP_1093

2022-11-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41309: Assignee: Yang Jie > Assign a name to the error class _LEGACY_ERROR_TEMP_1093 >

[jira] [Commented] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640813#comment-17640813 ] Apache Spark commented on SPARK-41282: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41282: Assignee: Apache Spark (was: Rui Wang) > Feature parity: Column API in Spark Connect >

[jira] [Assigned] (SPARK-41282) Feature parity: Column API in Spark Connect

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41282: Assignee: Rui Wang (was: Apache Spark) > Feature parity: Column API in Spark Connect >

[jira] [Updated] (SPARK-41322) Optimized query plan cost/statistics overview

2022-11-29 Thread Gerben van der Huizen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerben van der Huizen updated SPARK-41322: -- Description: *Motivation* Spark SQL supports running the `EXPLAIN COST`

[jira] [Created] (SPARK-41322) Optimized query plan cost/statistics overview

2022-11-29 Thread Gerben van der Huizen (Jira)
Gerben van der Huizen created SPARK-41322: - Summary: Optimized query plan cost/statistics overview Key: SPARK-41322 URL: https://issues.apache.org/jira/browse/SPARK-41322 Project: Spark

[jira] [Commented] (SPARK-41321) Support target field for UnresolvedStar

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640712#comment-17640712 ] Apache Spark commented on SPARK-41321: -- User 'dengziming' has created a pull request for this

[jira] [Assigned] (SPARK-41321) Support target field for UnresolvedStar

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41321: Assignee: (was: Apache Spark) > Support target field for UnresolvedStar >

[jira] [Commented] (SPARK-41321) Support target field for UnresolvedStar

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640711#comment-17640711 ] Apache Spark commented on SPARK-41321: -- User 'dengziming' has created a pull request for this

[jira] [Assigned] (SPARK-41321) Support target field for UnresolvedStar

2022-11-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41321: Assignee: Apache Spark > Support target field for UnresolvedStar >

[jira] [Updated] (SPARK-41321) Support target field for UnresolvedStar

2022-11-29 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deng Ziming updated SPARK-41321: Summary: Support target field for UnresolvedStar (was: Support target field UnresolvedStar) >

[jira] [Created] (SPARK-41321) Support target field UnresolvedStar

2022-11-29 Thread Deng Ziming (Jira)
Deng Ziming created SPARK-41321: --- Summary: Support target field UnresolvedStar Key: SPARK-41321 URL: https://issues.apache.org/jira/browse/SPARK-41321 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41317) PySpark write API for Spark Connect

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41317: - Assignee: Hyukjin Kwon > PySpark write API for Spark Connect >

[jira] [Resolved] (SPARK-41317) PySpark write API for Spark Connect

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41317. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38801

[jira] [Updated] (SPARK-41319) when otherwise support

2022-11-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41319: -- Summary: when otherwise support (was: IF-ELSE support) > when otherwise support >

  1   2   >