[jira] [Assigned] (SPARK-42309) Assign name to _LEGACY_ERROR_TEMP_1204

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42309: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_1204 > ---

[jira] [Assigned] (SPARK-42309) Assign name to _LEGACY_ERROR_TEMP_1204

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42309: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_1204 >

[jira] [Commented] (SPARK-42309) Assign name to _LEGACY_ERROR_TEMP_1204

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685723#comment-17685723 ] Apache Spark commented on SPARK-42309: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-42267) Support left_outer join

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42267: Assignee: (was: Apache Spark) > Support left_outer join > --- > >

[jira] [Commented] (SPARK-42267) Support left_outer join

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685722#comment-17685722 ] Apache Spark commented on SPARK-42267: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42267) Support left_outer join

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42267: Assignee: Apache Spark > Support left_outer join > --- > >

[jira] [Assigned] (SPARK-42024) createDataFrame should corse types of string float to float

2023-02-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42024: - Assignee: Ruifeng Zheng > createDataFrame should corse types of string float to float >

[jira] [Resolved] (SPARK-42024) createDataFrame should corse types of string float to float

2023-02-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42024. --- Resolution: Resolved > createDataFrame should corse types of string float to float > ---

[jira] [Created] (SPARK-42380) Upgrade maven to 3.9.0

2023-02-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-42380: Summary: Upgrade maven to 3.9.0 Key: SPARK-42380 URL: https://issues.apache.org/jira/browse/SPARK-42380 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-42378) Make `DataFrame.select` support `a.*`

2023-02-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42378: - Assignee: Ruifeng Zheng > Make `DataFrame.select` support `a.*` > -

[jira] [Resolved] (SPARK-42378) Make `DataFrame.select` support `a.*`

2023-02-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42378. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39934 [https://

[jira] [Resolved] (SPARK-42372) Improve performance of HiveGenericUDTF by making inputProjection instantiate once

2023-02-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42372. -- Fix Version/s: 3.4.0 Assignee: Kent Yao Resolution: Fixed issue resolved by https://gi

[jira] [Assigned] (SPARK-40045) The order of filtering predicates is not reasonable

2023-02-07 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-40045: -- Assignee: caican > The order of filtering predicates is not reasonable >

[jira] [Assigned] (SPARK-42315) Assign name to _LEGACY_ERROR_TEMP_2092

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42315: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2092 >

[jira] [Resolved] (SPARK-42315) Assign name to _LEGACY_ERROR_TEMP_2092

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42315. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39889 [https://github.com

[jira] [Resolved] (SPARK-42358) Provide more details in ExecutorUpdated sent in Master.removeWorker

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42358. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39903 [https://

[jira] [Assigned] (SPARK-42358) Provide more details in ExecutorUpdated sent in Master.removeWorker

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42358: - Assignee: Bo Zhang > Provide more details in ExecutorUpdated sent in Master.removeWorke

[jira] [Resolved] (SPARK-40045) The order of filtering predicates is not reasonable

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40045. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39892 [https://

[jira] [Commented] (SPARK-42379) Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685681#comment-17685681 ] Apache Spark commented on SPARK-42379: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-42379) Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42379: Assignee: (was: Apache Spark) > Use FileSystem.exists in FileSystemBasedCheckpointFil

[jira] [Assigned] (SPARK-42379) Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42379: Assignee: Apache Spark > Use FileSystem.exists in FileSystemBasedCheckpointFileManager.ex

[jira] [Commented] (SPARK-42379) Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685680#comment-17685680 ] Apache Spark commented on SPARK-42379: -- User 'HeartSaVioR' has created a pull reque

[jira] [Created] (SPARK-42379) Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-07 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-42379: Summary: Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists Key: SPARK-42379 URL: https://issues.apache.org/jira/browse/SPARK-42379 Project: Spark

[jira] [Commented] (SPARK-33807) Data Source V2: Remove read specific distributions

2023-02-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685674#comment-17685674 ] Chao Sun commented on SPARK-33807: -- This is actually already resolved as part of SPARK-

[jira] [Assigned] (SPARK-33807) Data Source V2: Remove read specific distributions

2023-02-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-33807: Assignee: (was: Chao Sun) > Data Source V2: Remove read specific distributions >

[jira] [Assigned] (SPARK-33807) Data Source V2: Remove read specific distributions

2023-02-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-33807: Assignee: Chao Sun > Data Source V2: Remove read specific distributions > ---

[jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685671#comment-17685671 ] Dongjoon Hyun commented on SPARK-41053: --- Hi, [~Gengliang.Wang]. Shall we resolve t

[jira] [Updated] (SPARK-35563) [SQL] Window operations with over Int.MaxValue + 1 rows can silently drop rows

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35563: -- Priority: Major (was: Blocker) > [SQL] Window operations with over Int.MaxValue + 1 rows can

[jira] [Commented] (SPARK-33807) Data Source V2: Remove read specific distributions

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685668#comment-17685668 ] Dongjoon Hyun commented on SPARK-33807: --- According to the discussion, I lowered th

[jira] [Updated] (SPARK-33807) Data Source V2: Remove read specific distributions

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33807: -- Priority: Major (was: Blocker) > Data Source V2: Remove read specific distributions > ---

[jira] [Commented] (SPARK-42210) Standardize registered pickled Python UDFs

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685667#comment-17685667 ] Apache Spark commented on SPARK-42210: -- User 'xinrong-meng' has created a pull requ

[jira] [Assigned] (SPARK-42210) Standardize registered pickled Python UDFs

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42210: Assignee: Apache Spark > Standardize registered pickled Python UDFs > ---

[jira] [Assigned] (SPARK-42210) Standardize registered pickled Python UDFs

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42210: Assignee: (was: Apache Spark) > Standardize registered pickled Python UDFs >

[jira] [Commented] (SPARK-42210) Standardize registered pickled Python UDFs

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685666#comment-17685666 ] Apache Spark commented on SPARK-42210: -- User 'xinrong-meng' has created a pull requ

[jira] [Commented] (SPARK-42244) Refine error message by using Python types.

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685655#comment-17685655 ] Apache Spark commented on SPARK-42244: -- User 'itholic' has created a pull request f

[jira] [Resolved] (SPARK-42371) Add scripts to start and stop Spark Connect server

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42371. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39928 [https://gi

[jira] [Assigned] (SPARK-42371) Add scripts to start and stop Spark Connect server

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42371: Assignee: Hyukjin Kwon > Add scripts to start and stop Spark Connect server > ---

[jira] [Updated] (SPARK-40819) Parquet INT64 (TIMESTAMP(NANOS,true)) now throwing Illegal Parquet type instead of automatically converting to LongType

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40819: - Fix Version/s: 3.2.4 3.3.2 > Parquet INT64 (TIMESTAMP(NANOS,true)) now throwi

[jira] [Resolved] (SPARK-42244) Refine error message by using Python types.

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42244. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39815 [https://gi

[jira] [Assigned] (SPARK-42244) Refine error message by using Python types.

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42244: Assignee: Haejoon Lee > Refine error message by using Python types. > ---

[jira] [Resolved] (SPARK-42301) Assign name to _LEGACY_ERROR_TEMP_1129

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42301. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39871 [https://github.com

[jira] [Assigned] (SPARK-42301) Assign name to _LEGACY_ERROR_TEMP_1129

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42301: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1129 >

[jira] [Assigned] (SPARK-42254) Assign name to _LEGACY_ERROR_TEMP_1117

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42254: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1117 >

[jira] [Resolved] (SPARK-42254) Assign name to _LEGACY_ERROR_TEMP_1117

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42254. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39837 [https://github.com

[jira] [Resolved] (SPARK-42249) Refining html strings in error messages

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42249. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39820 [https://github.com

[jira] [Assigned] (SPARK-42249) Refining html strings in error messages

2023-02-07 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42249: Assignee: Haejoon Lee > Refining html strings in error messages > ---

[jira] [Commented] (SPARK-42378) Make `DataFrame.select` support `a.*`

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685633#comment-17685633 ] Apache Spark commented on SPARK-42378: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42378) Make `DataFrame.select` support `a.*`

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42378: Assignee: Apache Spark > Make `DataFrame.select` support `a.*` >

[jira] [Assigned] (SPARK-42378) Make `DataFrame.select` support `a.*`

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42378: Assignee: (was: Apache Spark) > Make `DataFrame.select` support `a.*` > -

[jira] [Created] (SPARK-42378) Make `DataFrame.select` support `a.*`

2023-02-07 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42378: - Summary: Make `DataFrame.select` support `a.*` Key: SPARK-42378 URL: https://issues.apache.org/jira/browse/SPARK-42378 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2023-02-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685623#comment-17685623 ] Herman van Hövell commented on SPARK-39375: --- [~xkrogen] Regarding the external

[jira] [Resolved] (SPARK-42352) Upgrade maven to 3.8.7

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42352. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39896 [https://gi

[jira] [Assigned] (SPARK-42352) Upgrade maven to 3.8.7

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42352: Assignee: Yang Jie > Upgrade maven to 3.8.7 > -- > >

[jira] [Assigned] (SPARK-42094) Support `fill_value` for `ps.Series.add`

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42094: Assignee: Haejoon Lee > Support `fill_value` for `ps.Series.add` > --

[jira] [Resolved] (SPARK-42094) Support `fill_value` for `ps.Series.add`

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42094. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39790 [https://gi

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2023-02-07 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685619#comment-17685619 ] Herman van Hövell commented on SPARK-39375: --- [~xkrogen] the current work on UD

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685618#comment-17685618 ] Hyukjin Kwon commented on SPARK-39375: -- cc [~zhenli] [~hvanhovell] [~grundprinzip-d

[jira] [Commented] (SPARK-42377) Test Framework for Connect Scala Client

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685613#comment-17685613 ] Apache Spark commented on SPARK-42377: -- User 'hvanhovell' has created a pull reques

[jira] [Assigned] (SPARK-42377) Test Framework for Connect Scala Client

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42377: Assignee: (was: Apache Spark) > Test Framework for Connect Scala Client > ---

[jira] [Commented] (SPARK-42377) Test Framework for Connect Scala Client

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685612#comment-17685612 ] Apache Spark commented on SPARK-42377: -- User 'hvanhovell' has created a pull reques

[jira] [Assigned] (SPARK-42377) Test Framework for Connect Scala Client

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42377: Assignee: Apache Spark > Test Framework for Connect Scala Client > --

[jira] [Created] (SPARK-42377) Test Framework for Connect Scala Client

2023-02-07 Thread Jira
Herman van Hövell created SPARK-42377: - Summary: Test Framework for Connect Scala Client Key: SPARK-42377 URL: https://issues.apache.org/jira/browse/SPARK-42377 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2023-02-07 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685600#comment-17685600 ] Erik Krogen commented on SPARK-39375: - UDFs are a complex space, e.g. for Scala the

[jira] [Commented] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-07 Thread Ritika Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685466#comment-17685466 ] Ritika Maheshwari commented on SPARK-42346: --- Hello added three rows to input_t

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-07 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685384#comment-17685384 ] Gera Shegalov commented on SPARK-41793: --- Another interpretation of why the pre-3.4

[jira] [Updated] (SPARK-42369) Fix constructor for java.nio.DirectByteBuffer for Java 21+

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42369: -- Issue Type: Improvement (was: Bug) > Fix constructor for java.nio.DirectByteBuffer for Java 2

[jira] [Assigned] (SPARK-42369) Fix constructor for java.nio.DirectByteBuffer for Java 21+

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42369: - Assignee: Ludovic Henry > Fix constructor for java.nio.DirectByteBuffer for Java 21+ >

[jira] [Resolved] (SPARK-42369) Fix constructor for java.nio.DirectByteBuffer for Java 21+

2023-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42369. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39909 [https://

[jira] [Assigned] (SPARK-42376) Introduce watermark propagation among operators

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42376: Assignee: Apache Spark > Introduce watermark propagation among operators > --

[jira] [Commented] (SPARK-42376) Introduce watermark propagation among operators

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685350#comment-17685350 ] Apache Spark commented on SPARK-42376: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-42376) Introduce watermark propagation among operators

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42376: Assignee: (was: Apache Spark) > Introduce watermark propagation among operators > ---

[jira] [Commented] (SPARK-37099) Introduce a rank-based filter to optimize top-k computation

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685328#comment-17685328 ] Apache Spark commented on SPARK-37099: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-42376) Introduce watermark propagation among operators

2023-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685315#comment-17685315 ] Jungtaek Lim commented on SPARK-42376: -- Will submit a PR sooner. > Introduce water

[jira] [Created] (SPARK-42376) Introduce watermark propagation among operators

2023-02-07 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-42376: Summary: Introduce watermark propagation among operators Key: SPARK-42376 URL: https://issues.apache.org/jira/browse/SPARK-42376 Project: Spark Issue Type: I

[jira] [Assigned] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42136: --- Assignee: Peter Toth > Refactor BroadcastHashJoinExec output partitioning generation >

[jira] [Resolved] (SPARK-42136) Refactor BroadcastHashJoinExec output partitioning generation

2023-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42136. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 38038 [https://gith

[jira] [Created] (SPARK-42375) Point out the user-facing documentation in Spark Connect server startup

2023-02-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-42375: Summary: Point out the user-facing documentation in Spark Connect server startup Key: SPARK-42375 URL: https://issues.apache.org/jira/browse/SPARK-42375 Project: Spar

[jira] [Updated] (SPARK-42374) User-facing documentaiton

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42374: - Description: Should provide the user-facing documentation so end users how to use Spark Connect.

[jira] [Assigned] (SPARK-42374) User-facing documentaiton

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42374: Assignee: Haejoon Lee > User-facing documentaiton > - > >

[jira] [Updated] (SPARK-42375) Point out the user-facing documentation in Spark Connect server startup

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42375: - Description: See SPARK-42375 in SparkSubmit.scala (was: See ) > Point out the user-facing docum

[jira] [Created] (SPARK-42374) User-facing documentaiton

2023-02-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-42374: Summary: User-facing documentaiton Key: SPARK-42374 URL: https://issues.apache.org/jira/browse/SPARK-42374 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-42367) DataFrame.drop should handle duplicated columns properly

2023-02-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42367: -- Summary: DataFrame.drop should handle duplicated columns properly (was: DataFrame.drop could

[jira] [Assigned] (SPARK-42373) Remove unused blank line removal from CSVExprUtils

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42373: Assignee: Apache Spark > Remove unused blank line removal from CSVExprUtils > ---

[jira] [Assigned] (SPARK-42373) Remove unused blank line removal from CSVExprUtils

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42373: Assignee: (was: Apache Spark) > Remove unused blank line removal from CSVExprUtils >

[jira] [Commented] (SPARK-42373) Remove unused blank line removal from CSVExprUtils

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685268#comment-17685268 ] Apache Spark commented on SPARK-42373: -- User 'ted-jenks' has created a pull request

[jira] [Created] (SPARK-42373) Remove unused blank line removal from CSVExprUtils

2023-02-07 Thread Willi Raschkowski (Jira)
Willi Raschkowski created SPARK-42373: - Summary: Remove unused blank line removal from CSVExprUtils Key: SPARK-42373 URL: https://issues.apache.org/jira/browse/SPARK-42373 Project: Spark

[jira] [Assigned] (SPARK-42372) Improve performance of HiveGenericUDTF by making inputProjection instantiate once

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42372: Assignee: (was: Apache Spark) > Improve performance of HiveGenericUDTF by making inpu

[jira] [Commented] (SPARK-42372) Improve performance of HiveGenericUDTF by making inputProjection instantiate once

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685237#comment-17685237 ] Apache Spark commented on SPARK-42372: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-42372) Improve performance of HiveGenericUDTF by making inputProjection instantiate once

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42372: Assignee: Apache Spark > Improve performance of HiveGenericUDTF by making inputProjection

[jira] [Updated] (SPARK-42372) Improve performance of HiveGenericUDTF by making inputProjection instantiate once

2023-02-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-42372: - Description: {code:java} +++ b/sql/hive/benchmarks/HiveUDFBenchmark-per-row-results.txt @@ -0,0 +1,7 @@

[jira] [Created] (SPARK-42372) Improve performance of HiveGenericUDTF by making inputProjection instantiate once

2023-02-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-42372: Summary: Improve performance of HiveGenericUDTF by making inputProjection instantiate once Key: SPARK-42372 URL: https://issues.apache.org/jira/browse/SPARK-42372 Project: Sp

[jira] [Commented] (SPARK-42371) Add scripts to start and stop Spark Connect server

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685208#comment-17685208 ] Apache Spark commented on SPARK-42371: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-42371) Add scripts to start and stop Spark Connect server

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685209#comment-17685209 ] Apache Spark commented on SPARK-42371: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-42371) Add scripts to start and stop Spark Connect server

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42371: Assignee: (was: Apache Spark) > Add scripts to start and stop Spark Connect server >

[jira] [Assigned] (SPARK-42371) Add scripts to start and stop Spark Connect server

2023-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42371: Assignee: Apache Spark > Add scripts to start and stop Spark Connect server > ---

[jira] [Commented] (SPARK-42266) Local mode should work with IPython

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685207#comment-17685207 ] Hyukjin Kwon commented on SPARK-42266: -- Let me take a look > Local mode should wor

[jira] [Created] (SPARK-42371) Add scripts to start and stop Spark Connect server

2023-02-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-42371: Summary: Add scripts to start and stop Spark Connect server Key: SPARK-42371 URL: https://issues.apache.org/jira/browse/SPARK-42371 Project: Spark Issue Type

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685177#comment-17685177 ] Hyukjin Kwon commented on SPARK-39375: -- [~xkrogen] I just saw this. Some work is do

[jira] [Resolved] (SPARK-41289) Feature parity: Catalog API

2023-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41289. -- Resolution: Done > Feature parity: Catalog API > --- > >

[jira] [Updated] (SPARK-42370) Spark History Server fails to start on CentOS7 aarch64

2023-02-07 Thread Zhiguo Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiguo Wu updated SPARK-42370: -- Description: When I run `./sbin/start-history-server.sh` I'll get the error below !image-2023-02-07-

  1   2   >