[jira] [Resolved] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39725. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37142

[jira] [Assigned] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39725: Assignee: Bjørn Jørgensen > Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

[jira] [Resolved] (SPARK-39721) Add getTable/getDatabase/getFunction in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39721. --- Resolution: Not A Problem > Add getTable/getDatabase/getFunction in SparkR support 3L

[jira] [Updated] (SPARK-39494) Support `createDataFrame` from a list of scalars when schema is not provided

2022-07-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39494: - Description: {{Currently, DataFrame creation from a list of scalars is unsupported in PySpark,

[jira] [Updated] (SPARK-39494) Support `createDataFrame` from a list of scalars when schema is not provided

2022-07-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39494: - Description: Currently, DataFrame creation from a list of scalars is unsupported in PySpark,

[jira] [Updated] (SPARK-39494) Support `createDataFrame` from a list of scalars when schema is not provided

2022-07-08 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39494: - Summary: Support `createDataFrame` from a list of scalars when schema is not provided (was:

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564369#comment-17564369 ] Apache Spark commented on SPARK-39725: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39725: Assignee: (was: Apache Spark) > Upgrade jetty-http from 9.4.46.v20220331 to

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564368#comment-17564368 ] Apache Spark commented on SPARK-39725: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Assigned] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39725: Assignee: Apache Spark > Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622 >

[jira] [Assigned] (SPARK-39024) Add support for YARN decommissioning when ESS is Enabled

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39024: Assignee: (was: Apache Spark) > Add support for YARN decommissioning when ESS is

[jira] [Commented] (SPARK-39024) Add support for YARN decommissioning when ESS is Enabled

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564352#comment-17564352 ] Apache Spark commented on SPARK-39024: -- User 'abhishekd0907' has created a pull request for this

[jira] [Assigned] (SPARK-39024) Add support for YARN decommissioning when ESS is Enabled

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39024: Assignee: Apache Spark > Add support for YARN decommissioning when ESS is Enabled >

[jira] [Resolved] (SPARK-39709) The result of executeCollect and doExecute of TakeOrderedAndProjectExec should be the same

2022-07-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39709. - Resolution: Not A Bug > The result of executeCollect and doExecute of TakeOrderedAndProjectExec

[jira] [Commented] (SPARK-39726) Change the default value of spark.sql.execution.topKSortFallbackThreshold to 800000

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564311#comment-17564311 ] Apache Spark commented on SPARK-39726: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39726) Change the default value of spark.sql.execution.topKSortFallbackThreshold to 800000

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39726: Assignee: (was: Apache Spark) > Change the default value of

[jira] [Assigned] (SPARK-39726) Change the default value of spark.sql.execution.topKSortFallbackThreshold to 800000

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39726: Assignee: Apache Spark > Change the default value of

[jira] [Created] (SPARK-39726) Change the default value of spark.sql.execution.topKSortFallbackThreshold to 800000

2022-07-08 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39726: --- Summary: Change the default value of spark.sql.execution.topKSortFallbackThreshold to 80 Key: SPARK-39726 URL: https://issues.apache.org/jira/browse/SPARK-39726

[jira] [Updated] (SPARK-39620) History server page and API are using inconsistent conditions to filter running applications

2022-07-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39620: - Priority: Minor (was: Major) > History server page and API are using inconsistent conditions

[jira] [Assigned] (SPARK-39620) History server page and API are using inconsistent conditions to filter running applications

2022-07-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39620: Assignee: wy > History server page and API are using inconsistent conditions to filter

[jira] [Resolved] (SPARK-39620) History server page and API are using inconsistent conditions to filter running applications

2022-07-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39620. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37008

[jira] [Assigned] (SPARK-39661) Avoid creating unnecessary SLF4J Logger

2022-07-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39661: Assignee: BingKun Pan > Avoid creating unnecessary SLF4J Logger >

[jira] [Resolved] (SPARK-39661) Avoid creating unnecessary SLF4J Logger

2022-07-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39661. -- Resolution: Fixed Issue resolved by pull request 37058

[jira] [Created] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-07-08 Thread Jira
Bjørn Jørgensen created SPARK-39725: --- Summary: Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622 Key: SPARK-39725 URL: https://issues.apache.org/jira/browse/SPARK-39725 Project: Spark

[jira] [Assigned] (SPARK-39721) Add getTable/getDatabase/getFunction in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39721: Assignee: (was: Apache Spark) > Add getTable/getDatabase/getFunction in SparkR

[jira] [Assigned] (SPARK-39721) Add getTable/getDatabase/getFunction in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39721: Assignee: Apache Spark > Add getTable/getDatabase/getFunction in SparkR support 3L

[jira] [Commented] (SPARK-39721) Add getTable/getDatabase/getFunction in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564275#comment-17564275 ] Apache Spark commented on SPARK-39721: -- User 'zhengruifeng' has created a pull request for this

[jira] [Reopened] (SPARK-39721) Make recoverPartitions/listColumns in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-39721: --- > Make recoverPartitions/listColumns in SparkR support 3L namespace >

[jira] [Updated] (SPARK-39721) Add getTable/getDatabase/getFunction in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39721: -- Summary: Add getTable/getDatabase/getFunction in SparkR support 3L namespace (was: Make

[jira] [Resolved] (SPARK-39721) Make recoverPartitions/listColumns in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39721. --- Resolution: Duplicate > Make recoverPartitions/listColumns in SparkR support 3L namespace >

[jira] [Commented] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564266#comment-17564266 ] Apache Spark commented on SPARK-39718: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-39230) Support ANSI Aggregate Function: regr_slope

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564257#comment-17564257 ] Apache Spark commented on SPARK-39230: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-37623) Support ANSI Aggregate Function: regr_intercept

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564256#comment-17564256 ] Apache Spark commented on SPARK-37623: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39718: Assignee: Yikun Jiang > Enable base image build in PySpark job >

[jira] [Resolved] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39718. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37131

[jira] [Commented] (SPARK-39724) Remove duplicate `.setAccessible(true)` in `kvstore.KVTypeInfo`

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564248#comment-17564248 ] Apache Spark commented on SPARK-39724: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39724) Remove duplicate `.setAccessible(true)` in `kvstore.KVTypeInfo`

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39724: Assignee: (was: Apache Spark) > Remove duplicate `.setAccessible(true)` in

[jira] [Assigned] (SPARK-39724) Remove duplicate `.setAccessible(true)` in `kvstore.KVTypeInfo`

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39724: Assignee: Apache Spark > Remove duplicate `.setAccessible(true)` in

[jira] [Commented] (SPARK-39724) Remove duplicate `.setAccessible(true)` in `kvstore.KVTypeInfo`

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564249#comment-17564249 ] Apache Spark commented on SPARK-39724: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-39724) Remove duplicate `.setAccessible(true)` in `kvstore.KVTypeInfo`

2022-07-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-39724: Summary: Remove duplicate `.setAccessible(true)` in `kvstore.KVTypeInfo` Key: SPARK-39724 URL: https://issues.apache.org/jira/browse/SPARK-39724 Project: Spark

[jira] [Assigned] (SPARK-39723) Make ListFunctions/functionExists in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39723: Assignee: (was: Apache Spark) > Make ListFunctions/functionExists in SparkR support

[jira] [Assigned] (SPARK-39723) Make ListFunctions/functionExists in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39723: Assignee: Apache Spark > Make ListFunctions/functionExists in SparkR support 3L

[jira] [Commented] (SPARK-39723) Make ListFunctions/functionExists in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564244#comment-17564244 ] Apache Spark commented on SPARK-39723: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-39723) Make ListFunctions/functionExists in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-39723: - Summary: Make ListFunctions/functionExists in SparkR support 3L namespace Key: SPARK-39723 URL: https://issues.apache.org/jira/browse/SPARK-39723 Project: Spark

[jira] [Created] (SPARK-39722) Make Dataset.showString() public

2022-07-08 Thread Jatin Sharma (Jira)
Jatin Sharma created SPARK-39722: Summary: Make Dataset.showString() public Key: SPARK-39722 URL: https://issues.apache.org/jira/browse/SPARK-39722 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39722) Make Dataset.showString() public

2022-07-08 Thread Jatin Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jatin Sharma updated SPARK-39722: - Priority: Trivial (was: Major) > Make Dataset.showString() public >

[jira] [Assigned] (SPARK-39721) Make recoverPartitions/listColumns in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39721: Assignee: (was: Apache Spark) > Make recoverPartitions/listColumns in SparkR support

[jira] [Commented] (SPARK-39721) Make recoverPartitions/listColumns in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564238#comment-17564238 ] Apache Spark commented on SPARK-39721: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-39721) Make recoverPartitions/listColumns in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564237#comment-17564237 ] Apache Spark commented on SPARK-39721: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39721) Make recoverPartitions/listColumns in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39721: Assignee: Apache Spark > Make recoverPartitions/listColumns in SparkR support 3L

[jira] [Created] (SPARK-39721) Make recoverPartitions/listColumns in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-39721: - Summary: Make recoverPartitions/listColumns in SparkR support 3L namespace Key: SPARK-39721 URL: https://issues.apache.org/jira/browse/SPARK-39721 Project: Spark

[jira] [Assigned] (SPARK-39720) Make createTable/cacheTable/uncacheTable/refreshTable/tableExists in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39720: Assignee: (was: Apache Spark) > Make

[jira] [Commented] (SPARK-39720) Make createTable/cacheTable/uncacheTable/refreshTable/tableExists in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564235#comment-17564235 ] Apache Spark commented on SPARK-39720: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39720) Make createTable/cacheTable/uncacheTable/refreshTable/tableExists in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39720: Assignee: Apache Spark > Make

[jira] [Created] (SPARK-39720) Make createTable/cacheTable/uncacheTable/refreshTable/tableExists in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-39720: - Summary: Make createTable/cacheTable/uncacheTable/refreshTable/tableExists in SparkR support 3L namespace Key: SPARK-39720 URL:

[jira] [Resolved] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listCatalogs in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39716. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37127

[jira] [Assigned] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listCatalogs in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-39716: - Assignee: Ruifeng Zheng > Make currentDatabase/setCurrentDatabase/listCatalogs in

[jira] [Assigned] (SPARK-39719) Make databaseExists/listTables/tables/tableNames in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39719: Assignee: (was: Apache Spark) > Make databaseExists/listTables/tables/tableNames in

[jira] [Commented] (SPARK-39719) Make databaseExists/listTables/tables/tableNames in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564197#comment-17564197 ] Apache Spark commented on SPARK-39719: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39719) Make databaseExists/listTables/tables/tableNames in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39719: Assignee: Apache Spark > Make databaseExists/listTables/tables/tableNames in SparkR

[jira] [Updated] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listCatalogs in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39716: -- Summary: Make currentDatabase/setCurrentDatabase/listCatalogs in SparkR support 3L namespace

[jira] [Created] (SPARK-39719) Make databaseExists/listTables/tables/tableNames in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-39719: - Summary: Make databaseExists/listTables/tables/tableNames in SparkR support 3L namespace Key: SPARK-39719 URL: https://issues.apache.org/jira/browse/SPARK-39719

[jira] [Assigned] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39718: Assignee: Apache Spark > Enable base image build in PySpark job >

[jira] [Assigned] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39718: Assignee: (was: Apache Spark) > Enable base image build in PySpark job >

[jira] [Commented] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564167#comment-17564167 ] Apache Spark commented on SPARK-39718: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-39522) Add Apache Spark infra GA image cache

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564165#comment-17564165 ] Apache Spark commented on SPARK-39522: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564164#comment-17564164 ] Yikun Jiang commented on SPARK-39718: - https://github.com/apache/spark/pull/37005 > Enable base

[jira] [Created] (SPARK-39718) Enable base image build in PySpark job

2022-07-08 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-39718: --- Summary: Enable base image build in PySpark job Key: SPARK-39718 URL: https://issues.apache.org/jira/browse/SPARK-39718 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-39710) Support push topK through outer join

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564150#comment-17564150 ] Apache Spark commented on SPARK-39710: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39710) Support push topK through outer join

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39710: Assignee: Apache Spark > Support push topK through outer join >

[jira] [Commented] (SPARK-39710) Support push topK through outer join

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564149#comment-17564149 ] Apache Spark commented on SPARK-39710: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39710) Support push topK through outer join

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39710: Assignee: (was: Apache Spark) > Support push topK through outer join >

[jira] [Created] (SPARK-39717) Spark on YARN + preemption: "Not removing executor 304 because the ResourceProfile was UNKNOWN"

2022-07-08 Thread Jeroen Dries (Jira)
Jeroen Dries created SPARK-39717: Summary: Spark on YARN + preemption: "Not removing executor 304 because the ResourceProfile was UNKNOWN" Key: SPARK-39717 URL: https://issues.apache.org/jira/browse/SPARK-39717

[jira] [Resolved] (SPARK-39627) DS V2 pushdown should unify the compile API

2022-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39627. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37047

[jira] [Assigned] (SPARK-39627) DS V2 pushdown should unify the compile API

2022-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39627: --- Assignee: jiaan.geng > DS V2 pushdown should unify the compile API >

[jira] [Updated] (SPARK-39235) Make Catalog API be compatible with 3-layer-namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39235: -- Affects Version/s: 3.4.0 (was: 3.3.0) > Make Catalog API be

[jira] [Updated] (SPARK-39235) Make Catalog API be compatible with 3-layer-namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-39235: -- Component/s: PySpark R > Make Catalog API be compatible with

[jira] [Commented] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listDatabases in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564114#comment-17564114 ] Apache Spark commented on SPARK-39716: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listDatabases in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564112#comment-17564112 ] Apache Spark commented on SPARK-39716: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listDatabases in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39716: Assignee: (was: Apache Spark) > Make

[jira] [Assigned] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listDatabases in SparkR support 3L namespace

2022-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39716: Assignee: Apache Spark > Make currentDatabase/setCurrentDatabase/listDatabases in SparkR

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Created] (SPARK-39716) Make currentDatabase/setCurrentDatabase/listDatabases in SparkR support 3L namespace

2022-07-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-39716: - Summary: Make currentDatabase/setCurrentDatabase/listDatabases in SparkR support 3L namespace Key: SPARK-39716 URL: https://issues.apache.org/jira/browse/SPARK-39716

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Attachment: 3.png > spark UI about file size read > - > > Key:

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Attachment: 2.png > spark UI about file size read > - > > Key:

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Description: I run this sql  *select * from cm_dw.dwd_client_install where proc_date=20220707;* and then

[jira] [Updated] (SPARK-39715) spark UI about file size read

2022-07-08 Thread Maple (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-39715: -- Attachment: 1.png > spark UI about file size read > - > > Key:

[jira] [Created] (SPARK-39715) spark UI about file size

2022-07-08 Thread Maple (Jira)
Maple created SPARK-39715: - Summary: spark UI about file size Key: SPARK-39715 URL: https://issues.apache.org/jira/browse/SPARK-39715 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-39713) ANSI mode: add suggestion of using try_element_at for INVALID_ARRAY_INDEX error

2022-07-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39713. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37125