[jira] [Updated] (SPARK-46418) Reorganize `ReshapeTests`

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46418: --- Labels: pull-request-available (was: ) > Reorganize `ReshapeTests` >

[jira] [Created] (SPARK-46418) Reorganize `ReshapeTests`

2023-12-14 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46418: - Summary: Reorganize `ReshapeTests` Key: SPARK-46418 URL: https://issues.apache.org/jira/browse/SPARK-46418 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-46415) Creating partitions through jdbc connection to beeline is slow

2023-12-14 Thread xichenglin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xichenglin updated SPARK-46415: --- Description: Use jdbc to connect to spark beeline through the connection pool to perform partition

[jira] [Updated] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46417: --- Labels: pull-request-available (was: ) > do not fail when calling getTable and

[jira] [Updated] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-46417: Issue Type: Bug (was: Improvement) > do not fail when calling getTable and throwException is

[jira] [Created] (SPARK-46417) do not fail when calling getTable and throwException is false

2023-12-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46417: --- Summary: do not fail when calling getTable and throwException is false Key: SPARK-46417 URL: https://issues.apache.org/jira/browse/SPARK-46417 Project: Spark

[jira] [Resolved] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46402. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44349

[jira] [Assigned] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46402: Assignee: Hyukjin Kwon > Add getMessageParameters and getQueryContext support >

[jira] [Resolved] (SPARK-46416) Add @tailrec to HadoopFSUtils#shouldFilterOutPath

2023-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46416. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44345

[jira] [Updated] (SPARK-46416) Add @tailrec to HadoopFSUtils#shouldFilterOutPath

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46416: --- Labels: pull-request-available (was: ) > Add @tailrec to HadoopFSUtils#shouldFilterOutPath

[jira] [Assigned] (SPARK-46416) Add @tailrec to HadoopFSUtils#shouldFilterOutPath

2023-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46416: Assignee: Yang Jie > Add @tailrec to HadoopFSUtils#shouldFilterOutPath >

[jira] [Created] (SPARK-46416) Add @tailrec to HadoopFSUtils#shouldFilterOutPath

2023-12-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-46416: Summary: Add @tailrec to HadoopFSUtils#shouldFilterOutPath Key: SPARK-46416 URL: https://issues.apache.org/jira/browse/SPARK-46416 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-12-14 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marc Le Bihan resolved SPARK-45311. --- Fix Version/s: 4.0.0 3.5.1 3.4.2 Resolution:

[jira] [Created] (SPARK-46415) Creating partitions through jdbc connection to beeline is slow

2023-12-14 Thread xichenglin (Jira)
xichenglin created SPARK-46415: -- Summary: Creating partitions through jdbc connection to beeline is slow Key: SPARK-46415 URL: https://issues.apache.org/jira/browse/SPARK-46415 Project: Spark

[jira] [Updated] (SPARK-46414) Use prependBaseUri to render javascript imports

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46414: --- Labels: pull-request-available (was: ) > Use prependBaseUri to render javascript imports >

[jira] [Created] (SPARK-46414) Use prependBaseUri to render javascript imports

2023-12-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-46414: Summary: Use prependBaseUri to render javascript imports Key: SPARK-46414 URL: https://issues.apache.org/jira/browse/SPARK-46414 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

2023-12-14 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796975#comment-17796975 ] melin commented on SPARK-43338: --- [~yao]   databricks support change:   

[jira] [Resolved] (SPARK-46404) Add structured-streaming-page.test.js to test structured-streaming-page.js

2023-12-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46404. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44346

[jira] [Assigned] (SPARK-46384) Structured Streaming UI doesn't display graph correctly

2023-12-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46384: Assignee: Kent Yao > Structured Streaming UI doesn't display graph correctly >

[jira] [Assigned] (SPARK-46404) Add structured-streaming-page.test.js to test structured-streaming-page.js

2023-12-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46404: Assignee: Kent Yao > Add structured-streaming-page.test.js to test structured-streaming-page.js

[jira] [Resolved] (SPARK-46384) Structured Streaming UI doesn't display graph correctly

2023-12-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46384. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44346

[jira] [Assigned] (SPARK-46407) Reorganize `OpsOnDiffFramesDisabledTests`

2023-12-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46407: - Assignee: Ruifeng Zheng > Reorganize `OpsOnDiffFramesDisabledTests` >

[jira] [Resolved] (SPARK-46407) Reorganize `OpsOnDiffFramesDisabledTests`

2023-12-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46407. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44354

[jira] [Updated] (SPARK-43149) When CTAS with USING fails to store metadata in metastore, data gets left around

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43149: --- Labels: pull-request-available (was: ) > When CTAS with USING fails to store metadata in

[jira] [Updated] (SPARK-36680) Supports Dynamic Table Options for Spark SQL

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-36680: --- Labels: pull-request-available (was: ) > Supports Dynamic Table Options for Spark SQL >

[jira] [Resolved] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46294. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44222

[jira] [Assigned] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

2023-12-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46294: --- Assignee: Davin Tjong > Clean up initValue vs zeroValue semantics in SQLMetrics >

[jira] [Updated] (SPARK-46386) Improve assertions of observation (pyspark.sql.observation)

2023-12-14 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46386: - Summary: Improve assertions of observation (pyspark.sql.observation) (was: Improve and test

[jira] [Updated] (SPARK-46386) Improve and test assertions of observation (pyspark.sql.observation)

2023-12-14 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46386: - Parent: (was: SPARK-46041) Issue Type: Improvement (was: Sub-task) > Improve and

[jira] [Updated] (SPARK-46413) Validate returnType of Arrow Python UDF

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46413: --- Labels: pull-request-available (was: ) > Validate returnType of Arrow Python UDF >

[jira] [Updated] (SPARK-46413) Validate returnType of Arrow Python UDF

2023-12-14 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46413: - Description: Validate returnType of Arrow Python UDF (was: Check returnType of Arrow Python

[jira] [Updated] (SPARK-46413) Validate returnType of Arrow Python UDF

2023-12-14 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46413: - Summary: Validate returnType of Arrow Python UDF (was: Check returnType of Arrow Python UDF)

[jira] [Created] (SPARK-46413) Check returnType of Arrow Python UDF

2023-12-14 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-46413: Summary: Check returnType of Arrow Python UDF Key: SPARK-46413 URL: https://issues.apache.org/jira/browse/SPARK-46413 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46289) Exception when ordering by UDT in interpreted mode

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46289: --- Labels: pull-request-available (was: ) > Exception when ordering by UDT in interpreted

[jira] [Created] (SPARK-46412) Update resource-managers/kubernetes/integration-tests/README.md to java 17 and 21

2023-12-14 Thread Jira
Bjørn Jørgensen created SPARK-46412: --- Summary: Update resource-managers/kubernetes/integration-tests/README.md to java 17 and 21 Key: SPARK-46412 URL: https://issues.apache.org/jira/browse/SPARK-46412

[jira] [Updated] (SPARK-46409) Spark Connect Repl does not work with ClosureCleaner

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46409: --- Labels: pull-request-available (was: ) > Spark Connect Repl does not work with

[jira] [Updated] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2023-12-14 Thread Andrew Otto (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Otto updated SPARK-23890: Shepherd: Max Gekk Affects Version/s: 3.0.0 Description: As part of 

[jira] [Reopened] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2023-12-14 Thread Andrew Otto (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Otto reopened SPARK-23890: - This was supposed to have been fixed in Spark 3 datasource v2, but the issue persists. > Hive

[jira] [Updated] (SPARK-23890) Hive ALTER TABLE CHANGE COLUMN for struct type no longer works

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-23890: --- Labels: bulk-closed pull-request-available (was: bulk-closed) > Hive ALTER TABLE CHANGE

[jira] [Updated] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46411: --- Labels: pull-request-available (was: ) > Change to use bcprov/bcpkix-jdk18on for test >

[jira] [Created] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

2023-12-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-46411: Summary: Change to use bcprov/bcpkix-jdk18on for test Key: SPARK-46411 URL: https://issues.apache.org/jira/browse/SPARK-46411 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46410) Assign error classes/subclasses to JdbcUtils.classifyException

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46410: --- Labels: pull-request-available (was: ) > Assign error classes/subclasses to

[jira] [Assigned] (SPARK-46410) Assign error classes/subclasses to JdbcUtils.classifyException

2023-12-14 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46410: Assignee: Max Gekk > Assign error classes/subclasses to JdbcUtils.classifyException >

[jira] [Created] (SPARK-46410) Assign error classes/subclasses to JdbcUtils.classifyException

2023-12-14 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-46410: Summary: Assign error classes/subclasses to JdbcUtils.classifyException Key: SPARK-46410 URL: https://issues.apache.org/jira/browse/SPARK-46410 Project: Spark

[jira] [Created] (SPARK-46409) Spark Connect Repl does not work with ClosureCleaner

2023-12-14 Thread Vsevolod Stepanov (Jira)
Vsevolod Stepanov created SPARK-46409: - Summary: Spark Connect Repl does not work with ClosureCleaner Key: SPARK-46409 URL: https://issues.apache.org/jira/browse/SPARK-46409 Project: Spark

[jira] [Updated] (SPARK-46408) support date_sub on V2ExpressionBuilder

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46408: --- Labels: pull-request-available (was: ) > support date_sub on V2ExpressionBuilder >

[jira] [Created] (SPARK-46408) support date_sub on V2ExpressionBuilder

2023-12-14 Thread Caican Cai (Jira)
Caican Cai created SPARK-46408: -- Summary: support date_sub on V2ExpressionBuilder Key: SPARK-46408 URL: https://issues.apache.org/jira/browse/SPARK-46408 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46406) Assign a name to the error class _LEGACY_ERROR_TEMP_1023

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46406: --- Labels: pull-request-available (was: ) > Assign a name to the error class

[jira] [Updated] (SPARK-46407) Reorganize `OpsOnDiffFramesDisabledTests`

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46407: --- Labels: pull-request-available (was: ) > Reorganize `OpsOnDiffFramesDisabledTests` >

[jira] [Created] (SPARK-46407) Reorganize `OpsOnDiffFramesDisabledTests`

2023-12-14 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46407: - Summary: Reorganize `OpsOnDiffFramesDisabledTests` Key: SPARK-46407 URL: https://issues.apache.org/jira/browse/SPARK-46407 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-46406) Assign a name to the error class _LEGACY_ERROR_TEMP_1023

2023-12-14 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-46406: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_1023 Key: SPARK-46406 URL: https://issues.apache.org/jira/browse/SPARK-46406 Project: Spark Issue

[jira] [Resolved] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-12-14 Thread Jiaan Geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng resolved SPARK-45796. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44184

[jira] [Assigned] (SPARK-46391) Reorganize `ExpandingParityTests`

2023-12-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46391: - Assignee: Ruifeng Zheng > Reorganize `ExpandingParityTests` >

[jira] [Resolved] (SPARK-46391) Reorganize `ExpandingParityTests`

2023-12-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46391. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44332

[jira] [Updated] (SPARK-28386) Cannot resolve ORDER BY columns with GROUP BY and HAVING

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-28386: --- Labels: pull-request-available (was: ) > Cannot resolve ORDER BY columns with GROUP BY and

[jira] [Created] (SPARK-46405) Issue with CSV schema inference and malformed records

2023-12-14 Thread Yaohua Zhao (Jira)
Yaohua Zhao created SPARK-46405: --- Summary: Issue with CSV schema inference and malformed records Key: SPARK-46405 URL: https://issues.apache.org/jira/browse/SPARK-46405 Project: Spark Issue

[jira] [Assigned] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45796: -- Assignee: Jiaan Geng (was: Apache Spark) > Support MODE() WITHIN GROUP (ORDER BY

[jira] [Assigned] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45796: -- Assignee: Apache Spark (was: Jiaan Geng) > Support MODE() WITHIN GROUP (ORDER BY

[jira] [Assigned] (SPARK-46401) Should use `!isEmpty()` on RoaringBitmap instead of `getCardinality() > 0`

2023-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46401: Assignee: Yang Jie > Should use `!isEmpty()` on RoaringBitmap instead of `getCardinality() > 0`

[jira] [Resolved] (SPARK-46401) Should use `!isEmpty()` on RoaringBitmap instead of `getCardinality() > 0`

2023-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46401. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44347

[jira] [Assigned] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45796: -- Assignee: Apache Spark (was: Jiaan Geng) > Support MODE() WITHIN GROUP (ORDER BY

[jira] [Commented] (SPARK-46404) Add structured-streaming-page.test.js to test structured-streaming-page.js

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796633#comment-17796633 ] ASF GitHub Bot commented on SPARK-46404: User 'yaooqinn' has created a pull request for this

[jira] [Assigned] (SPARK-46404) Add structured-streaming-page.test.js to test structured-streaming-page.js

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46404: -- Assignee: Apache Spark > Add structured-streaming-page.test.js to test

[jira] [Assigned] (SPARK-45796) Support MODE() WITHIN GROUP (ORDER BY col)

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45796: -- Assignee: Jiaan Geng (was: Apache Spark) > Support MODE() WITHIN GROUP (ORDER BY

[jira] [Assigned] (SPARK-46384) Structured Streaming UI doesn't display graph correctly

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46384: -- Assignee: Apache Spark > Structured Streaming UI doesn't display graph correctly >

[jira] [Assigned] (SPARK-46401) Should use `!isEmpty()` on RoaringBitmap instead of `getCardinality() > 0`

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46401: -- Assignee: Apache Spark > Should use `!isEmpty()` on RoaringBitmap instead of

[jira] [Assigned] (SPARK-46384) Structured Streaming UI doesn't display graph correctly

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46384: -- Assignee: (was: Apache Spark) > Structured Streaming UI doesn't display graph

[jira] [Assigned] (SPARK-46404) Add structured-streaming-page.test.js to test structured-streaming-page.js

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46404: -- Assignee: (was: Apache Spark) > Add structured-streaming-page.test.js to test

[jira] [Assigned] (SPARK-46401) Should use `!isEmpty()` on RoaringBitmap instead of `getCardinality() > 0`

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46401: -- Assignee: (was: Apache Spark) > Should use `!isEmpty()` on RoaringBitmap instead

[jira] [Assigned] (SPARK-46404) Add structured-streaming-page.test.js to test structured-streaming-page.js

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46404: -- Assignee: Apache Spark > Add structured-streaming-page.test.js to test

[jira] [Assigned] (SPARK-46384) Structured Streaming UI doesn't display graph correctly

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46384: -- Assignee: Apache Spark > Structured Streaming UI doesn't display graph correctly >

[jira] [Assigned] (SPARK-46384) Structured Streaming UI doesn't display graph correctly

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46384: -- Assignee: (was: Apache Spark) > Structured Streaming UI doesn't display graph

[jira] [Assigned] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46400: -- Assignee: Apache Spark > When there are corrupted files in the local maven repo,

[jira] [Assigned] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46400: -- Assignee: (was: Apache Spark) > When there are corrupted files in the local

[jira] [Assigned] (SPARK-45959) Abusing DataSet.withColumn can cause huge tree with severe perf degradation

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45959: -- Assignee: (was: Apache Spark) > Abusing DataSet.withColumn can cause huge tree

[jira] [Assigned] (SPARK-45959) Abusing DataSet.withColumn can cause huge tree with severe perf degradation

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45959: -- Assignee: Apache Spark > Abusing DataSet.withColumn can cause huge tree with severe

[jira] [Assigned] (SPARK-45959) Abusing DataSet.withColumn can cause huge tree with severe perf degradation

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45959: -- Assignee: Apache Spark > Abusing DataSet.withColumn can cause huge tree with severe

[jira] [Assigned] (SPARK-45959) Abusing DataSet.withColumn can cause huge tree with severe perf degradation

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45959: -- Assignee: (was: Apache Spark) > Abusing DataSet.withColumn can cause huge tree

[jira] [Created] (SPARK-46404) Add structured-streaming-page.test.js to test structured-streaming-page.js

2023-12-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-46404: Summary: Add structured-streaming-page.test.js to test structured-streaming-page.js Key: SPARK-46404 URL: https://issues.apache.org/jira/browse/SPARK-46404 Project: Spark

[jira] [Updated] (SPARK-46403) Decode parquet binary with getBytesUnsafe method

2023-12-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46403: --- Labels: pull-request-available (was: ) > Decode parquet binary with getBytesUnsafe method

[jira] [Updated] (SPARK-46403) Decode parquet binary with getBytesUnsafe method

2023-12-14 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-46403: Description: Now spark will get a parquet binary object with getBytes() method. The *Binary.getBytes()*

[jira] [Updated] (SPARK-46403) Decode parquet binary with getBytesUnsafe method

2023-12-14 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-46403: Description: Now spark will get a parquet binary object with getBytes() method. The *Binary.getBytes()*

[jira] [Updated] (SPARK-46403) Decode parquet binary with getBytesUnsafe method

2023-12-14 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-46403: Attachment: image-2023-12-14-16-30-39-104.png > Decode parquet binary with getBytesUnsafe method >

[jira] [Updated] (SPARK-46403) Decode parquet binary with getBytesUnsafe method

2023-12-14 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-46403: Summary: Decode parquet binary with getBytesUnsafe method (was: Decode parquet binary dictionary with

[jira] [Created] (SPARK-46403) Decode parquet binary dictionary with getBytesUnsafe method

2023-12-14 Thread Wan Kun (Jira)
Wan Kun created SPARK-46403: --- Summary: Decode parquet binary dictionary with getBytesUnsafe method Key: SPARK-46403 URL: https://issues.apache.org/jira/browse/SPARK-46403 Project: Spark Issue

[jira] [Resolved] (SPARK-46396) LegacyFastTimestampFormatter.parseOptional should not throw exception

2023-12-14 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-46396. Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-46393) Classify exceptions in the JDBC table catalog

2023-12-14 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46393. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44335