[jira] [Resolved] (SPARK-49495) Document and Feature Preview on master branch via Live GitHub Pages Updates

2024-09-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49495. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48175 [https://github.com

[jira] [Assigned] (SPARK-49495) Document and Feature Preview on master branch via Live GitHub Pages Updates

2024-09-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49495: Assignee: Kent Yao > Document and Feature Preview on master branch via Live GitHub Pages Updates

[jira] [Resolved] (SPARK-49495) Document and Feature Preview on master branch via Live GitHub Pages Updates

2024-09-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49495. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47968 [https://github.com

[jira] [Assigned] (SPARK-49495) Document and Feature Preview on master branch via Live GitHub Pages Updates

2024-09-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49495: Assignee: Kent Yao > Document and Feature Preview on master branch via Live GitHub Pages Updates

[jira] [Commented] (SPARK-49508) Optimized hadoop-aws dependency, aws-java-sdk-bundle jar is too large

2024-09-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879827#comment-17879827 ] Kent Yao commented on SPARK-49508: -- That‘s the 'provided' scope for. Spark already prov

[jira] [Commented] (SPARK-49508) Optimized hadoop-aws dependency, aws-java-sdk-bundle jar is too large

2024-09-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879818#comment-17879818 ] Kent Yao commented on SPARK-49508: -- I don't see this in tar.gz files. Do they only pull

[jira] [Resolved] (SPARK-49408) Poor performance in ProjectingInternalRow

2024-09-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49408. -- Fix Version/s: 3.4.4 4.0.0 3.5.3 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-49408) Poor performance in ProjectingInternalRow

2024-09-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49408: Assignee: Frank Wong > Poor performance in ProjectingInternalRow > --

[jira] [Resolved] (SPARK-49445) Support show tooltip in the progress bar of UI

2024-09-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49445. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47908 [https://github.com

[jira] [Assigned] (SPARK-49470) Update dataTables from 1.13.5 to 1.13.11

2024-09-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49470: Assignee: Kent Yao > Update dataTables from 1.13.5 to 1.13.11 > -

[jira] [Resolved] (SPARK-49470) Update dataTables from 1.13.5 to 1.13.11

2024-09-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49470. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47938 [https://github.com

[jira] [Created] (SPARK-49495) Document and Feature Preview on master branch via Live GitHub Pages Updates

2024-09-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-49495: Summary: Document and Feature Preview on master branch via Live GitHub Pages Updates Key: SPARK-49495 URL: https://issues.apache.org/jira/browse/SPARK-49495 Project: Spark

[jira] [Created] (SPARK-49494) Using spark logos from spark-website in docs

2024-09-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-49494: Summary: Using spark logos from spark-website in docs Key: SPARK-49494 URL: https://issues.apache.org/jira/browse/SPARK-49494 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-49378) Break apart the Structured Streaming Programming Guide

2024-08-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49378. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47864 [https://github.com

[jira] [Assigned] (SPARK-49378) Break apart the Structured Streaming Programming Guide

2024-08-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49378: Assignee: Neil Ramaswamy > Break apart the Structured Streaming Programming Guide > -

[jira] [Created] (SPARK-49470) Update dataTables from 1.13.5 to 1.13.11

2024-08-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-49470: Summary: Update dataTables from 1.13.5 to 1.13.11 Key: SPARK-49470 URL: https://issues.apache.org/jira/browse/SPARK-49470 Project: Spark Issue Type: Dependency upgra

[jira] [Created] (SPARK-49459) Support CRC32C for Shuffle Checksum

2024-08-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-49459: Summary: Support CRC32C for Shuffle Checksum Key: SPARK-49459 URL: https://issues.apache.org/jira/browse/SPARK-49459 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46037) When Left Join build Left, ShuffledHashJoinExec may result in incorrect results

2024-08-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46037: - Priority: Blocker (was: Minor) > When Left Join build Left, ShuffledHashJoinExec may result in incorrec

[jira] [Resolved] (SPARK-49405) Restrict charsets in JsonOptions

2024-08-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49405. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47887 [https://github.com

[jira] [Created] (SPARK-49405) Restrict charsets in JsonOptions

2024-08-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-49405: Summary: Restrict charsets in JsonOptions Key: SPARK-49405 URL: https://issues.apache.org/jira/browse/SPARK-49405 Project: Spark Issue Type: Improvement Co

[jira] [Resolved] (SPARK-49314) Upgrade `h2` to 2.3.232, `postgresql` to 42.7.4 and `mssql` to 12.8.1.jre11

2024-08-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49314. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47810 [https://github.com

[jira] [Assigned] (SPARK-49314) Upgrade `h2` to 2.3.232, `postgresql` to 42.7.4 and `mssql` to 12.8.1.jre11

2024-08-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49314: Assignee: Wei Guo > Upgrade `h2` to 2.3.232, `postgresql` to 42.7.4 and `mssql` to 12.8.1.jre11 >

[jira] [Resolved] (SPARK-49180) Optimize spark-website and doc release size

2024-08-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49180. -- Assignee: Kent Yao Resolution: Fixed The repo size is reduced from 17G to 6.5G now, so I mark th

[jira] [Resolved] (SPARK-49209) Archive Spark Documentations in Apache Archives

2024-08-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49209. -- Assignee: Kent Yao Resolution: Fixed Archived at https://archive.apache.org/dist/spark/docs/ >

[jira] [Assigned] (SPARK-49039) Reset checkbox when executor metrics are loaded in the Stages tab

2024-08-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49039: Assignee: dzcxzl > Reset checkbox when executor metrics are loaded in the Stages tab > --

[jira] [Resolved] (SPARK-49039) Reset checkbox when executor metrics are loaded in the Stages tab

2024-08-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49039. -- Fix Version/s: 3.4.4 4.0.0 3.5.3 Resolution: Fixed Issue

[jira] [Updated] (SPARK-45590) okio-1.15.0 CVE-2023-3635

2024-08-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-45590: - Fix Version/s: 4.0.0 3.4.4 > okio-1.15.0 CVE-2023-3635 > - >

[jira] [Resolved] (SPARK-45590) okio-1.15.0 CVE-2023-3635

2024-08-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45590. -- Fix Version/s: 3.5.3 Resolution: Fixed Issue resolved by pull request 47769 [https://github.com

[jira] [Assigned] (SPARK-45590) okio-1.15.0 CVE-2023-3635

2024-08-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45590: Assignee: Gabor Roczei > okio-1.15.0 CVE-2023-3635 > - > >

[jira] [Resolved] (SPARK-49242) Upgrade commons-cli to 1.9.0

2024-08-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49242. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47764 [https://github.com

[jira] [Resolved] (SPARK-48947) Use lowercased charset name to decrease cache missing in Charset.forName

2024-08-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48947. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47420 [https://github.com

[jira] [Resolved] (SPARK-49205) KeyGroupedPartitioning should inherit HashPartitioningLike

2024-08-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47734 [https://github.com

[jira] [Assigned] (SPARK-49205) KeyGroupedPartitioning should inherit HashPartitioningLike

2024-08-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49205: Assignee: XiDuo You > KeyGroupedPartitioning should inherit HashPartitioningLike > --

[jira] [Updated] (SPARK-49209) Archive Spark Documentations in Apache Archives

2024-08-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49209: - Description: To address the issue of the Spark website repository size reaching the storage limit for

[jira] [Created] (SPARK-49209) Archive Spark Documentations in Apache Archives

2024-08-12 Thread Kent Yao (Jira)
Kent Yao created SPARK-49209: Summary: Archive Spark Documentations in Apache Archives Key: SPARK-49209 URL: https://issues.apache.org/jira/browse/SPARK-49209 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-49181) Remove site/docs/{version}/api/python/_sources folder

2024-08-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49181: Assignee: Kent Yao > Remove site/docs/{version}/api/python/_sources folder >

[jira] [Resolved] (SPARK-49181) Remove site/docs/{version}/api/python/_sources folder

2024-08-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49181. -- Resolution: Fixed > Remove site/docs/{version}/api/python/_sources folder > --

[jira] [Assigned] (SPARK-11583) Make MapStatus use less memory uage

2024-08-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-11583: Assignee: Kent Yao (was: Davies Liu) > Make MapStatus use less memory uage > ---

[jira] [Updated] (SPARK-49182) Stop publish site/docs/{version}/api/python/_sources

2024-08-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49182: - Fix Version/s: 3.5.3 (was: 3.5.2) > Stop publish site/docs/{version}/api/python/_

[jira] [Assigned] (SPARK-49182) Stop publish site/docs/{version}/api/python/_sources

2024-08-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49182: Assignee: Kent Yao > Stop publish site/docs/{version}/api/python/_sources > -

[jira] [Resolved] (SPARK-49182) Stop publish site/docs/{version}/api/python/_sources

2024-08-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49182. -- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution: Fixed Issue

[jira] [Resolved] (SPARK-49174) Exclude the dir `docs/util` from `_site`

2024-08-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49174. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47678 [https://github.com

[jira] [Created] (SPARK-49182) Stop publish site/docs/{version}/api/python/_sources

2024-08-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-49182: Summary: Stop publish site/docs/{version}/api/python/_sources Key: SPARK-49182 URL: https://issues.apache.org/jira/browse/SPARK-49182 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-49181) Remove site/docs/{version}/api/python/_sources folder

2024-08-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-49181: Summary: Remove site/docs/{version}/api/python/_sources folder Key: SPARK-49181 URL: https://issues.apache.org/jira/browse/SPARK-49181 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-49180) Optimize spark-website and doc release size

2024-08-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-49180: Summary: Optimize spark-website and doc release size Key: SPARK-49180 URL: https://issues.apache.org/jira/browse/SPARK-49180 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-49147) Mark KryoRegistrator as DeveloperApi interface

2024-08-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49147. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47657 [https://github.com

[jira] [Assigned] (SPARK-49147) Mark KryoRegistrator as DeveloperApi interface

2024-08-08 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49147: Assignee: Rob Reeves > Mark KryoRegistrator as DeveloperApi interface > -

[jira] [Resolved] (SPARK-49154) Upgrade `Volcano` to 1.9.0

2024-08-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49154. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47661 [https://github.com

[jira] [Resolved] (SPARK-49124) Upgrade tink to 1.14.1

2024-08-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49124. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47632 [https://github.com

[jira] [Assigned] (SPARK-49124) Upgrade tink to 1.14.1

2024-08-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49124: Assignee: Wei Guo > Upgrade tink to 1.14.1 > -- > > Key: SPAR

[jira] [Created] (SPARK-49141) Mark variant as hive incompatible data type

2024-08-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-49141: Summary: Mark variant as hive incompatible data type Key: SPARK-49141 URL: https://issues.apache.org/jira/browse/SPARK-49141 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49134) Support retry for deploying artifacts to Nexus staging repository

2024-08-06 Thread Kent Yao (Jira)
Kent Yao created SPARK-49134: Summary: Support retry for deploying artifacts to Nexus staging repository Key: SPARK-49134 URL: https://issues.apache.org/jira/browse/SPARK-49134 Project: Spark Is

[jira] [Resolved] (SPARK-49120) Bump Gson 2.11.0

2024-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49120. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47627 [https://github.com

[jira] [Updated] (SPARK-49099) Refactor CatalogManager.setCurrentNamespace

2024-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49099: - Affects Version/s: 3.5.1 > Refactor CatalogManager.setCurrentNamespace > ---

[jira] [Updated] (SPARK-49099) Refactor CatalogManager.setCurrentNamespace

2024-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49099: - Issue Type: Bug (was: Improvement) > Refactor CatalogManager.setCurrentNamespace >

[jira] [Resolved] (SPARK-49099) Refactor CatalogManager.setCurrentNamespace

2024-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49099. -- Fix Version/s: 4.0.0 3.5.2 Resolution: Fixed > Refactor CatalogManager.setCu

[jira] [Resolved] (SPARK-49091) Some broadcasts cannot be cleared from memory storage

2024-08-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49091. -- Assignee: Zhen Wang Resolution: Not A Problem > Some broadcasts cannot be cleared from memory st

[jira] [Resolved] (SPARK-49107) ROUTINE_ALREADY_EXISTS supports RoutineType

2024-08-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49107. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47600 [https://github.com

[jira] [Resolved] (SPARK-49108) Add `submit_pi.sh` REST API example

2024-08-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49108. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47601 [https://github.com

[jira] [Assigned] (SPARK-49078) Support show columns syntax in v2 table

2024-08-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49078: Assignee: xy > Support show columns syntax in v2 table > ---

[jira] [Resolved] (SPARK-49078) Support show columns syntax in v2 table

2024-08-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49078. -- Resolution: Fixed Issue resolved by pull request 47568 [https://github.com/apache/spark/pull/47568] >

[jira] [Updated] (SPARK-49094) ignoreCorruptFiles file source option is partially supported for orc format

2024-08-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49094: - Issue Type: Bug (was: Improvement) > ignoreCorruptFiles file source option is partially supported for o

[jira] [Commented] (SPARK-49091) Some broadcasts cannot be cleared from memory storage

2024-08-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870519#comment-17870519 ] Kent Yao commented on SPARK-49091: -- Thank you [~wforget] for the verification, sounds r

[jira] [Updated] (SPARK-49094) ignoreCorruptFiles file source option is partially supported for orc format

2024-08-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49094: - Affects Version/s: 3.4.3 3.5.1 > ignoreCorruptFiles file source option is partial

[jira] [Created] (SPARK-49094) ignoreCorruptFiles file source option is partially supported for orc format

2024-08-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-49094: Summary: ignoreCorruptFiles file source option is partially supported for orc format Key: SPARK-49094 URL: https://issues.apache.org/jira/browse/SPARK-49094 Project: Spark

[jira] [Updated] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49000: - Fix Version/s: 3.4.4 > Aggregation with DISTINCT gives wrong results when dealing with literals > --

[jira] [Commented] (SPARK-49030) Self join of a CTE seems non-deterministic

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870341#comment-17870341 ] Kent Yao commented on SPARK-49030: -- I retargeted this to version 3.5.3 because we have

[jira] [Updated] (SPARK-49030) Self join of a CTE seems non-deterministic

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49030: - Fix Version/s: 3.5.3 > Self join of a CTE seems non-deterministic >

[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870316#comment-17870316 ] Kent Yao commented on SPARK-48950: -- Thank you [~dongjoon] Hi [~Tom_Newton] Please let

[jira] [Updated] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-44638: - Fix Version/s: 3.4.4 > Unable to read from JDBC data sources when using custom schema containing > varc

[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870190#comment-17870190 ] Kent Yao commented on SPARK-48950: -- Thank you [~Tom_Newton] for the additional inputs.

[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870183#comment-17870183 ] Kent Yao commented on SPARK-48950: -- Did your app run with ignoreCorruptFiles? BTW,I wo

[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870152#comment-17870152 ] Kent Yao commented on SPARK-48950: -- According to the error stacks you provided, ``` C

[jira] [Commented] (SPARK-49030) Self join of a CTE seems non-deterministic

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870147#comment-17870147 ] Kent Yao commented on SPARK-49030: -- Thank you [~ulysses] for the verification > Self j

[jira] [Commented] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870120#comment-17870120 ] Kent Yao commented on SPARK-49000: -- The commit is reverted to fix CI, please send a bac

[jira] [Updated] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

2024-08-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49000: - Fix Version/s: (was: 3.5.2) > Aggregation with DISTINCT gives wrong results when dealing with litera

[jira] [Updated] (SPARK-49054) Column default value should support current_* functions

2024-07-31 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49054: - Fix Version/s: 4.0.0 > Column default value should support current_* functions > ---

[jira] [Assigned] (SPARK-49067) Move utf-8 literal into the methods of UrlCodec class

2024-07-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-49067: Assignee: Zhen Wang > Move utf-8 literal into the methods of UrlCodec class > ---

[jira] [Resolved] (SPARK-49067) Move utf-8 literal into the methods of UrlCodec class

2024-07-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-49067. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47544 [https://github.com

[jira] [Resolved] (SPARK-48608) Spark 3.5: fails to build with value defaultValueNotConstantError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors

2024-07-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48608. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by https://github.com/apache/spark/pull/4

[jira] [Updated] (SPARK-48308) Unify getting data schema without partition columns in FileSourceStrategy

2024-07-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48308: - Fix Version/s: 3.5.2 > Unify getting data schema without partition columns in FileSourceStrategy > -

[jira] [Updated] (SPARK-48991) FileStreamSink.hasMetadata handles invalid path

2024-07-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48991: - Fix Version/s: 3.5.3 (was: 3.5.2) > FileStreamSink.hasMetadata handles invalid pa

[jira] [Created] (SPARK-48991) FileStreamSink.hasMetadata handles invalid path

2024-07-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-48991: Summary: FileStreamSink.hasMetadata handles invalid path Key: SPARK-48991 URL: https://issues.apache.org/jira/browse/SPARK-48991 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-48963) Support JIRA_ACCESS_TOKEN in translate-contributors.py

2024-07-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-48963: Summary: Support JIRA_ACCESS_TOKEN in translate-contributors.py Key: SPARK-48963 URL: https://issues.apache.org/jira/browse/SPARK-48963 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-48921) ScalaUDF in subquery should run through analyzer

2024-07-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867174#comment-17867174 ] Kent Yao commented on SPARK-48921: -- Collected to 3.5.2 > ScalaUDF in subquery should r

[jira] [Updated] (SPARK-48934) Python datetime types converted incorrectly for setting timeout in applyInPandasWithState

2024-07-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48934: - Fix Version/s: 3.5.2 (was: 3.5.3) > Python datetime types converted incorrectly f

[jira] [Updated] (SPARK-48921) ScalaUDF in subquery should run through analyzer

2024-07-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48921: - Fix Version/s: 3.5.2 (was: 3.5.3) > ScalaUDF in subquery should run through analy

[jira] [Updated] (SPARK-48791) Perf regression due to accumulator registration overhead using CopyOnWriteArrayList

2024-07-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48791: - Fix Version/s: 3.5.2 (was: 3.5.3) > Perf regression due to accumulator registrati

[jira] [Commented] (SPARK-48791) Perf regression due to accumulator registration overhead using CopyOnWriteArrayList

2024-07-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867175#comment-17867175 ] Kent Yao commented on SPARK-48791: -- Collected to 3.5.2 > Perf regression due to accumu

[jira] [Commented] (SPARK-48934) Python datetime types converted incorrectly for setting timeout in applyInPandasWithState

2024-07-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867173#comment-17867173 ] Kent Yao commented on SPARK-48934: -- Collected this to 3.5.2 > Python datetime types co

[jira] [Resolved] (SPARK-48865) Add try_url_decode function

2024-07-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48865. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47294 [https://github.com

[jira] [Resolved] (SPARK-48908) GitHub API Rate Limit Exceeded Problem in spark-rm Dockerfile

2024-07-16 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48908. -- Resolution: Not A Problem Only 3.5 has such an issue > GitHub API Rate Limit Exceeded Problem in spar

[jira] [Created] (SPARK-48908) GitHub API Rate Limit Exceeded Problem in spark-rm Dockerfile

2024-07-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-48908: Summary: GitHub API Rate Limit Exceeded Problem in spark-rm Dockerfile Key: SPARK-48908 URL: https://issues.apache.org/jira/browse/SPARK-48908 Project: Spark Issue

[jira] [Created] (SPARK-48905) Add a guideline for version updates in DOC and various API DOCs

2024-07-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-48905: Summary: Add a guideline for version updates in DOC and various API DOCs Key: SPARK-48905 URL: https://issues.apache.org/jira/browse/SPARK-48905 Project: Spark Issu

[jira] [Created] (SPARK-48904) Update doc's version field to align with fixedVersion field of JIRA ticket

2024-07-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-48904: Summary: Update doc's version field to align with fixedVersion field of JIRA ticket Key: SPARK-48904 URL: https://issues.apache.org/jira/browse/SPARK-48904 Project: Spark

[jira] [Resolved] (SPARK-48885) Make some inheritances of RuntimeReplaceable override replacement to lazy val

2024-07-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48885. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47333 [https://github.com

[jira] [Assigned] (SPARK-48885) Make some inheritances of RuntimeReplaceable override replacement to lazy val

2024-07-15 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48885: Assignee: Kent Yao > Make some inheritances of RuntimeReplaceable override replacement to lazy va

[jira] [Updated] (SPARK-47819) Use asynchronous callback for execution cleanup

2024-07-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47819: - Fix Version/s: (was: 4.0.0) (was: 3.5.2) > Use asynchronous callback for exec

[jira] [Updated] (SPARK-47652) Spark Remote Connect to multiple Spark Sessions

2024-07-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47652: - Fix Version/s: (was: 3.5.2) > Spark Remote Connect to multiple Spark Sessions >

[jira] [Updated] (SPARK-47947) Add AssertDataFrameEquality util function for scala

2024-07-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47947: - Fix Version/s: (was: 3.5.2) > Add AssertDataFrameEquality util function for scala >

  1   2   3   4   5   6   7   8   9   10   >