[jira] [Reopened] (SPARK-45547) Validate Vectors with built-in function

2023-10-22 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-45547: --- > Validate Vectors with built-in function > --- > >

[jira] [Created] (SPARK-45629) Fix `Implicit definition should have explicit type`

2023-10-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45629: Summary: Fix `Implicit definition should have explicit type` Key: SPARK-45629 URL: https://issues.apache.org/jira/browse/SPARK-45629 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44407) Clean up the compilation warnings related to `it will become a keyword in Scala 3`

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44407: - Summary: Clean up the compilation warnings related to `it will become a keyword in Scala 3` (was:

[jira] [Updated] (SPARK-44407) Clean up the compilation warnings related to xx

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44407: - Summary: Clean up the compilation warnings related to xx (was: Prohibit using `enum` as a variable or

[jira] [Updated] (SPARK-44407) Prohibit using `enum` as a variable or function name

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44407: - Description: {code:java} [warn]

[jira] [Updated] (SPARK-44407) Prohibit using `enum` as a variable or function name

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44407: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Prohibit using `enum` as a

[jira] [Resolved] (SPARK-45625) Upgrade log4j2 to 2.21.0

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45625. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43478

[jira] [Assigned] (SPARK-45625) Upgrade log4j2 to 2.21.0

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45625: Assignee: Yang Jie > Upgrade log4j2 to 2.21.0 > > >

[jira] [Resolved] (SPARK-45616) Usages of ParVector are unsafe because it does not propagate ThreadLocals or SparkSession

2023-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45616. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-45628) improve vector_to_array for .mllib.linalg.SparseVector

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45628: --- Labels: pull-request-available (was: ) > improve vector_to_array for

[jira] [Created] (SPARK-45628) improve vector_to_array for .mllib.linalg.SparseVector

2023-10-22 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45628: - Summary: improve vector_to_array for .mllib.linalg.SparseVector Key: SPARK-45628 URL: https://issues.apache.org/jira/browse/SPARK-45628 Project: Spark

[jira] [Assigned] (SPARK-45620) Fix user-facing APIs related to Python UDTF to use camelCase.

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45620: Assignee: Takuya Ueshin > Fix user-facing APIs related to Python UDTF to use camelCase.

[jira] [Resolved] (SPARK-45620) Fix user-facing APIs related to Python UDTF to use camelCase.

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45620. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43470

[jira] [Resolved] (SPARK-44753) XML: Add Python and sparkR binding including Spark Connect

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44753. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43462

[jira] [Assigned] (SPARK-44753) XML: Add Python and sparkR binding including Spark Connect

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44753: Assignee: Sandip Agarwala > XML: Add Python and sparkR binding including Spark Connect >

[jira] [Assigned] (SPARK-45624) Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible`

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45624: Assignee: Yang Jie > Use `AccessibleObject#canAccess` instead of

[jira] [Resolved] (SPARK-45624) Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible`

2023-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45624. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43477

[jira] [Resolved] (SPARK-45547) Validate Vectors with built-in function

2023-10-22 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45547. --- Resolution: Not A Problem > Validate Vectors with built-in function >

[jira] [Updated] (SPARK-44406) DataFrame depending on temp view fail after the view is dropped

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44406: --- Labels: pull-request-available (was: ) > DataFrame depending on temp view fail after the

[jira] [Updated] (SPARK-44427) Use PartitionEvaluator API in MapElementsExec, MapGroupsExec, MapPartitionsExec

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44427: --- Labels: pull-request-available (was: ) > Use PartitionEvaluator API in MapElementsExec,

[jira] [Updated] (SPARK-39195) Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39195: --- Labels: pull-request-available (was: ) > Spark OutputCommitCoordinator should abort stage

[jira] [Updated] (SPARK-44407) Prohibit using `enum` as a variable or function name

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44407: --- Labels: pull-request-available (was: ) > Prohibit using `enum` as a variable or function

[jira] [Updated] (SPARK-45627) Fix `symbol literal is deprecated`

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45627: - Description: For the code `val symbol = 'symbol`, it's a compile warning in Scala 2.13, but it's a

[jira] [Resolved] (SPARK-45610) Fix "Auto-application to `()` is deprecated."

2023-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45610. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43472

[jira] [Assigned] (SPARK-45610) Fix "Auto-application to `()` is deprecated."

2023-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45610: Assignee: Yang Jie > Fix "Auto-application to `()` is deprecated." >

[jira] [Commented] (SPARK-45023) SPIP: Python Stored Procedures

2023-10-22 Thread Abhinav Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778411#comment-17778411 ] Abhinav Kumar commented on SPARK-45023: --- Based on this, I will put another SPIP to create a

[jira] [Commented] (SPARK-45533) Use `j.l.r.Cleaner` instead of `finalize` for `RocksDBIterator/LevelDBIterator`

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778394#comment-17778394 ] Yang Jie commented on SPARK-45533: -- Okay, I'm just confirming that you will follow up on this issue,

[jira] [Commented] (SPARK-45533) Use `j.l.r.Cleaner` instead of `finalize` for `RocksDBIterator/LevelDBIterator`

2023-10-22 Thread Min Zhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778391#comment-17778391 ] Min Zhao commented on SPARK-45533: -- Sorry, I will do it in the next few days.  If it is urgent, you can

[jira] [Commented] (SPARK-44810) XML: ArrayType and MapType support in from_xml

2023-10-22 Thread tangjiafu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778386#comment-17778386 ] tangjiafu commented on SPARK-44810: --- well， [~sandip.agarwala]  Thank you for your patience and

[jira] [Updated] (SPARK-45626) Fix variable name of error-class & assign names to the error class _LEGACY_ERROR_TEMP_1055

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45626: --- Labels: pull-request-available (was: ) > Fix variable name of error-class & assign names

[jira] [Created] (SPARK-45626) Fix variable name of error-class & assign names to the error class _LEGACY_ERROR_TEMP_1055

2023-10-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-45626: --- Summary: Fix variable name of error-class & assign names to the error class _LEGACY_ERROR_TEMP_1055 Key: SPARK-45626 URL: https://issues.apache.org/jira/browse/SPARK-45626

[jira] [Updated] (SPARK-40820) Creating StructType from Json

2023-10-22 Thread Anthony Wainer Cachay Guivin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Wainer Cachay Guivin updated SPARK-40820: - Language: Python Scala (was: Python) > Creating StructType

[jira] [Updated] (SPARK-40820) Creating StructType from Json

2023-10-22 Thread Anthony Wainer Cachay Guivin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Wainer Cachay Guivin updated SPARK-40820: - Component/s: Spark Core Affects Version/s: 3.5.0

[jira] [Updated] (SPARK-45625) Upgrade log4j2 to 2.21.0

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45625: --- Labels: pull-request-available (was: ) > Upgrade log4j2 to 2.21.0 >

[jira] [Created] (SPARK-45625) Upgrade log4j2 to 2.21.0

2023-10-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45625: Summary: Upgrade log4j2 to 2.21.0 Key: SPARK-45625 URL: https://issues.apache.org/jira/browse/SPARK-45625 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45624) Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible`

2023-10-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45624: --- Labels: pull-request-available (was: ) > Use `AccessibleObject#canAccess` instead of

[jira] [Created] (SPARK-45624) Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible`

2023-10-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-45624: Summary: Use `AccessibleObject#canAccess` instead of `AccessibleObject#isAccessible` Key: SPARK-45624 URL: https://issues.apache.org/jira/browse/SPARK-45624 Project: Spark

[jira] [Resolved] (SPARK-45541) [CORE] Add SSLFactory

2023-10-22 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45541. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Commented] (SPARK-45533) Use `j.l.r.Cleaner` instead of `finalize` for `RocksDBIterator/LevelDBIterator`

2023-10-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778305#comment-17778305 ] Yang Jie commented on SPARK-45533: -- [~zhaomin] Are you still interested in this job?           > Use

[jira] [Resolved] (SPARK-45574) Add :: syntax as a shorthand for casting

2023-10-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45574. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43430