[jira] [Commented] (SPARK-45928) Fix schema merging for nested structures

2024-05-09 Thread Konjac (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845214#comment-17845214 ] Konjac commented on SPARK-45928: Hi [~shujing.yang] where is the PR? > Fix schema mergi

[jira] [Commented] (SPARK-46171) Remove `HiveContext` from Apache Spark 4.0

2024-05-09 Thread Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845213#comment-17845213 ] Kun commented on SPARK-46171: - It seems the PR has been abandoned. So, could we close this t

[jira] [Updated] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48231: --- Labels: pull-request-available (was: ) > Remove unused CodeHaus Jackson dependencies >

[jira] [Created] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

2024-05-09 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-48231: - Summary: Remove unused CodeHaus Jackson dependencies Key: SPARK-48231 URL: https://issues.apache.org/jira/browse/SPARK-48231 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-48158) XML expressions (all collations)

2024-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48158. - Fix Version/s: 4.0.0 Assignee: Uroš Bojanić Resolution: Fixed > XML expressions

[jira] [Updated] (SPARK-48158) XML expressions (all collations)

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48158: --- Labels: pull-request-available (was: ) > XML expressions (all collations) > ---

[jira] [Resolved] (SPARK-47847) Deprecate spark.network.remoteReadNioBufferConversion

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47847. --- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-47847) Deprecate spark.network.remoteReadNioBufferConversion

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47847: - Assignee: Cheng Pan > Deprecate spark.network.remoteReadNioBufferConversion > -

[jira] [Updated] (SPARK-47847) Deprecate spark.network.remoteReadNioBufferConversion

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47847: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Deprecate spark.network

[jira] [Updated] (SPARK-48230) Remove unused jodd-core

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48230: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove unused jodd-core

[jira] [Updated] (SPARK-48230) Remove unused jodd-core

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48230: --- Labels: pull-request-available (was: ) > Remove unused jodd-core > ---

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h2. ASF INFRA POLICY - [https://infra.apache.org/github-actions-policy.html] h2

[jira] [Created] (SPARK-48230) Remove unused jodd-core

2024-05-09 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-48230: - Summary: Remove unused jodd-core Key: SPARK-48230 URL: https://issues.apache.org/jira/browse/SPARK-48230 Project: Spark Issue Type: Improvement Component

[jira] [Resolved] (SPARK-48201) Docstrings of the pyspark DataStream Reader methods are inaccurate

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48201. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46416 [https://

[jira] [Assigned] (SPARK-48201) Docstrings of the pyspark DataStream Reader methods are inaccurate

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48201: - Assignee: Chloe He > Docstrings of the pyspark DataStream Reader methods are inaccurate

[jira] [Resolved] (SPARK-48228) Implement the missing function validation in ApplyInXXX

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48228. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46519 [https://

[jira] [Assigned] (SPARK-48228) Implement the missing function validation in ApplyInXXX

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48228: - Assignee: Ruifeng Zheng > Implement the missing function validation in ApplyInXXX > ---

[jira] [Created] (SPARK-48229) inputFile expressions (all collations)

2024-05-09 Thread Jira
Uroš Bojanić created SPARK-48229: Summary: inputFile expressions (all collations) Key: SPARK-48229 URL: https://issues.apache.org/jira/browse/SPARK-48229 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-48224) Disable variant from being a part of a map key

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48224. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46516 [https://

[jira] [Assigned] (SPARK-48224) Disable variant from being a part of a map key

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48224: - Assignee: Harsh Motwani > Disable variant from being a part of a map key >

[jira] [Updated] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48163: -- Parent: (was: SPARK-44111) Issue Type: Bug (was: Sub-task) > Disable `SparkConnec

[jira] [Closed] (SPARK-37626) Upgrade libthrift to 0.15.0

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-37626. - > Upgrade libthrift to 0.15.0 > --- > > Key: SPARK-37626 >

[jira] [Resolved] (SPARK-47018) Upgrade built-in Hive to 2.3.10

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47018. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46468 [https://

[jira] [Updated] (SPARK-47834) Mark deprecated functions with `@deprecated` in `SQLImplicits`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47834: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Mark deprecated functio

[jira] [Updated] (SPARK-48228) Implement the missing function validation in ApplyInXXX

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48228: --- Labels: pull-request-available (was: ) > Implement the missing function validation in Apply

[jira] [Resolved] (SPARK-47834) Mark deprecated functions with `@deprecated` in `SQLImplicits`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47834. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46029 [https://

[jira] [Created] (SPARK-48228) Implement the missing function validation in ApplyInXXX

2024-05-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48228: - Summary: Implement the missing function validation in ApplyInXXX Key: SPARK-48228 URL: https://issues.apache.org/jira/browse/SPARK-48228 Project: Spark Iss

[jira] [Updated] (SPARK-27900) Spark driver will not exit due to an oom error

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-27900: --- Labels: pull-request-available (was: ) > Spark driver will not exit due to an oom error > -

[jira] [Assigned] (SPARK-48176) Fix name of FIELD_ALREADY_EXISTS error condition

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48176: Assignee: Nicholas Chammas > Fix name of FIELD_ALREADY_EXISTS error condition > -

[jira] [Resolved] (SPARK-48176) Fix name of FIELD_ALREADY_EXISTS error condition

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48176. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46510 [https://gi

[jira] [Assigned] (SPARK-48222) Sync Ruby Bundler to 2.4.22 and refresh Gem lock file

2024-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48222: --- Assignee: Nicholas Chammas > Sync Ruby Bundler to 2.4.22 and refresh Gem lock file > --

[jira] [Resolved] (SPARK-48222) Sync Ruby Bundler to 2.4.22 and refresh Gem lock file

2024-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48222. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46512 [https://gith

[jira] [Resolved] (SPARK-48227) Document the requirement of seed in protos

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48227. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46518 [https://

[jira] [Assigned] (SPARK-48227) Document the requirement of seed in protos

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48227: - Assignee: Ruifeng Zheng > Document the requirement of seed in protos >

[jira] [Assigned] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48180: Assignee: Daniel > Analyzer bug with multiple ORDER BY items for input table argument > -

[jira] [Resolved] (SPARK-48180) Analyzer bug with multiple ORDER BY items for input table argument

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48180. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46451 [https://gi

[jira] [Resolved] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48226. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46501 [https://

[jira] [Assigned] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48226: - Assignee: BingKun Pan > Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl`

[jira] [Assigned] (SPARK-48148) JSON objects should not be modified when read as STRING

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48148: Assignee: Eric Maynard > JSON objects should not be modified when read as STRING > --

[jira] [Resolved] (SPARK-48148) JSON objects should not be modified when read as STRING

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48148. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46408 [https://gi

[jira] [Resolved] (SPARK-48089) Streaming query listener not working in 3.5 client <> 4.0 server

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48089. -- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46513 [https://gi

[jira] [Assigned] (SPARK-48089) Streaming query listener not working in 3.5 client <> 4.0 server

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48089: Assignee: Wei Liu > Streaming query listener not working in 3.5 client <> 4.0 server > --

[jira] [Resolved] (SPARK-48082) Recover compatibility with Spark Connect client 3.5 <> Spark Connect server 4.0

2024-05-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48082. -- Assignee: Hyukjin Kwon Resolution: Done > Recover compatibility with Spark Connect clie

[jira] [Updated] (SPARK-48227) Document the requirement of seed in protos

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48227: --- Labels: pull-request-available (was: ) > Document the requirement of seed in protos > -

[jira] [Created] (SPARK-48227) Document the requirement of seed in protos

2024-05-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48227: - Summary: Document the requirement of seed in protos Key: SPARK-48227 URL: https://issues.apache.org/jira/browse/SPARK-48227 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48226: --- Labels: pull-request-available (was: ) > Add `spark-ganglia-lgpl` to `lint-java` & `spark-g

[jira] [Updated] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`

2024-05-09 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-48226: Component/s: Build (was: Project Infra) > Add `spark-ganglia-lgpl` to `lint-j

[jira] [Created] (SPARK-48226) Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle`

2024-05-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48226: --- Summary: Add `spark-ganglia-lgpl` to `lint-java` & `spark-ganglia-lgpl` and `jvm-profiler` to `sbt-checkstyle` Key: SPARK-48226 URL: https://issues.apache.org/jira/browse/SPARK-4822

[jira] [Updated] (SPARK-48225) Upgrade `sbt` to 1.10.0

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48225: --- Labels: pull-request-available (was: ) > Upgrade `sbt` to 1.10.0 > ---

[jira] [Created] (SPARK-48225) Upgrade `sbt` to 1.10.0

2024-05-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48225: - Summary: Upgrade `sbt` to 1.10.0 Key: SPARK-48225 URL: https://issues.apache.org/jira/browse/SPARK-48225 Project: Spark Issue Type: Improvement C

[jira] [Closed] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-48164. - > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - > get_resources_command`

[jira] [Updated] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48164: -- Parent: (was: SPARK-44111) Issue Type: Bug (was: Sub-task) > Re-enable `SparkConn

[jira] [Updated] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48164: -- Priority: Major (was: Blocker) > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands se

[jira] [Comment Edited] (SPARK-44810) XML: ArrayType and MapType support in from_xml

2024-05-09 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845125#comment-17845125 ] HiuFung Kwok edited comment on SPARK-44810 at 5/9/24 8:49 PM:

[jira] [Commented] (SPARK-44810) XML: ArrayType and MapType support in from_xml

2024-05-09 Thread HiuFung Kwok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845125#comment-17845125 ] HiuFung Kwok commented on SPARK-44810: -- [~sandip.agarwala] Should this be closed al

[jira] [Updated] (SPARK-48224) Disable variant from being a part of a map key

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48224: --- Labels: pull-request-available (was: ) > Disable variant from being a part of a map key > -

[jira] [Updated] (SPARK-47172) Upgrade Transport block cipher mode to GCM

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47172: --- Labels: pull-request-available (was: ) > Upgrade Transport block cipher mode to GCM > -

[jira] [Created] (SPARK-48224) Disable variant from being a part of a map key

2024-05-09 Thread Harsh Motwani (Jira)
Harsh Motwani created SPARK-48224: - Summary: Disable variant from being a part of a map key Key: SPARK-48224 URL: https://issues.apache.org/jira/browse/SPARK-48224 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-09 Thread Leo Timofeyev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844968#comment-17844968 ] Leo Timofeyev edited comment on SPARK-47008 at 5/9/24 7:12 PM: ---

[jira] [Updated] (SPARK-48223) PrometheusServlet does not work well with queryName in spark streaming metric names

2024-05-09 Thread Mason Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mason Chen updated SPARK-48223: --- Summary: PrometheusServlet does not work well with queryName in spark streaming metric names (was:

[jira] [Updated] (SPARK-48223) PrometheusServlet does not work well with queryName in the metric name

2024-05-09 Thread Mason Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mason Chen updated SPARK-48223: --- Description: PrometheusServlet does not work well with queryName in the metric name. For driver met

[jira] [Created] (SPARK-48223) PrometheusServlet does not work well with queryName in the metric name

2024-05-09 Thread Mason Chen (Jira)
Mason Chen created SPARK-48223: -- Summary: PrometheusServlet does not work well with queryName in the metric name Key: SPARK-48223 URL: https://issues.apache.org/jira/browse/SPARK-48223 Project: Spark

[jira] [Updated] (SPARK-47930) Upgrade RoaringBitmap to 1.0.6

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47930: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade RoaringBitmap t

[jira] [Updated] (SPARK-47982) Update code style' plugins to latest version

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47982: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Update code style' plug

[jira] [Comment Edited] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-09 Thread Leo Timofeyev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844968#comment-17844968 ] Leo Timofeyev edited comment on SPARK-47008 at 5/9/24 5:49 PM: ---

[jira] [Comment Edited] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-09 Thread Leo Timofeyev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844968#comment-17844968 ] Leo Timofeyev edited comment on SPARK-47008 at 5/9/24 5:46 PM: ---

[jira] [Updated] (SPARK-48222) Sync Ruby Bundler to 2.4.22 and refresh Gem lock file

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48222: --- Labels: pull-request-available (was: ) > Sync Ruby Bundler to 2.4.22 and refresh Gem lock f

[jira] [Updated] (SPARK-48222) Sync Ruby Bundler to 2.4.22 and refresh Gem lock file

2024-05-09 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-48222: - Component/s: Documentation > Sync Ruby Bundler to 2.4.22 and refresh Gem lock file > ---

[jira] [Created] (SPARK-48222) Sync Ruby Bundler to 2.4.22 and refresh Gem lock file

2024-05-09 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-48222: Summary: Sync Ruby Bundler to 2.4.22 and refresh Gem lock file Key: SPARK-48222 URL: https://issues.apache.org/jira/browse/SPARK-48222 Project: Spark

[jira] [Resolved] (SPARK-48216) Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48216. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46505 [https://

[jira] [Assigned] (SPARK-48216) Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48216: - Assignee: Kent Yao > Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to m

[jira] [Updated] (SPARK-48221) Alter string search logic for UTF8_BINARY_LCASE collation

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48221: --- Labels: pull-request-available (was: ) > Alter string search logic for UTF8_BINARY_LCASE co

[jira] [Created] (SPARK-48221) Alter string search logic for UTF8_BINARY_LCASE collation

2024-05-09 Thread Jira
Uroš Bojanić created SPARK-48221: Summary: Alter string search logic for UTF8_BINARY_LCASE collation Key: SPARK-48221 URL: https://issues.apache.org/jira/browse/SPARK-48221 Project: Spark Iss

[jira] [Updated] (SPARK-48176) Fix name of FIELD_ALREADY_EXISTS error condition

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48176: --- Labels: pull-request-available (was: ) > Fix name of FIELD_ALREADY_EXISTS error condition >

[jira] [Assigned] (SPARK-47409) StringTrim & StringTrimLeft/Right/Both (binary & lowercase collation only)

2024-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47409: --- Assignee: David Milicevic > StringTrim & StringTrimLeft/Right/Both (binary & lowercase coll

[jira] [Resolved] (SPARK-47409) StringTrim & StringTrimLeft/Right/Both (binary & lowercase collation only)

2024-05-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47409. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46206 [https://gith

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h2. ASF INFRA POLICY - [https://infra.apache.org/github-actions-policy.html] h2

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Priority: Major (was: Blocker) > Reduce GitHub Action usage according to ASF project allowanc

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Fix Version/s: (was: 4.0.0) > Reduce GitHub Action usage according to ASF project allowanc

[jira] [Updated] (SPARK-48187) Run `docs` only in PR builders and `build_non_ansi` Daily CI

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48187: -- Fix Version/s: 4.0.0 > Run `docs` only in PR builders and `build_non_ansi` Daily CI >

[jira] [Updated] (SPARK-48187) Run `docs` only in PR builders and `build_non_ansi` Daily CI

2024-05-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48187: -- Fix Version/s: (was: 4.0.0) > Run `docs` only in PR builders and `build_non_ansi` Daily CI

[jira] [Commented] (SPARK-34679) inferTimestamp option is missing from the list of options in DataFrameReader.json.

2024-05-09 Thread sadha chilukoori (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844995#comment-17844995 ] sadha chilukoori commented on SPARK-34679: -- [~gurwls223] , [~P7hB] I'm interest

[jira] [Updated] (SPARK-47465) Remove experimental tag from toArrow() PySpark DataFrame method

2024-05-09 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47465: - Fix Version/s: 4.0.0 > Remove experimental tag from toArrow() PySpark DataFrame method > ---

[jira] [Updated] (SPARK-48220) Allow passing PyArrow Table to createDataFrame()

2024-05-09 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-48220: - Description: SPARK-47365 added support for returning a Spark DataFrame as a PyArrow Table. It would be

[jira] [Updated] (SPARK-47466) Add PySpark DataFrame method to return iterator of PyArrow RecordBatches

2024-05-09 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-47466: - Description: As a follow-up to SPARK-47365: {{toArrow()}} is useful when the data is relatively small.

[jira] [Created] (SPARK-48220) Allow passing PyArrow Table to createDataFrame()

2024-05-09 Thread Ian Cook (Jira)
Ian Cook created SPARK-48220: Summary: Allow passing PyArrow Table to createDataFrame() Key: SPARK-48220 URL: https://issues.apache.org/jira/browse/SPARK-48220 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-48219) StreamReader Charset fix with UTF8

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48219: --- Labels: pull-request-available (was: ) > StreamReader Charset fix with UTF8 > -

[jira] [Created] (SPARK-48219) StreamReader Charset fix with UTF8

2024-05-09 Thread xy (Jira)
xy created SPARK-48219: -- Summary: StreamReader Charset fix with UTF8 Key: SPARK-48219 URL: https://issues.apache.org/jira/browse/SPARK-48219 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-09 Thread Leo Timofeyev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844968#comment-17844968 ] Leo Timofeyev commented on SPARK-47008: --- Hey [~ste...@apache.org]  What do you th

[jira] [Commented] (SPARK-47415) Levenshtein (all collations)

2024-05-09 Thread Nebojsa Savic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844962#comment-17844962 ] Nebojsa Savic commented on SPARK-47415: --- Taking over this work. > Levenshtein (al

[jira] [Updated] (SPARK-48218) TransportClientFactory.createClient may NPE cause FetchFailedException

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48218: --- Labels: pull-request-available (was: ) > TransportClientFactory.createClient may NPE cause

[jira] [Created] (SPARK-48218) TransportClientFactory.createClient may NPE cause FetchFailedException

2024-05-09 Thread dzcxzl (Jira)
dzcxzl created SPARK-48218: -- Summary: TransportClientFactory.createClient may NPE cause FetchFailedException Key: SPARK-48218 URL: https://issues.apache.org/jira/browse/SPARK-48218 Project: Spark I

[jira] [Updated] (SPARK-48217) Spark stdout and stderr getting removed at end of spark job triggered from cloudera hue workflow

2024-05-09 Thread Noam Shemesh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noam Shemesh updated SPARK-48217: - Description: Hello, we are running spark job triggered from cloudera hue workflow and spark pr

[jira] [Updated] (SPARK-48217) Spark stdout and stderr getting removed at end of spark job triggered from cloudera hue workflow

2024-05-09 Thread Noam Shemesh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noam Shemesh updated SPARK-48217: - Description: Hello, we are running spark job triggered from cloudera hue workflow and spark pr

[jira] [Updated] (SPARK-48217) Spark stdout and stderr getting removed at end of spark job triggered from cloudera hue workflow

2024-05-09 Thread Noam Shemesh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noam Shemesh updated SPARK-48217: - Attachment: workflow_running_logs_printed.png workflow_succeeded_logs_cleaned.png

[jira] [Updated] (SPARK-48216) Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable

2024-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48216: --- Labels: pull-request-available (was: ) > Remove overrides DockerJDBCIntegrationSuite.connec

[jira] [Created] (SPARK-48217) Spark stdout and stderr getting removed at end of spark job triggered from cloudera hue workflow

2024-05-09 Thread Noam Shemesh (Jira)
Noam Shemesh created SPARK-48217: Summary: Spark stdout and stderr getting removed at end of spark job triggered from cloudera hue workflow Key: SPARK-48217 URL: https://issues.apache.org/jira/browse/SPARK-48217

[jira] [Created] (SPARK-48216) Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable

2024-05-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-48216: Summary: Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable Key: SPARK-48216 URL: https://issues.apache.org/jira/browse/SPARK-48216

[jira] [Updated] (SPARK-48215) DateFormatClass (all collations)

2024-05-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48215: - Description: Enable collation support for the *DateFormatClass* built-in function in Spark. Fir

[jira] [Created] (SPARK-48215) DateFormatClass (all collations)

2024-05-09 Thread Jira
Uroš Bojanić created SPARK-48215: Summary: DateFormatClass (all collations) Key: SPARK-48215 URL: https://issues.apache.org/jira/browse/SPARK-48215 Project: Spark Issue Type: Sub-task

  1   2   >