[jira] [Updated] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47686: --- Labels: pull-request-available (was: ) > Use `=!=` instead of `!==` in `JoinHintSuite` >

[jira] [Created] (SPARK-47686) Use `=!=` instead of `!==` in `JoinHintSuite`

2024-04-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-47686: Summary: Use `=!=` instead of `!==` in `JoinHintSuite` Key: SPARK-47686 URL: https://issues.apache.org/jira/browse/SPARK-47686 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47685) Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47685: --- Labels: pull-request-available (was: ) > Should restore the handling of `Stream` in

[jira] [Updated] (SPARK-47685) Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-47685: - Summary: Should restore the handling of `Stream` in `RelationalGroupedDataset#toDF` (was: Restore the

[jira] [Created] (SPARK-47685) Restore the handling of `Stream` in `RelationalGroupedDataset#toDF`

2024-04-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-47685: Summary: Restore the handling of `Stream` in `RelationalGroupedDataset#toDF` Key: SPARK-47685 URL: https://issues.apache.org/jira/browse/SPARK-47685 Project: Spark

[jira] [Assigned] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47665: Assignee: Kent Yao > Using SMALLINT to Write ShortType to MYSQL >

[jira] [Resolved] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47665. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45789

[jira] [Resolved] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47679. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45804

[jira] [Resolved] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-04-01 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-47068. Resolution: Fixed Marking this issue as fixed. > Recover -1 and 0 case for

[jira] [Created] (SPARK-47683) Separate pure Python packaging

2024-04-01 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47683: Summary: Separate pure Python packaging Key: SPARK-47683 URL: https://issues.apache.org/jira/browse/SPARK-47683 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47682) Support cast from variant.

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47682: --- Labels: pull-request-available (was: ) > Support cast from variant. >

[jira] [Created] (SPARK-47682) Support cast from variant.

2024-04-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47682: -- Summary: Support cast from variant. Key: SPARK-47682 URL: https://issues.apache.org/jira/browse/SPARK-47682 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47681) Add variant_schema expression.

2024-04-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47681: -- Summary: Add variant_schema expression. Key: SPARK-47681 URL: https://issues.apache.org/jira/browse/SPARK-47681 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47551) Add variant_get expression.

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47551. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45708

[jira] [Updated] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47679: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Use

[jira] [Updated] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47679: --- Labels: pull-request-available (was: ) > Use `HiveConf.getConfVars` or Hive conf names

[jira] [Created] (SPARK-47679) Use `HiveConf.getConfVars` or Hive conf names directly

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47679: - Summary: Use `HiveConf.getConfVars` or Hive conf names directly Key: SPARK-47679 URL: https://issues.apache.org/jira/browse/SPARK-47679 Project: Spark

[jira] [Updated] (SPARK-47678) Got fetch failed exception when new executor reused same ip address from a previously killed executor

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47678: --- Labels: pull-request-available (was: ) > Got fetch failed exception when new executor

[jira] [Created] (SPARK-47678) Got fetch failed exception when new executor reused same ip address from a previously killed executor

2024-04-01 Thread BoYang (Jira)
BoYang created SPARK-47678: -- Summary: Got fetch failed exception when new executor reused same ip address from a previously killed executor Key: SPARK-47678 URL: https://issues.apache.org/jira/browse/SPARK-47678

[jira] [Updated] (SPARK-47677) Pandas circular import error in Python 3.10

2024-04-01 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-47677: - Description: {{AttributeError: partially initialized module 'pandas' has no attribute

[jira] [Created] (SPARK-47677) Pandas circular import error in Python 3.10

2024-04-01 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-47677: Summary: Pandas circular import error in Python 3.10 Key: SPARK-47677 URL: https://issues.apache.org/jira/browse/SPARK-47677 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47643) Add pyspark test for python streaming data source

2024-04-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47643. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45768

[jira] [Resolved] (SPARK-47676) Clean up the removed `VersionsSuite` references

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47676. --- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution:

[jira] [Assigned] (SPARK-47676) Clean up the removed `VersionsSuite` references

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47676: - Assignee: Dongjoon Hyun > Clean up the removed `VersionsSuite` references >

[jira] [Updated] (SPARK-47676) Clean up the removed `VersionsSuite` references

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47676: --- Labels: pull-request-available (was: ) > Clean up the removed `VersionsSuite` references >

[jira] [Created] (SPARK-47676) Clean up the removed `VersionsSuite` references

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47676: - Summary: Clean up the removed `VersionsSuite` references Key: SPARK-47676 URL: https://issues.apache.org/jira/browse/SPARK-47676 Project: Spark Issue

[jira] [Resolved] (SPARK-47675) Use AWS SDK v2 2.23.19 in K8s IT

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47675. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45799

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47556: --- Labels: pull-request-available (was: ) > [K8] Spark App ID collision resulting in deleting

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: SPARK-36014) > [K8] Spark App ID collision resulting in deleting

[jira] [Closed] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-47556. - > [K8] Spark App ID collision resulting in deleting wrong resources >

[jira] [Resolved] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47556. --- Fix Version/s: SPARK-36014 Resolution: Duplicate > [K8] Spark App ID collision

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47556: -- Fix Version/s: (was: 3.3.0) > [K8] Spark App ID collision resulting in deleting wrong

[jira] [Reopened] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-47556: --- > [K8] Spark App ID collision resulting in deleting wrong resources >

[jira] [Updated] (SPARK-47675) Use AWS SDK v2 2.23.19 in K8s IT

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47675: -- Summary: Use AWS SDK v2 2.23.19 in K8s IT (was: Remove `aws.java.sdk.v2.version` property in

[jira] [Updated] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47675: -- Component/s: Kubernetes Tests > Remove `aws.java.sdk.v2.version` property in

[jira] [Assigned] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47675: - Assignee: Dongjoon Hyun > Remove `aws.java.sdk.v2.version` property in pom.xml >

[jira] [Updated] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47675: --- Labels: pull-request-available (was: ) > Remove `aws.java.sdk.v2.version` property in

[jira] [Created] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47675: - Summary: Remove `aws.java.sdk.v2.version` property in pom.xml Key: SPARK-47675 URL: https://issues.apache.org/jira/browse/SPARK-47675 Project: Spark Issue

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-01 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832949#comment-17832949 ] Gideon P commented on SPARK-47413: -- [~uros-db] All that sounds good.

[jira] [Resolved] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47674. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45798

[jira] [Updated] (SPARK-47655) Integrate timer with Initial State handling for state-v2

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47655: --- Labels: pull-request-available (was: ) > Integrate timer with Initial State handling for

[jira] [Commented] (SPARK-39897) StackOverflowError in TaskMemoryManager

2024-04-01 Thread Vladimir Prus (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832924#comment-17832924 ] Vladimir Prus commented on SPARK-39897: --- Previously reported in  SPARK-28314 > StackOverflowError

[jira] [Commented] (SPARK-39897) StackOverflowError in TaskMemoryManager

2024-04-01 Thread Vladimir Prus (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832923#comment-17832923 ] Vladimir Prus commented on SPARK-39897: --- FWIW, we ran into this problem using Spark 3.5 on a

[jira] [Assigned] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

2024-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47674: - Assignee: Dongjoon Hyun > Enable `spark.metrics.appStatusSource.enabled` by default >

[jira] [Updated] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47674: --- Labels: pull-request-available (was: ) > Enable `spark.metrics.appStatusSource.enabled` by

[jira] [Created] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default

2024-04-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47674: - Summary: Enable `spark.metrics.appStatusSource.enabled` by default Key: SPARK-47674 URL: https://issues.apache.org/jira/browse/SPARK-47674 Project: Spark

[jira] [Created] (SPARK-47673) [Arbitrary State Support] State TTL support - ListState

2024-04-01 Thread Eric Marnadi (Jira)
Eric Marnadi created SPARK-47673: Summary: [Arbitrary State Support] State TTL support - ListState Key: SPARK-47673 URL: https://issues.apache.org/jira/browse/SPARK-47673 Project: Spark

[jira] [Created] (SPARK-47672) Avoid double evaluation of non-trivial projected elements from filter pushdown

2024-04-01 Thread Holden Karau (Jira)
Holden Karau created SPARK-47672: Summary: Avoid double evaluation of non-trivial projected elements from filter pushdown Key: SPARK-47672 URL: https://issues.apache.org/jira/browse/SPARK-47672

[jira] [Resolved] (SPARK-47659) Improve `*LoggingSuite*`

2024-04-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47659. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45784

[jira] [Updated] (SPARK-47659) Improve `*LoggingSuite*`

2024-04-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47659: --- Parent: SPARK-47240 Issue Type: Sub-task (was: Improvement) > Improve

[jira] [Created] (SPARK-47671) Enable structured logging in log4j2.properties.template and update `configuration.md`

2024-04-01 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47671: -- Summary: Enable structured logging in log4j2.properties.template and update `configuration.md` Key: SPARK-47671 URL: https://issues.apache.org/jira/browse/SPARK-47671

[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832897#comment-17832897 ] Gengliang Wang commented on SPARK-47240: [~panbingkun] sure, thank you in advance! > SPIP:

[jira] [Created] (SPARK-47670) Multiple calls to GET_JSON_OBJECT with the same JSON str should parse it just one time

2024-04-01 Thread Zheng Shao (Jira)
Zheng Shao created SPARK-47670: -- Summary: Multiple calls to GET_JSON_OBJECT with the same JSON str should parse it just one time Key: SPARK-47670 URL: https://issues.apache.org/jira/browse/SPARK-47670

[jira] [Resolved] (SPARK-46840) Collation benchmarking

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46840. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45453

[jira] [Assigned] (SPARK-46840) Collation benchmarking

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46840: --- Assignee: Gideon P > Collation benchmarking > -- > >

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832851#comment-17832851 ] Uroš Bojanić commented on SPARK-47413: -- [~gpgp] in terms of the timeline, I wouldn't impose any

[jira] [Updated] (SPARK-47669) Add `try_cast` function in DataFrame

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47669: --- Labels: pull-request-available (was: ) > Add `try_cast` function in DataFrame >

[jira] [Updated] (SPARK-47663) Add an end to end tests for checking if spark task works well with resources

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47663: --- Labels: pull-request-available (was: ) > Add an end to end tests for checking if spark

[jira] [Commented] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832809#comment-17832809 ] Kent Yao commented on SPARK-47666: -- resolved by https://github.com/apache/spark/pull/45790 > Fix NPE

[jira] [Resolved] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47666. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > Fix NPE when reading

[jira] [Created] (SPARK-47668) Add API to remove the existing ResourceProfile from ResourceProfileManager

2024-04-01 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-47668: -- Summary: Add API to remove the existing ResourceProfile from ResourceProfileManager Key: SPARK-47668 URL: https://issues.apache.org/jira/browse/SPARK-47668 Project:

[jira] [Comment Edited] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-04-01 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829408#comment-17829408 ] Milan Dankovic edited comment on SPARK-47477 at 4/1/24 10:11 AM: - I am

[jira] [Commented] (SPARK-47567) StringLocate

2024-04-01 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832805#comment-17832805 ] Milan Dankovic commented on SPARK-47567: I am working on this > StringLocate > > >

[jira] [Updated] (SPARK-47567) StringLocate

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47567: --- Labels: pull-request-available (was: ) > StringLocate > > >

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832803#comment-17832803 ] Uroš Bojanić commented on SPARK-47413: -- [~gpgp] For additional context, you can also take a look at

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832800#comment-17832800 ] Uroš Bojanić commented on SPARK-47413: -- Sorry for the late response [~gpgp], you got it - all

[jira] [Assigned] (SPARK-47664) Validate the column name with cached schema

2024-04-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47664: Assignee: Ruifeng Zheng > Validate the column name with cached schema >

[jira] [Resolved] (SPARK-47664) Validate the column name with cached schema

2024-04-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47664. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45788

[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832783#comment-17832783 ] BingKun Pan commented on SPARK-47240: - [~Gengliang.Wang] Can I participate in the subsequent log

[jira] [Created] (SPARK-47667) Specify certain stages for speculative execution

2024-04-01 Thread KnightChess (Jira)
KnightChess created SPARK-47667: --- Summary: Specify certain stages for speculative execution Key: SPARK-47667 URL: https://issues.apache.org/jira/browse/SPARK-47667 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47666: - Affects Version/s: 3.5.1 3.4.1 > Fix NPE when reading mysql bit array as

[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47666: --- Labels: pull-request-available (was: ) > Fix NPE when reading mysql bit array as LongType

[jira] [Created] (SPARK-47666) Fix NPE when reading mysql bit array as LongType

2024-04-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-47666: Summary: Fix NPE when reading mysql bit array as LongType Key: SPARK-47666 URL: https://issues.apache.org/jira/browse/SPARK-47666 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47569) Disallow comparing variant.

2024-04-01 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47569. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45726

[jira] [Updated] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Intern

2024-04-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45593: - Affects Version/s: 3.5.1 > Building a runnable distribution from master code running spark-sql raise >

[jira] [Updated] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Intern

2024-04-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45593: - Fix Version/s: 3.5.2 > Building a runnable distribution from master code running spark-sql raise >

[jira] [Updated] (SPARK-47660) Memory leak in StructType column's .dropFields method

2024-04-01 Thread Eylon Ronen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eylon Ronen updated SPARK-47660: Priority: Major (was: Minor) > Memory leak in StructType column's .dropFields method >

[jira] [Resolved] (SPARK-47654) Structured logging framework: support log concatenation

2024-04-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47654. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45779

[jira] [Updated] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)

2024-04-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47540: - Description: *Q1. What are you trying to do? Articulate your objectives using absolutely no

[jira] [Updated] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47665: --- Labels: pull-request-available (was: ) > Using SMALLINT to Write ShortType to MYSQL >

[jira] [Updated] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)

2024-04-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47540: - Description: *Q1. What are you trying to do? Articulate your objectives using absolutely no

[jira] [Created] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL

2024-04-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-47665: Summary: Using SMALLINT to Write ShortType to MYSQL Key: SPARK-47665 URL: https://issues.apache.org/jira/browse/SPARK-47665 Project: Spark Issue Type: Sub-task