[jira] [Created] (SPARK-47612) Improve picking the side of partially clustered distribution accroding to partition size

2024-03-26 Thread Qi Zhu (Jira)
Qi Zhu created SPARK-47612: -- Summary: Improve picking the side of partially clustered distribution accroding to partition size Key: SPARK-47612 URL: https://issues.apache.org/jira/browse/SPARK-47612

[jira] [Updated] (SPARK-47611) Cleanup dead code in MySQLDialect.getCatalystType

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47611: --- Labels: pull-request-available (was: ) > Cleanup dead code in MySQLDialect.getCatalystType

[jira] [Created] (SPARK-47611) Cleanup dead code in MySQLDialect.getCatalystType

2024-03-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-47611: Summary: Cleanup dead code in MySQLDialect.getCatalystType Key: SPARK-47611 URL: https://issues.apache.org/jira/browse/SPARK-47611 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47610) Always set io.netty.tryReflectionSetAccessible=true

2024-03-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47610. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45733

[jira] [Assigned] (SPARK-47610) Always set io.netty.tryReflectionSetAccessible=true

2024-03-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47610: Assignee: Cheng Pan > Always set io.netty.tryReflectionSetAccessible=true >

[jira] [Resolved] (SPARK-42040) SPJ: Introduce a new API for V2 input partition to report partition size

2024-03-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-42040. -- Fix Version/s: 4.0.0 Resolution: Fixed > SPJ: Introduce a new API for V2 input partition to

[jira] [Assigned] (SPARK-42040) SPJ: Introduce a new API for V2 input partition to report partition size

2024-03-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-42040: Assignee: Qi Zhu (was: zhuqi) > SPJ: Introduce a new API for V2 input partition to report

[jira] [Assigned] (SPARK-42040) SPJ: Introduce a new API for V2 input partition to report partition size

2024-03-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-42040: Assignee: zhuqi > SPJ: Introduce a new API for V2 input partition to report partition size >

[jira] [Resolved] (SPARK-47562) Factor literal handling out of `plan.py`

2024-03-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47562. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45719

[jira] [Assigned] (SPARK-47562) Factor literal handling out of `plan.py`

2024-03-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-47562: - Assignee: Ruifeng Zheng > Factor literal handling out of `plan.py` >

[jira] [Assigned] (SPARK-47570) Integrate range scan encoder changes with timer implementation

2024-03-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47570: Assignee: Jing Zhan > Integrate range scan encoder changes with timer implementation >

[jira] [Resolved] (SPARK-47570) Integrate range scan encoder changes with timer implementation

2024-03-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47570. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45709

[jira] [Resolved] (SPARK-47273) Implement python stream writer interface

2024-03-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47273. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45305

[jira] [Assigned] (SPARK-47273) Implement python stream writer interface

2024-03-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47273: Assignee: Chaoqin Li > Implement python stream writer interface >

[jira] [Assigned] (SPARK-47498) Refine some fractional GPU resource calculation tests.

2024-03-26 Thread Wu Yi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wu Yi reassigned SPARK-47498: - Assignee: Bobby Wang > Refine some fractional GPU resource calculation tests. >

[jira] [Resolved] (SPARK-47498) Refine some fractional GPU resource calculation tests.

2024-03-26 Thread Wu Yi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wu Yi resolved SPARK-47498. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45631

[jira] [Updated] (SPARK-47610) Always set io.netty.tryReflectionSetAccessible=true

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47610: --- Labels: pull-request-available (was: ) > Always set

[jira] [Created] (SPARK-47610) Always set io.netty.tryReflectionSetAccessible=true

2024-03-26 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-47610: - Summary: Always set io.netty.tryReflectionSetAccessible=true Key: SPARK-47610 URL: https://issues.apache.org/jira/browse/SPARK-47610 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47609) CacheManager Lookup can miss picking InMemoryRelation corresponding to subplan

2024-03-26 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-47609: - Description: This issue became apparent while bringing my PR  [https://github.com/apache/spark/pull/43854] in

[jira] [Created] (SPARK-47609) CacheManager Lookup can miss picking InMemoryRelation corresponding to subplan

2024-03-26 Thread Asif (Jira)
Asif created SPARK-47609: Summary: CacheManager Lookup can miss picking InMemoryRelation corresponding to subplan Key: SPARK-47609 URL: https://issues.apache.org/jira/browse/SPARK-47609 Project: Spark

[jira] [Comment Edited] (SPARK-26708) Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan

2024-03-26 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831116#comment-17831116 ] Asif edited comment on SPARK-26708 at 3/27/24 12:58 AM: I believe the current

[jira] [Comment Edited] (SPARK-26708) Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan

2024-03-26 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831117#comment-17831117 ] Asif edited comment on SPARK-26708 at 3/27/24 12:54 AM: Towards that please take

[jira] [Commented] (SPARK-26708) Incorrect result caused by inconsistency between a SQL cache's cached RDD and its physical plan

2024-03-26 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831116#comment-17831116 ] Asif commented on SPARK-26708: -- I believe the current caching logic is suboptimal and accordingly the bug

[jira] [Updated] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47561: Fix Version/s: 3.5.2 > fix analyzer rule order issues about Alias >

[jira] [Updated] (SPARK-47558) [Arbitrary State Support] State TTL support - ValueState

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47558: --- Labels: pull-request-available (was: ) > [Arbitrary State Support] State TTL support -

[jira] [Created] (SPARK-47608) Improve user experience of loading logs as json data source

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47608: -- Summary: Improve user experience of loading logs as json data source Key: SPARK-47608 URL: https://issues.apache.org/jira/browse/SPARK-47608 Project: Spark

[jira] [Created] (SPARK-47607) Add documentation for Structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47607: -- Summary: Add documentation for Structured logging framework Key: SPARK-47607 URL: https://issues.apache.org/jira/browse/SPARK-47607 Project: Spark Issue

[jira] [Created] (SPARK-47606) Create log4j templates for both structured logging and plain text logging

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47606: -- Summary: Create log4j templates for both structured logging and plain text logging Key: SPARK-47606 URL: https://issues.apache.org/jira/browse/SPARK-47606

[jira] [Created] (SPARK-47605) Enable structured logging in all the test log4j2.properties

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47605: -- Summary: Enable structured logging in all the test log4j2.properties Key: SPARK-47605 URL: https://issues.apache.org/jira/browse/SPARK-47605 Project: Spark

[jira] [Created] (SPARK-47604) Resource managers: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47604: -- Summary: Resource managers: Migrate logInfo with variables to structured logging framework Key: SPARK-47604 URL: https://issues.apache.org/jira/browse/SPARK-47604

[jira] [Created] (SPARK-47600) MLLib: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47600: -- Summary: MLLib: Migrate logInfo with variables to structured logging framework Key: SPARK-47600 URL: https://issues.apache.org/jira/browse/SPARK-47600 Project:

[jira] [Created] (SPARK-47601) Graphx: Migrate logs with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47601: -- Summary: Graphx: Migrate logs with variables to structured logging framework Key: SPARK-47601 URL: https://issues.apache.org/jira/browse/SPARK-47601 Project:

[jira] [Created] (SPARK-47598) MLLib: Migrate logError with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47598: -- Summary: MLLib: Migrate logError with variables to structured logging framework Key: SPARK-47598 URL: https://issues.apache.org/jira/browse/SPARK-47598 Project:

[jira] [Created] (SPARK-47599) MLLib: Migrate logWarn with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47599: -- Summary: MLLib: Migrate logWarn with variables to structured logging framework Key: SPARK-47599 URL: https://issues.apache.org/jira/browse/SPARK-47599 Project:

[jira] [Created] (SPARK-47594) Connector module: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47594: -- Summary: Connector module: Migrate logInfo with variables to structured logging framework Key: SPARK-47594 URL: https://issues.apache.org/jira/browse/SPARK-47594

[jira] [Created] (SPARK-47592) Connector module: Migrate logError with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47592: -- Summary: Connector module: Migrate logError with variables to structured logging framework Key: SPARK-47592 URL: https://issues.apache.org/jira/browse/SPARK-47592

[jira] [Created] (SPARK-47593) Connector module: Migrate logWarn with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47593: -- Summary: Connector module: Migrate logWarn with variables to structured logging framework Key: SPARK-47593 URL: https://issues.apache.org/jira/browse/SPARK-47593

[jira] [Created] (SPARK-47590) Hive-thriftserver: Migrate logWarn with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47590: -- Summary: Hive-thriftserver: Migrate logWarn with variables to structured logging framework Key: SPARK-47590 URL: https://issues.apache.org/jira/browse/SPARK-47590

[jira] [Created] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47591: -- Summary: Hive-thriftserver: Migrate logInfo with variables to structured logging framework Key: SPARK-47591 URL: https://issues.apache.org/jira/browse/SPARK-47591

[jira] [Created] (SPARK-47588) Hive module: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47588: -- Summary: Hive module: Migrate logInfo with variables to structured logging framework Key: SPARK-47588 URL: https://issues.apache.org/jira/browse/SPARK-47588

[jira] [Created] (SPARK-47583) SQL core: Migrate logError with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47583: -- Summary: SQL core: Migrate logError with variables to structured logging framework Key: SPARK-47583 URL: https://issues.apache.org/jira/browse/SPARK-47583

[jira] [Created] (SPARK-47589) Hive-thriftserver: Migrate logError with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47589: -- Summary: Hive-thriftserver: Migrate logError with variables to structured logging framework Key: SPARK-47589 URL: https://issues.apache.org/jira/browse/SPARK-47589

[jira] [Created] (SPARK-47586) Hive module: Migrate logError with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47586: -- Summary: Hive module: Migrate logError with variables to structured logging framework Key: SPARK-47586 URL: https://issues.apache.org/jira/browse/SPARK-47586

[jira] [Created] (SPARK-47587) Hive module: Migrate logWarn with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47587: -- Summary: Hive module: Migrate logWarn with variables to structured logging framework Key: SPARK-47587 URL: https://issues.apache.org/jira/browse/SPARK-47587

[jira] [Created] (SPARK-47585) SQL core: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47585: -- Summary: SQL core: Migrate logInfo with variables to structured logging framework Key: SPARK-47585 URL: https://issues.apache.org/jira/browse/SPARK-47585

[jira] [Created] (SPARK-47584) SQL core: Migrate logWarn with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47584: -- Summary: SQL core: Migrate logWarn with variables to structured logging framework Key: SPARK-47584 URL: https://issues.apache.org/jira/browse/SPARK-47584

[jira] [Created] (SPARK-47582) SQL catalyst: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47582: -- Summary: SQL catalyst: Migrate logInfo with variables to structured logging framework Key: SPARK-47582 URL: https://issues.apache.org/jira/browse/SPARK-47582

[jira] [Created] (SPARK-47581) SQL catalyst: Migrate logWarn with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47581: -- Summary: SQL catalyst: Migrate logWarn with variables to structured logging framework Key: SPARK-47581 URL: https://issues.apache.org/jira/browse/SPARK-47581

[jira] [Created] (SPARK-47579) Spark core: Migrate logInfo with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47579: -- Summary: Spark core: Migrate logInfo with variables to structured logging framework Key: SPARK-47579 URL: https://issues.apache.org/jira/browse/SPARK-47579

[jira] [Created] (SPARK-47580) SQL catalyst: Migrate logError with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47580: -- Summary: SQL catalyst: Migrate logError with variables to structured logging framework Key: SPARK-47580 URL: https://issues.apache.org/jira/browse/SPARK-47580

[jira] [Created] (SPARK-47577) Spark core: Migrate logError with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47577: -- Summary: Spark core: Migrate logError with variables to structured logging framework Key: SPARK-47577 URL: https://issues.apache.org/jira/browse/SPARK-47577

[jira] [Created] (SPARK-47578) Spark core: Migrate logWarn with variables to structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47578: -- Summary: Spark core: Migrate logWarn with variables to structured logging framework Key: SPARK-47578 URL: https://issues.apache.org/jira/browse/SPARK-47578

[jira] [Created] (SPARK-47575) Implement logWarn API in structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47575: -- Summary: Implement logWarn API in structured logging framework Key: SPARK-47575 URL: https://issues.apache.org/jira/browse/SPARK-47575 Project: Spark

[jira] [Created] (SPARK-47576) Implement logInfo API in structured logging framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47576: -- Summary: Implement logInfo API in structured logging framework Key: SPARK-47576 URL: https://issues.apache.org/jira/browse/SPARK-47576 Project: Spark

[jira] [Updated] (SPARK-47556) [K8] Spark App ID collision resulting in deleting wrong resources

2024-03-26 Thread Sundeep K (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sundeep K updated SPARK-47556: -- Description: h3. Issue: We noticed that sometimes K8s executor pods go in a crash loop. Reason being

[jira] [Updated] (SPARK-47572) Enforce Window partitionSpec is orderable.

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47572: --- Labels: pull-request-available (was: ) > Enforce Window partitionSpec is orderable. >

[jira] [Updated] (SPARK-47574) Introduce Structured Logging Framework

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47574: --- Labels: pull-request-available (was: ) > Introduce Structured Logging Framework >

[jira] [Updated] (SPARK-47573) Support custom driver log URLs for Kubernetes

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47573: --- Labels: pull-request-available (was: ) > Support custom driver log URLs for Kubernetes >

[jira] [Updated] (SPARK-47574) Introduce Structured Logging Framework

2024-03-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-47574: --- Description: Introduce Structured Logging Framework as per

[jira] [Created] (SPARK-47574) Introduce Structured Logging Framework

2024-03-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-47574: -- Summary: Introduce Structured Logging Framework Key: SPARK-47574 URL: https://issues.apache.org/jira/browse/SPARK-47574 Project: Spark Issue Type:

[jira] [Created] (SPARK-47572) Enforce Window partitionSpec is orderable.

2024-03-26 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47572: -- Summary: Enforce Window partitionSpec is orderable. Key: SPARK-47572 URL: https://issues.apache.org/jira/browse/SPARK-47572 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-47571) date_format() java.lang.ArithmeticException: long overflow for large dates

2024-03-26 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-47571: Summary: date_format() java.lang.ArithmeticException: long overflow for large dates Key: SPARK-47571 URL: https://issues.apache.org/jira/browse/SPARK-47571 Project:

[jira] [Updated] (SPARK-47570) Integrate range scan encoder changes with timer implementation

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47570: --- Labels: pull-request-available (was: ) > Integrate range scan encoder changes with timer

[jira] [Created] (SPARK-47570) Integrate range scan encoder changes with timer implementation

2024-03-26 Thread Jing Zhan (Jira)
Jing Zhan created SPARK-47570: - Summary: Integrate range scan encoder changes with timer implementation Key: SPARK-47570 URL: https://issues.apache.org/jira/browse/SPARK-47570 Project: Spark

[jira] [Updated] (SPARK-47569) Disallow comparing variant.

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47569: --- Labels: pull-request-available (was: ) > Disallow comparing variant. >

[jira] [Created] (SPARK-47569) Disallow comparing variant.

2024-03-26 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47569: -- Summary: Disallow comparing variant. Key: SPARK-47569 URL: https://issues.apache.org/jira/browse/SPARK-47569 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47555) Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Summary: Show a warning message about SQLException if `JDBCTableCatalog.loadTable` fails

[jira] [Updated] (SPARK-47566) SubstringIndex

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47566: --- Labels: pull-request-available (was: ) > SubstringIndex > -- > >

[jira] [Assigned] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47555: - Assignee: xleoken > Record necessary raw exception log when loadTable >

[jira] [Updated] (SPARK-47568) Fix race condition between maintenance thread and task thead for RocksDB snapshot

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47568: --- Labels: pull-request-available (was: ) > Fix race condition between maintenance thread and

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Parent: SPARK-47361 Issue Type: Sub-task (was: Improvement) > Record necessary raw

[jira] [Resolved] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47555. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45711

[jira] [Created] (SPARK-47568) Fix race condition between maintenance thread and task thead for RocksDB snapshot

2024-03-26 Thread Bhuwan Sahni (Jira)
Bhuwan Sahni created SPARK-47568: Summary: Fix race condition between maintenance thread and task thead for RocksDB snapshot Key: SPARK-47568 URL: https://issues.apache.org/jira/browse/SPARK-47568

[jira] [Updated] (SPARK-47555) Record necessary raw exception log when loadTable

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47555: -- Affects Version/s: 4.0.0 (was: 3.5.1) > Record necessary raw

[jira] [Commented] (SPARK-47558) [Arbitrary State Support] State TTL support - ValueState

2024-03-26 Thread Bhuwan Sahni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830977#comment-17830977 ] Bhuwan Sahni commented on SPARK-47558: -- https://github.com/apache/spark/pull/45674 > [Arbitrary

[jira] [Assigned] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47561: - Assignee: Wenchen Fan > fix analyzer rule order issues about Alias >

[jira] [Resolved] (SPARK-47561) fix analyzer rule order issues about Alias

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47561. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45718

[jira] [Resolved] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47544. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45700

[jira] [Assigned] (SPARK-47544) [Pyspark] SparkSession builder method is incompatible with vs code intellisense

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47544: - Assignee: Niranjan Jayakar > [Pyspark] SparkSession builder method is incompatible

[jira] [Assigned] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47557: - Assignee: Kent Yao > Audit MySQL ENUM/SET Types > -- > >

[jira] [Resolved] (SPARK-47557) Audit MySQL ENUM/SET Types

2024-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47557. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45713

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

2024-03-26 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830952#comment-17830952 ] Gideon P commented on SPARK-47413: -- [~davidm-db] Awesome, thanks! Do you have any guidance BTW as to

[jira] [Comment Edited] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-03-26 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829408#comment-17829408 ] Milan Dankovic edited comment on SPARK-47477 at 3/26/24 1:54 PM: - I am

[jira] [Updated] (SPARK-47567) StringLocate

2024-03-26 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Dankovic updated SPARK-47567: --- Description: Enable collation support for the *StringLocate* built-in string function in

[jira] [Commented] (SPARK-47566) SubstringIndex

2024-03-26 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830938#comment-17830938 ] Milan Dankovic commented on SPARK-47566: I am working on this > SubstringIndex > --

[jira] [Created] (SPARK-47567) StringLocate

2024-03-26 Thread Milan Dankovic (Jira)
Milan Dankovic created SPARK-47567: -- Summary: StringLocate Key: SPARK-47567 URL: https://issues.apache.org/jira/browse/SPARK-47567 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-03-26 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Dankovic updated SPARK-47477: --- Description: Enable collation support for the *SubstringIndex* and *StringLocate* built-in

[jira] [Updated] (SPARK-28419) A patch for SparkThriftServer support multi-tenant authentication

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-28419: --- Labels: pull-request-available (was: ) > A patch for SparkThriftServer support

[jira] [Updated] (SPARK-47566) SubstringIndex

2024-03-26 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Dankovic updated SPARK-47566: --- Description: Enable collation support for the *SubstringIndex* built-in string function in

[jira] [Created] (SPARK-47566) SubstringIndex

2024-03-26 Thread Milan Dankovic (Jira)
Milan Dankovic created SPARK-47566: -- Summary: SubstringIndex Key: SPARK-47566 URL: https://issues.apache.org/jira/browse/SPARK-47566 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-03-26 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47477: -- Parent: (was: SPARK-46837) Issue Type: New Feature (was: Sub-task) >

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-03-26 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47477: -- Epic Link: SPARK-46830 > SubstringIndex, StringLocate (all collations) >

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-03-26 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47477: -- Labels: (was: pull-request-available) > SubstringIndex, StringLocate (all

[jira] [Updated] (SPARK-47477) SubstringIndex, StringLocate (all collations)

2024-03-26 Thread Milan Dankovic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milan Dankovic updated SPARK-47477: --- Labels: (was: pull-request-available) > SubstringIndex, StringLocate (all collations) >

[jira] [Resolved] (SPARK-47431) Add session level default Collation

2024-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47431. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45592

[jira] [Updated] (SPARK-47565) PySpark workers dying in daemon mode idle queue fail query

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47565: --- Labels: pull-request-available (was: ) > PySpark workers dying in daemon mode idle queue

[jira] [Commented] (SPARK-47565) PySpark workers dying in daemon mode idle queue fail query

2024-03-26 Thread Nikita Awasthi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830913#comment-17830913 ] Nikita Awasthi commented on SPARK-47565: User 'sebastianhillig-db' has created a pull request

[jira] [Created] (SPARK-47565) PySpark workers dying in daemon mode idle queue fail query

2024-03-26 Thread Sebastian Hillig (Jira)
Sebastian Hillig created SPARK-47565: Summary: PySpark workers dying in daemon mode idle queue fail query Key: SPARK-47565 URL: https://issues.apache.org/jira/browse/SPARK-47565 Project: Spark

[jira] [Updated] (SPARK-47564) always throw FAILED_READ_FILE error when fail to read files

2024-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47564: --- Labels: pull-request-available (was: ) > always throw FAILED_READ_FILE error when fail to

[jira] [Created] (SPARK-47564) always throw FAILED_READ_FILE error when fail to read files

2024-03-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47564: --- Summary: always throw FAILED_READ_FILE error when fail to read files Key: SPARK-47564 URL: https://issues.apache.org/jira/browse/SPARK-47564 Project: Spark

  1   2   >