[jira] [Resolved] (SPARK-38595) add support to load json file in case in-sensitive way

[ https://issues.apache.org/jira/browse/SPARK-38595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TANG ZHAO resolved SPARK-38595. --- Resolution: Duplicate duplicate to  > add support to load json file in case in-sensitive way >

[jira] [Commented] (SPARK-38601) AttributeError: module 'databricks.koalas' has no attribute 'DateOffset'

[ https://issues.apache.org/jira/browse/SPARK-38601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509142#comment-17509142 ] Hyukjin Kwon commented on SPARK-38601: -- [~prakharsandhu] does it work if you use {{pd.DateOffset}}?

[jira] [Updated] (SPARK-38596) add support to load json file in case in-sensitive way

[ https://issues.apache.org/jira/browse/SPARK-38596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38596: - Target Version/s: (was: 3.2.1) > add support to load json file in case in-sensitive way >

[jira] [Resolved] (SPARK-38596) add support to load json file in case in-sensitive way

[ https://issues.apache.org/jira/browse/SPARK-38596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38596. -- Resolution: Duplicate > add support to load json file in case in-sensitive way >

[jira] [Updated] (SPARK-38595) add support to load json file in case in-sensitive way

[ https://issues.apache.org/jira/browse/SPARK-38595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38595: - Target Version/s: (was: 3.2.1) > add support to load json file in case in-sensitive way >

[jira] [Resolved] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38568. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35877

[jira] [Assigned] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38568: Assignee: Yuming Wang > Upgrade ZSTD-JNI to 1.5.2-2 > --- > >

[jira] [Created] (SPARK-38603) Qualified star selection produces duplicated common columns after join then alias

Yves Li created SPARK-38603: --- Summary: Qualified star selection produces duplicated common columns after join then alias Key: SPARK-38603 URL: https://issues.apache.org/jira/browse/SPARK-38603 Project:

[jira] [Commented] (SPARK-38194) Make memory overhead factor configurable

[ https://issues.apache.org/jira/browse/SPARK-38194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509129#comment-17509129 ] Apache Spark commented on SPARK-38194: -- User 'Kimahriman' has created a pull request for this

[jira] [Created] (SPARK-38602) Upgrade Kafka to 3.1.1

Dongjoon Hyun created SPARK-38602: - Summary: Upgrade Kafka to 3.1.1 Key: SPARK-38602 URL: https://issues.apache.org/jira/browse/SPARK-38602 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38308) Select of a stream of window expressions fails

[ https://issues.apache.org/jira/browse/SPARK-38308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38308: -- Affects Version/s: 3.4.0 > Select of a stream of window expressions fails >

[jira] [Updated] (SPARK-38600) Include unit into the sql string of TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38600: - Issue Type: Bug (was: Improvement) > Include unit into the sql string of TIMESTAMPADD/DIFF >

[jira] [Resolved] (SPARK-38600) Include unit into the sql string of TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38600. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35911

[jira] [Updated] (SPARK-38600) Include unit into the sql string of TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38600: - Affects Version/s: 3.3.0 > Include unit into the sql string of TIMESTAMPADD/DIFF >

[jira] [Commented] (SPARK-38597) Enable resource limited spark k8s IT in GA

[ https://issues.apache.org/jira/browse/SPARK-38597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508823#comment-17508823 ] Apache Spark commented on SPARK-38597: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38597) Enable resource limited spark k8s IT in GA

[ https://issues.apache.org/jira/browse/SPARK-38597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38597: Assignee: Apache Spark > Enable resource limited spark k8s IT in GA >

[jira] [Assigned] (SPARK-38597) Enable resource limited spark k8s IT in GA

[ https://issues.apache.org/jira/browse/SPARK-38597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38597: Assignee: (was: Apache Spark) > Enable resource limited spark k8s IT in GA >

[jira] [Commented] (SPARK-38597) Enable resource limited spark k8s IT in GA

[ https://issues.apache.org/jira/browse/SPARK-38597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508824#comment-17508824 ] Apache Spark commented on SPARK-38597: -- User 'Yikun' has created a pull request for this issue:

[jira] [Created] (SPARK-38601) AttributeError: module 'databricks.koalas' has no attribute 'DateOffset'

Prakhar Sandhu created SPARK-38601: -- Summary: AttributeError: module 'databricks.koalas' has no attribute 'DateOffset' Key: SPARK-38601 URL: https://issues.apache.org/jira/browse/SPARK-38601

[jira] [Commented] (SPARK-38600) Include unit into the sql string of TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508744#comment-17508744 ] Apache Spark commented on SPARK-38600: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38600) Include unit into the sql string of TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38600: Assignee: Max Gekk (was: Apache Spark) > Include unit into the sql string of

[jira] [Assigned] (SPARK-38600) Include unit into the sql string of TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38600: Assignee: Apache Spark (was: Max Gekk) > Include unit into the sql string of

[jira] [Created] (SPARK-38600) Include unit into the sql string of TIMESTAMPADD/DIFF

Max Gekk created SPARK-38600: Summary: Include unit into the sql string of TIMESTAMPADD/DIFF Key: SPARK-38600 URL: https://issues.apache.org/jira/browse/SPARK-38600 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38599) support load json file in case-insensitive way

[ https://issues.apache.org/jira/browse/SPARK-38599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TANG ZHAO updated SPARK-38599: -- Affects Version/s: (was: 3.0.0) (was: 3.1.0)

[jira] [Commented] (SPARK-38599) support load json file in case-insensitive way

[ https://issues.apache.org/jira/browse/SPARK-38599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508719#comment-17508719 ] TANG ZHAO commented on SPARK-38599: --- I'd like to contribute to this issue. > support load json file

[jira] [Resolved] (SPARK-38598) add support to load json file in case in-sensitive way

[ https://issues.apache.org/jira/browse/SPARK-38598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TANG ZHAO resolved SPARK-38598. --- Resolution: Duplicate > add support to load json file in case in-sensitive way >

[jira] [Updated] (SPARK-38599) support load json file in case-insensitive way

[ https://issues.apache.org/jira/browse/SPARK-38599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TANG ZHAO updated SPARK-38599: -- Description: The task is to load json files into dataFrame.   Currently we use this method: //

[jira] [Updated] (SPARK-38599) support load json file in case-insensitive way

[ https://issues.apache.org/jira/browse/SPARK-38599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TANG ZHAO updated SPARK-38599: -- Description: The task is to load json files into hive table.   Currently we use this method: //

[jira] [Created] (SPARK-38599) support load json file in case-insensitive way

TANG ZHAO created SPARK-38599: - Summary: support load json file in case-insensitive way Key: SPARK-38599 URL: https://issues.apache.org/jira/browse/SPARK-38599 Project: Spark Issue Type: New

[jira] [Created] (SPARK-38598) add support to load json file in case in-sensitive way

TANG ZHAO created SPARK-38598: - Summary: add support to load json file in case in-sensitive way Key: SPARK-38598 URL: https://issues.apache.org/jira/browse/SPARK-38598 Project: Spark Issue Type:

[jira] [Created] (SPARK-38597) Enable resource limited spark k8s IT in GA

Yikun Jiang created SPARK-38597: --- Summary: Enable resource limited spark k8s IT in GA Key: SPARK-38597 URL: https://issues.apache.org/jira/browse/SPARK-38597 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38593) Incorporate numRowsDroppedByWatermark metric from SessionWindowStateStoreRestoreExec into StateOperatorProgress

[ https://issues.apache.org/jira/browse/SPARK-38593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38593: - Fix Version/s: 3.3.0 > Incorporate numRowsDroppedByWatermark metric from >

[jira] [Assigned] (SPARK-38593) Incorporate numRowsDroppedByWatermark metric from SessionWindowStateStoreRestoreExec into StateOperatorProgress

[ https://issues.apache.org/jira/browse/SPARK-38593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-38593: Assignee: Jungtaek Lim (was: Apache Spark) > Incorporate numRowsDroppedByWatermark

[jira] [Resolved] (SPARK-38593) Incorporate numRowsDroppedByWatermark metric from SessionWindowStateStoreRestoreExec into StateOperatorProgress

[ https://issues.apache.org/jira/browse/SPARK-38593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38593. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35909

[jira] [Created] (SPARK-38596) add support to load json file in case in-sensitive way

TANG ZHAO created SPARK-38596: - Summary: add support to load json file in case in-sensitive way Key: SPARK-38596 URL: https://issues.apache.org/jira/browse/SPARK-38596 Project: Spark Issue Type:

[jira] [Created] (SPARK-38595) add support to load json file in case in-sensitive way

TANG ZHAO created SPARK-38595: - Summary: add support to load json file in case in-sensitive way Key: SPARK-38595 URL: https://issues.apache.org/jira/browse/SPARK-38595 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38585) Simplify the code of TreeNode.clone()

[ https://issues.apache.org/jira/browse/SPARK-38585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38585: - Description: SPARK-28057 adds {{forceCopy}} to private {{mapChildren}} method in  {{TreeNode}} to

[jira] [Updated] (SPARK-38585) Simplify the code of TreeNode.clone()

[ https://issues.apache.org/jira/browse/SPARK-38585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38585: - Summary: Simplify the code of TreeNode.clone() (was: Remove the constant arg `forceCopy` for the

[jira] [Assigned] (SPARK-38594) Change to use `NettyUtils` to create `EventLoop` and `ChannelClass` in RBackend

[ https://issues.apache.org/jira/browse/SPARK-38594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38594: Assignee: (was: Apache Spark) > Change to use `NettyUtils` to create `EventLoop` and

[jira] [Commented] (SPARK-38594) Change to use `NettyUtils` to create `EventLoop` and `ChannelClass` in RBackend

[ https://issues.apache.org/jira/browse/SPARK-38594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17508642#comment-17508642 ] Apache Spark commented on SPARK-38594: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38594) Change to use `NettyUtils` to create `EventLoop` and `ChannelClass` in RBackend

[ https://issues.apache.org/jira/browse/SPARK-38594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38594: Assignee: Apache Spark > Change to use `NettyUtils` to create `EventLoop` and

[jira] [Created] (SPARK-38594) Change to use `NettyUtils` to create `EventLoop` and `ChannelClass` in RBackend

Yang Jie created SPARK-38594: Summary: Change to use `NettyUtils` to create `EventLoop` and `ChannelClass` in RBackend Key: SPARK-38594 URL: https://issues.apache.org/jira/browse/SPARK-38594 Project:

[jira] [Resolved] (SPARK-38583) to_timestamp should allow numeric types

[ https://issues.apache.org/jira/browse/SPARK-38583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38583. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35887

[jira] [Assigned] (SPARK-38583) to_timestamp should allow numeric types

[ https://issues.apache.org/jira/browse/SPARK-38583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38583: Assignee: Hyukjin Kwon > to_timestamp should allow numeric types >