[jira] [Created] (SPARK-42089) Different result in nested lambda function

2023-01-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42089: - Summary: Different result in nested lambda function Key: SPARK-42089 URL: https://issues.apache.org/jira/browse/SPARK-42089 Project: Spark Issue Type:

[jira] (SPARK-41471) SPJ: Reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning

2023-01-16 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41471 ] Mars deleted comment on SPARK-41471: -- was (Author: JIRAUSER290821): [~csun] Hi, I want to take it :) > SPJ: Reduce Spark shuffle when only one side of a join is > KeyGroupedPartitioning >

[jira] [Comment Edited] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

2023-01-16 Thread Xiaomin Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677162#comment-17677162 ] Xiaomin Zhang edited comment on SPARK-38230 at 1/16/23 10:54 AM: - Hello

[jira] [Resolved] (SPARK-41993) Move RowEncoder to AgnosticEncoders

2023-01-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41993. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39517

[jira] [Resolved] (SPARK-42087) Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars.

2023-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42087. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39601

[jira] [Assigned] (SPARK-42087) Use `--no-same-owner` when HiveExternalCatalogVersionsSuite untars.

2023-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42087: - Assignee: Dongjoon Hyun > Use `--no-same-owner` when HiveExternalCatalogVersionsSuite

[jira] [Resolved] (SPARK-36728) Can't create datetime object from anything other then year column Pyspark - koalas

2023-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36728. -- Resolution: Duplicate Thanks for letting me know > Can't create datetime object from

[jira] [Assigned] (SPARK-42032) Map data show in different order

2023-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42032: Assignee: Ruifeng Zheng > Map data show in different order >

[jira] [Resolved] (SPARK-42032) Map data show in different order

2023-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42032. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39600

[jira] [Resolved] (SPARK-41988) Fix map_filter and map_zip_with output order

2023-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41988. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39600

[jira] [Assigned] (SPARK-41988) Fix map_filter and map_zip_with output order

2023-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41988: Assignee: jiaan.geng > Fix map_filter and map_zip_with output order >

[jira] [Commented] (SPARK-35801) SPIP: Row-level operations in Data Source V2

2023-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677256#comment-17677256 ] Dongjoon Hyun commented on SPARK-35801: --- Hi, [~viirya]and [~aokolnychyi]. Are we going to open

[jira] [Commented] (SPARK-42032) Map data show in different order

2023-01-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677235#comment-17677235 ] jiaan.geng commented on SPARK-42032: After my investigation, the fact is the result of connect is

[jira] [Assigned] (SPARK-42088) Running python3 setup.py sdist on windows reports a permission error

2023-01-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42088: Assignee: Apache Spark > Running python3 setup.py sdist on windows reports a permission

[jira] [Commented] (SPARK-42088) Running python3 setup.py sdist on windows reports a permission error

2023-01-16 Thread zheju_he (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677214#comment-17677214 ] zheju_he commented on SPARK-42088: -- This is my pr address https://github.com/apache/spark/pull/39603 >

[jira] [Assigned] (SPARK-42086) Sort test cases in SQLQueryTestSuite

2023-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42086: - Assignee: Dongjoon Hyun > Sort test cases in SQLQueryTestSuite >

[jira] [Resolved] (SPARK-42086) Sort test cases in SQLQueryTestSuite

2023-01-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42086. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39599

[jira] [Assigned] (SPARK-42088) Running python3 setup.py sdist on windows reports a permission error

2023-01-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42088: Assignee: (was: Apache Spark) > Running python3 setup.py sdist on windows reports a

[jira] [Commented] (SPARK-42088) Running python3 setup.py sdist on windows reports a permission error

2023-01-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677216#comment-17677216 ] Apache Spark commented on SPARK-42088: -- User 'zekai-li' has created a pull request for this issue:

[jira] [Created] (SPARK-42088) Running python3 setup.py sdist on windows reports a permission error

2023-01-16 Thread zheju_he (Jira)
zheju_he created SPARK-42088: Summary: Running python3 setup.py sdist on windows reports a permission error Key: SPARK-42088 URL: https://issues.apache.org/jira/browse/SPARK-42088 Project: Spark

[jira] [Resolved] (SPARK-42085) Make `from_arrow_schema` support nested types

2023-01-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42085. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39594

[jira] [Assigned] (SPARK-42085) Make `from_arrow_schema` support nested types

2023-01-16 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42085: - Assignee: Ruifeng Zheng > Make `from_arrow_schema` support nested types >

<    1   2