[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440252#comment-17440252 ] Yang Jie commented on SPARK-37239: -- I think your description should be to avoid call `setReplication`

[jira] [Commented] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440244#comment-17440244 ] Yang Jie commented on SPARK-37239: -- Why `setReplication` is a unnecessary operation? > Avoid

[jira] [Commented] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440239#comment-17440239 ] Apache Spark commented on SPARK-37235: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37235: Assignee: Apache Spark > Inline type hints for distribution.py and __init__.py in >

[jira] [Assigned] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37235: Assignee: (was: Apache Spark) > Inline type hints for distribution.py and

[jira] [Created] (SPARK-37239) Avoid unnecessary `setReplication` in Yarn mode

2021-11-07 Thread wang-zhun (Jira)
wang-zhun created SPARK-37239: - Summary: Avoid unnecessary `setReplication` in Yarn mode Key: SPARK-37239 URL: https://issues.apache.org/jira/browse/SPARK-37239 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37158) Add doc about spark not supported hive built-in function

2021-11-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37158. Resolution: Won't Fix See the discussion.

[jira] [Resolved] (SPARK-37238) Upgrade ORC to 1.6.12

2021-11-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37238. Fix Version/s: 3.2.1 Assignee: Dongjoon Hyun Resolution: Fixed Issue

[jira] [Commented] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440196#comment-17440196 ] Apache Spark commented on SPARK-37234: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37234: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/stat/_statistics.py

[jira] [Assigned] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37234: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2021-11-07 Thread Jin Xing (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440194#comment-17440194 ] Jin Xing commented on SPARK-30602: -- Hi [~mshen]  Thanks a lot for the feature of Remote Shuffle

[jira] [Resolved] (SPARK-37211) More descriptions and adding an image to the failure message about enabling GitHub Actions

2021-11-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37211. Fix Version/s: 3.3.0 Assignee: Yuto Akutsu Resolution: Fixed Issue

[jira] [Resolved] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions

2021-11-07 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37231. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved in

[jira] [Resolved] (SPARK-37214) Fail query analysis earlier with invalid identifiers

2021-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37214. - Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-37238) Upgrade ORC to 1.6.12

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440180#comment-17440180 ] Apache Spark commented on SPARK-37238: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37238) Upgrade ORC to 1.6.12

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37238: Assignee: (was: Apache Spark) > Upgrade ORC to 1.6.12 > - > >

[jira] [Assigned] (SPARK-37238) Upgrade ORC to 1.6.12

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37238: Assignee: Apache Spark > Upgrade ORC to 1.6.12 > - > >

[jira] [Created] (SPARK-37238) Upgrade ORC to 1.6.12

2021-11-07 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37238: - Summary: Upgrade ORC to 1.6.12 Key: SPARK-37238 URL: https://issues.apache.org/jira/browse/SPARK-37238 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-37199) Add a deterministic field to QueryPlan

2021-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37199. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34470

[jira] [Assigned] (SPARK-37199) Add a deterministic field to QueryPlan

2021-11-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37199: --- Assignee: Abhishek Somani > Add a deterministic field to QueryPlan >

[jira] [Assigned] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37236: Assignee: Apache Spark > Inline type hints for KernelDensity.pyi, test.py in

[jira] [Assigned] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37236: Assignee: (was: Apache Spark) > Inline type hints for KernelDensity.pyi, test.py in

[jira] [Commented] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440168#comment-17440168 ] Apache Spark commented on SPARK-37236: -- User 'dchvn' has created a pull request for this issue:

[jira] [Commented] (SPARK-37237) Upgrade kubernetes-client to 5.9.0

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440167#comment-17440167 ] Apache Spark commented on SPARK-37237: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37237) Upgrade kubernetes-client to 5.9.0

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37237: Assignee: Apache Spark > Upgrade kubernetes-client to 5.9.0 >

[jira] [Assigned] (SPARK-37237) Upgrade kubernetes-client to 5.9.0

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37237: Assignee: (was: Apache Spark) > Upgrade kubernetes-client to 5.9.0 >

[jira] [Updated] (SPARK-37237) Upgrade kubernetes-client to 5.9.0

2021-11-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37237: -- Issue Type: Improvement (was: Test) > Upgrade kubernetes-client to 5.9.0 >

[jira] [Created] (SPARK-37237) Upgrade kubernetes-client to 5.9.0

2021-11-07 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37237: - Summary: Upgrade kubernetes-client to 5.9.0 Key: SPARK-37237 URL: https://issues.apache.org/jira/browse/SPARK-37237 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-35437) Use expressions to filter Hive partitions at client side

2021-11-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-35437: - Priority: Major (was: Minor) > Use expressions to filter Hive partitions at client side >

[jira] [Assigned] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34521: Assignee: (was: Apache Spark) > spark.createDataFrame does not support Pandas

[jira] [Commented] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440154#comment-17440154 ] Apache Spark commented on SPARK-34521: -- User 'nicolasazrak' has created a pull request for this

[jira] [Assigned] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34521: Assignee: Apache Spark > spark.createDataFrame does not support Pandas StringDtype

[jira] [Resolved] (SPARK-35437) Use expressions to filter Hive partitions at client side

2021-11-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-35437. -- Resolution: Fixed Issue resolved by pull request 34431 [https://github.com/apache/spark/pull/34431]

[jira] [Assigned] (SPARK-35437) Use expressions to filter Hive partitions at client side

2021-11-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-35437: Assignee: dzcxzl > Use expressions to filter Hive partitions at client side >

[jira] [Commented] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440143#comment-17440143 ] dch nguyen commented on SPARK-37236: working on this > Inline type hints for KernelDensity.pyi,

[jira] [Commented] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440142#comment-17440142 ] dch nguyen commented on SPARK-37235: working on this   > Inline type hints for distribution.py and

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37235: --- Summary: Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/ (was:

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37235: --- Summary: Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat (was:

[jira] [Updated] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37236: --- Summary: Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/ (was:

[jira] [Created] (SPARK-37236) Inline type hints for distribution.py, __init__.py in python/pyspark/mllib/stat/

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37236: -- Summary: Inline type hints for distribution.py, __init__.py in python/pyspark/mllib/stat/ Key: SPARK-37236 URL: https://issues.apache.org/jira/browse/SPARK-37236

[jira] [Created] (SPARK-37235) Inline type hints for python/pyspark/mllib/distribution.py and __init__.py

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37235: -- Summary: Inline type hints for python/pyspark/mllib/distribution.py and __init__.py Key: SPARK-37235 URL: https://issues.apache.org/jira/browse/SPARK-37235 Project:

[jira] [Updated] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-37234: --- Summary: Inline type hints for python/pyspark/mllib/stat/_statistics.py (was: Inline type hints

[jira] [Commented] (SPARK-37234) Inline type hints for python/pyspark/mllib/_statistics.py

2021-11-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440141#comment-17440141 ] dch nguyen commented on SPARK-37234: working on this. > Inline type hints for

[jira] [Created] (SPARK-37234) Inline type hints for python/pyspark/mllib/_statistics.py

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37234: -- Summary: Inline type hints for python/pyspark/mllib/_statistics.py Key: SPARK-37234 URL: https://issues.apache.org/jira/browse/SPARK-37234 Project: Spark Issue

[jira] [Created] (SPARK-37233) Inline type hints for files in python/pyspark/mllib

2021-11-07 Thread dch nguyen (Jira)
dch nguyen created SPARK-37233: -- Summary: Inline type hints for files in python/pyspark/mllib Key: SPARK-37233 URL: https://issues.apache.org/jira/browse/SPARK-37233 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37120) Add Java17 GitHub Action build and test job

2021-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37120. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34508

[jira] [Assigned] (SPARK-37120) Add Java17 GitHub Action build and test job

2021-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37120: Assignee: Dongjoon Hyun > Add Java17 GitHub Action build and test job >

[jira] [Resolved] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

2021-11-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-37221. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34499

[jira] [Assigned] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

2021-11-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-37221: --- Assignee: L. C. Hsieh > The collect-like API in SparkPlan should support columnar output >

[jira] [Updated] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-11-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36998: -- Fix Version/s: (was: 3.2.1) > Handle concurrent eviction of same application in SHS >

[jira] [Commented] (SPARK-37120) Add Java17 GitHub Action build and test job

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440128#comment-17440128 ] Apache Spark commented on SPARK-37120: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37120) Add Java17 GitHub Action build and test job

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37120: Assignee: Apache Spark > Add Java17 GitHub Action build and test job >

[jira] [Assigned] (SPARK-37120) Add Java17 GitHub Action build and test job

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37120: Assignee: (was: Apache Spark) > Add Java17 GitHub Action build and test job >

[jira] [Resolved] (SPARK-37232) Upgrade ORC to 1.7.1

2021-11-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37232. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34507

[jira] [Assigned] (SPARK-37232) Upgrade ORC to 1.7.1

2021-11-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37232: - Assignee: William Hyun > Upgrade ORC to 1.7.1 > > >

[jira] [Assigned] (SPARK-37232) Upgrade ORC to 1.7.1

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37232: Assignee: Apache Spark > Upgrade ORC to 1.7.1 > > >

[jira] [Assigned] (SPARK-37232) Upgrade ORC to 1.7.1

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37232: Assignee: (was: Apache Spark) > Upgrade ORC to 1.7.1 > > >

[jira] [Commented] (SPARK-37232) Upgrade ORC to 1.7.1

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440076#comment-17440076 ] Apache Spark commented on SPARK-37232: -- User 'williamhyun' has created a pull request for this

[jira] [Updated] (SPARK-37232) Upgrade ORC to 1.7.1

2021-11-07 Thread William Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Hyun updated SPARK-37232: - Issue Type: Bug (was: Test) > Upgrade ORC to 1.7.1 > > >

[jira] [Created] (SPARK-37232) Upgrade ORC to 1.7.1

2021-11-07 Thread William Hyun (Jira)
William Hyun created SPARK-37232: Summary: Upgrade ORC to 1.7.1 Key: SPARK-37232 URL: https://issues.apache.org/jira/browse/SPARK-37232 Project: Spark Issue Type: Test Components:

[jira] [Assigned] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37231: Assignee: Max Gekk (was: Apache Spark) > Dynamic writes/reads of ANSI interval

[jira] [Assigned] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37231: Assignee: Apache Spark (was: Max Gekk) > Dynamic writes/reads of ANSI interval

[jira] [Commented] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions

2021-11-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440070#comment-17440070 ] Apache Spark commented on SPARK-37231: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-37231) Dynamic writes/reads of ANSI interval partitions

2021-11-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-37231: Summary: Dynamic writes/reads of ANSI interval partitions Key: SPARK-37231 URL: https://issues.apache.org/jira/browse/SPARK-37231 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-11-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440066#comment-17440066 ] Chao Sun commented on SPARK-36998: -- Fixed > Handle concurrent eviction of same application in SHS >

[jira] [Assigned] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-11-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-36998: Assignee: Thejdeep Gudivada (was: Thejdeep) > Handle concurrent eviction of same application in

[jira] [Commented] (SPARK-36998) Handle concurrent eviction of same application in SHS

2021-11-07 Thread Thejdeep Gudivada (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440050#comment-17440050 ] Thejdeep Gudivada commented on SPARK-36998: --- [~dongjoon]  This seems to be assigned to another

[jira] [Commented] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440042#comment-17440042 ] Chao Sun commented on SPARK-37220: -- Thanks [~hyukjin.kwon]! > Do not split input file for Parquet

[jira] [Assigned] (SPARK-37207) Python API does not have isEmpty

2021-11-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37207: Assignee: Dhiren Navani > Python API does not have isEmpty >

[jira] [Resolved] (SPARK-37207) Python API does not have isEmpty

2021-11-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37207. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34484

[jira] [Assigned] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37223: Assignee: Cheng Su > Fix unit test check in JoinHintSuite >

[jira] [Resolved] (SPARK-37223) Fix unit test check in JoinHintSuite

2021-11-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37223. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34501

[jira] [Resolved] (SPARK-35933) PartitionFilters and pushFilters not applied to window functions

2021-11-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-35933. - Resolution: Not A Problem > PartitionFilters and pushFilters not applied to window functions >

[jira] [Comment Edited] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-07 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439944#comment-17439944 ] Zhen Wang edited comment on SPARK-37210 at 11/7/21, 10:28 AM: -- Yes

[jira] [Comment Edited] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-07 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439944#comment-17439944 ] Zhen Wang edited comment on SPARK-37210 at 11/7/21, 10:24 AM: -- Yes

[jira] [Resolved] (SPARK-36665) Add more Not operator optimizations

2021-11-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36665. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33930

[jira] [Assigned] (SPARK-36665) Add more Not operator optimizations

2021-11-07 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36665: --- Assignee: Kazuyuki Tanimura > Add more Not operator optimizations >

[jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions

2021-11-07 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439944#comment-17439944 ] Zhen Wang commented on SPARK-37210: --- Yes [~dongjoon] , this error will occur when two tasks

[jira] [Assigned] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37220: Assignee: Cheng Su > Do not split input file for Parquet reader with aggregate push down

[jira] [Commented] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439926#comment-17439926 ] Hyukjin Kwon commented on SPARK-37220: -- Fixed in https://github.com/apache/spark/pull/34498 > Do

[jira] [Commented] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

2021-11-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439924#comment-17439924 ] Hyukjin Kwon commented on SPARK-37220: -- [~csun], I gave you administrative permission. Should be