[
https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440252#comment-17440252
]
Yang Jie commented on SPARK-37239:
--
I think your description should be to avoid call `setReplication`
[
https://issues.apache.org/jira/browse/SPARK-37239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440244#comment-17440244
]
Yang Jie commented on SPARK-37239:
--
Why `setReplication` is a unnecessary operation?
> Avoid
[
https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440239#comment-17440239
]
Apache Spark commented on SPARK-37235:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37235:
Assignee: Apache Spark
> Inline type hints for distribution.py and __init__.py in
>
[
https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37235:
Assignee: (was: Apache Spark)
> Inline type hints for distribution.py and
wang-zhun created SPARK-37239:
-
Summary: Avoid unnecessary `setReplication` in Yarn mode
Key: SPARK-37239
URL: https://issues.apache.org/jira/browse/SPARK-37239
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-37158.
Resolution: Won't Fix
See the discussion.
[
https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-37238.
Fix Version/s: 3.2.1
Assignee: Dongjoon Hyun
Resolution: Fixed
Issue
[
https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440196#comment-17440196
]
Apache Spark commented on SPARK-37234:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37234:
Assignee: Apache Spark
> Inline type hints for python/pyspark/mllib/stat/_statistics.py
[
https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37234:
Assignee: (was: Apache Spark)
> Inline type hints for
[
https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440194#comment-17440194
]
Jin Xing commented on SPARK-30602:
--
Hi [~mshen]
Thanks a lot for the feature of Remote Shuffle
[
https://issues.apache.org/jira/browse/SPARK-37211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-37211.
Fix Version/s: 3.3.0
Assignee: Yuto Akutsu
Resolution: Fixed
Issue
[
https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-37231.
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved in
[
https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37214.
-
Fix Version/s: 3.3.0
3.2.1
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440180#comment-17440180
]
Apache Spark commented on SPARK-37238:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37238:
Assignee: (was: Apache Spark)
> Upgrade ORC to 1.6.12
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-37238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37238:
Assignee: Apache Spark
> Upgrade ORC to 1.6.12
> -
>
>
Dongjoon Hyun created SPARK-37238:
-
Summary: Upgrade ORC to 1.6.12
Key: SPARK-37238
URL: https://issues.apache.org/jira/browse/SPARK-37238
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-37199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-37199.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34470
[
https://issues.apache.org/jira/browse/SPARK-37199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-37199:
---
Assignee: Abhishek Somani
> Add a deterministic field to QueryPlan
>
[
https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37236:
Assignee: Apache Spark
> Inline type hints for KernelDensity.pyi, test.py in
[
https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37236:
Assignee: (was: Apache Spark)
> Inline type hints for KernelDensity.pyi, test.py in
[
https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440168#comment-17440168
]
Apache Spark commented on SPARK-37236:
--
User 'dchvn' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440167#comment-17440167
]
Apache Spark commented on SPARK-37237:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37237:
Assignee: Apache Spark
> Upgrade kubernetes-client to 5.9.0
>
[
https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37237:
Assignee: (was: Apache Spark)
> Upgrade kubernetes-client to 5.9.0
>
[
https://issues.apache.org/jira/browse/SPARK-37237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-37237:
--
Issue Type: Improvement (was: Test)
> Upgrade kubernetes-client to 5.9.0
>
Dongjoon Hyun created SPARK-37237:
-
Summary: Upgrade kubernetes-client to 5.9.0
Key: SPARK-37237
URL: https://issues.apache.org/jira/browse/SPARK-37237
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-35437:
-
Priority: Major (was: Minor)
> Use expressions to filter Hive partitions at client side
>
[
https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34521:
Assignee: (was: Apache Spark)
> spark.createDataFrame does not support Pandas
[
https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440154#comment-17440154
]
Apache Spark commented on SPARK-34521:
--
User 'nicolasazrak' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34521:
Assignee: Apache Spark
> spark.createDataFrame does not support Pandas StringDtype
[
https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-35437.
--
Resolution: Fixed
Issue resolved by pull request 34431
[https://github.com/apache/spark/pull/34431]
[
https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-35437:
Assignee: dzcxzl
> Use expressions to filter Hive partitions at client side
>
[
https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440143#comment-17440143
]
dch nguyen commented on SPARK-37236:
working on this
> Inline type hints for KernelDensity.pyi,
[
https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440142#comment-17440142
]
dch nguyen commented on SPARK-37235:
working on this
> Inline type hints for distribution.py and
[
https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-37235:
---
Summary: Inline type hints for distribution.py and __init__.py in
python/pyspark/mllib/ (was:
[
https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-37235:
---
Summary: Inline type hints for distribution.py and __init__.py in
python/pyspark/mllib/stat (was:
[
https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-37236:
---
Summary: Inline type hints for KernelDensity.pyi, test.py in
python/pyspark/mllib/stat/ (was:
dch nguyen created SPARK-37236:
--
Summary: Inline type hints for distribution.py, __init__.py in
python/pyspark/mllib/stat/
Key: SPARK-37236
URL: https://issues.apache.org/jira/browse/SPARK-37236
dch nguyen created SPARK-37235:
--
Summary: Inline type hints for
python/pyspark/mllib/distribution.py and __init__.py
Key: SPARK-37235
URL: https://issues.apache.org/jira/browse/SPARK-37235
Project:
[
https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dch nguyen updated SPARK-37234:
---
Summary: Inline type hints for python/pyspark/mllib/stat/_statistics.py
(was: Inline type hints
[
https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440141#comment-17440141
]
dch nguyen commented on SPARK-37234:
working on this.
> Inline type hints for
dch nguyen created SPARK-37234:
--
Summary: Inline type hints for python/pyspark/mllib/_statistics.py
Key: SPARK-37234
URL: https://issues.apache.org/jira/browse/SPARK-37234
Project: Spark
Issue
dch nguyen created SPARK-37233:
--
Summary: Inline type hints for files in python/pyspark/mllib
Key: SPARK-37233
URL: https://issues.apache.org/jira/browse/SPARK-37233
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-37120.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34508
[
https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-37120:
Assignee: Dongjoon Hyun
> Add Java17 GitHub Action build and test job
>
[
https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh resolved SPARK-37221.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34499
[
https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh reassigned SPARK-37221:
---
Assignee: L. C. Hsieh
> The collect-like API in SparkPlan should support columnar output
>
[
https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-36998:
--
Fix Version/s: (was: 3.2.1)
> Handle concurrent eviction of same application in SHS
>
[
https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440128#comment-17440128
]
Apache Spark commented on SPARK-37120:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37120:
Assignee: Apache Spark
> Add Java17 GitHub Action build and test job
>
[
https://issues.apache.org/jira/browse/SPARK-37120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37120:
Assignee: (was: Apache Spark)
> Add Java17 GitHub Action build and test job
>
[
https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-37232.
---
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34507
[
https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-37232:
-
Assignee: William Hyun
> Upgrade ORC to 1.7.1
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37232:
Assignee: Apache Spark
> Upgrade ORC to 1.7.1
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37232:
Assignee: (was: Apache Spark)
> Upgrade ORC to 1.7.1
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440076#comment-17440076
]
Apache Spark commented on SPARK-37232:
--
User 'williamhyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-37232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Hyun updated SPARK-37232:
-
Issue Type: Bug (was: Test)
> Upgrade ORC to 1.7.1
>
>
>
William Hyun created SPARK-37232:
Summary: Upgrade ORC to 1.7.1
Key: SPARK-37232
URL: https://issues.apache.org/jira/browse/SPARK-37232
Project: Spark
Issue Type: Test
Components:
[
https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37231:
Assignee: Max Gekk (was: Apache Spark)
> Dynamic writes/reads of ANSI interval
[
https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37231:
Assignee: Apache Spark (was: Max Gekk)
> Dynamic writes/reads of ANSI interval
[
https://issues.apache.org/jira/browse/SPARK-37231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440070#comment-17440070
]
Apache Spark commented on SPARK-37231:
--
User 'MaxGekk' has created a pull request for this issue:
Max Gekk created SPARK-37231:
Summary: Dynamic writes/reads of ANSI interval partitions
Key: SPARK-37231
URL: https://issues.apache.org/jira/browse/SPARK-37231
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440066#comment-17440066
]
Chao Sun commented on SPARK-36998:
--
Fixed
> Handle concurrent eviction of same application in SHS
>
[
https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned SPARK-36998:
Assignee: Thejdeep Gudivada (was: Thejdeep)
> Handle concurrent eviction of same application in
[
https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440050#comment-17440050
]
Thejdeep Gudivada commented on SPARK-36998:
---
[~dongjoon] This seems to be assigned to another
[
https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440042#comment-17440042
]
Chao Sun commented on SPARK-37220:
--
Thanks [~hyukjin.kwon]!
> Do not split input file for Parquet
[
https://issues.apache.org/jira/browse/SPARK-37207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-37207:
Assignee: Dhiren Navani
> Python API does not have isEmpty
>
[
https://issues.apache.org/jira/browse/SPARK-37207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-37207.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34484
[
https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-37223:
Assignee: Cheng Su
> Fix unit test check in JoinHintSuite
>
[
https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-37223.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 34501
[
https://issues.apache.org/jira/browse/SPARK-35933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-35933.
-
Resolution: Not A Problem
> PartitionFilters and pushFilters not applied to window functions
>
[
https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439944#comment-17439944
]
Zhen Wang edited comment on SPARK-37210 at 11/7/21, 10:28 AM:
--
Yes
[
https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439944#comment-17439944
]
Zhen Wang edited comment on SPARK-37210 at 11/7/21, 10:24 AM:
--
Yes
[
https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh resolved SPARK-36665.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 33930
[
https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh reassigned SPARK-36665:
---
Assignee: Kazuyuki Tanimura
> Add more Not operator optimizations
>
[
https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439944#comment-17439944
]
Zhen Wang commented on SPARK-37210:
---
Yes [~dongjoon] , this error will occur when two tasks
[
https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-37220:
Assignee: Cheng Su
> Do not split input file for Parquet reader with aggregate push down
[
https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439926#comment-17439926
]
Hyukjin Kwon commented on SPARK-37220:
--
Fixed in https://github.com/apache/spark/pull/34498
> Do
[
https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17439924#comment-17439924
]
Hyukjin Kwon commented on SPARK-37220:
--
[~csun], I gave you administrative permission. Should be
82 matches
Mail list logo