Chao Sun created SPARK-36726:
Summary: Upgrade Parquet to 1.12.1
Key: SPARK-36726
URL: https://issues.apache.org/jira/browse/SPARK-36726
Project: Spark
Issue Type: Bug
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-36726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36726:
Assignee: Apache Spark
> Upgrade Parquet to 1.12.1
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-36726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413676#comment-17413676
]
Apache Spark commented on SPARK-36726:
--
User 'sunchao' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-36726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36726:
Assignee: (was: Apache Spark)
> Upgrade Parquet to 1.12.1
> -
[
https://issues.apache.org/jira/browse/SPARK-32285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413679#comment-17413679
]
pralabhkumar commented on SPARK-32285:
--
Thx , will share the PR in some time
> Add
Tongwei created SPARK-36727:
---
Summary: Support sql overwrite a path that is also being read from
when partitionOverwriteMode is dynamic
Key: SPARK-36727
URL: https://issues.apache.org/jira/browse/SPARK-36727
[
https://issues.apache.org/jira/browse/SPARK-33648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei closed SPARK-33648.
---
> Moving file stage failed cause dulpicated data
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei updated SPARK-36727:
Description:
{code:java}
// non-partitioned table overwrite
CREATE TABLE tbl (col1 INT, col2 STRING) USING
[
https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei updated SPARK-36727:
Description:
{code:java}
// non-partitioned table overwrite
CREATE TABLE tbl (col1 INT, col2 STRING) USING
[
https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei updated SPARK-36727:
Description:
{code:java}
// non-partitioned table overwrite
CREATE TABLE tbl (col1 INT, col2 STRING) USING
Bjørn Jørgensen created SPARK-36728:
---
Summary: Can't create datetime object from anything other then
year column Pyspark - koalas
Key: SPARK-36728
URL: https://issues.apache.org/jira/browse/SPARK-36728
[
https://issues.apache.org/jira/browse/SPARK-36728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørn Jørgensen updated SPARK-36728:
Attachment: pyspark_date.txt
> Can't create datetime object from anything other then year
Kousuke Saruta created SPARK-36729:
--
Summary: Upgrade Netty from 4.1.63 to 4.1.68
Key: SPARK-36729
URL: https://issues.apache.org/jira/browse/SPARK-36729
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-36729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413718#comment-17413718
]
Apache Spark commented on SPARK-36729:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-36729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36729:
Assignee: Apache Spark (was: Kousuke Saruta)
> Upgrade Netty from 4.1.63 to 4.1.68
> ---
[
https://issues.apache.org/jira/browse/SPARK-36729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413717#comment-17413717
]
Apache Spark commented on SPARK-36729:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-36729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36729:
Assignee: Kousuke Saruta (was: Apache Spark)
> Upgrade Netty from 4.1.63 to 4.1.68
> ---
[
https://issues.apache.org/jira/browse/SPARK-36728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413725#comment-17413725
]
dgd_contributor commented on SPARK-36728:
-
I think this is not a bug, same behav
[
https://issues.apache.org/jira/browse/SPARK-36636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-36636.
--
Fix Version/s: 3.0.4
3.1.3
3.2.0
Assignee: Yang
[
https://issues.apache.org/jira/browse/SPARK-36729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-36729:
---
Priority: Minor (was: Major)
> Upgrade Netty from 4.1.63 to 4.1.68
> --
[
https://issues.apache.org/jira/browse/SPARK-36720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413734#comment-17413734
]
Balaji Balasubramaniam commented on SPARK-36720:
Because even though I’m
[
https://issues.apache.org/jira/browse/SPARK-36729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-36729.
---
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 33970
[https://
[
https://issues.apache.org/jira/browse/SPARK-36726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-36726:
-
Priority: Blocker (was: Major)
> Upgrade Parquet to 1.12.1
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-36705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-36705:
--
Target Version/s: 3.2.0
> Disable push based shuffle when IO encryption is enabled or serializ
Huaxin Gao created SPARK-36730:
--
Summary: Use V2 Filter in V2 file source
Key: SPARK-36730
URL: https://issues.apache.org/jira/browse/SPARK-36730
Project: Spark
Issue Type: Sub-task
Co
Dongjoon Hyun created SPARK-36731:
-
Summary: BrotliCodec doesn't support Apple Silicon on MacOS
Key: SPARK-36731
URL: https://issues.apache.org/jira/browse/SPARK-36731
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-36731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413859#comment-17413859
]
Dongjoon Hyun commented on SPARK-36731:
---
Thanks to SPARK-36670, we identified this
[
https://issues.apache.org/jira/browse/SPARK-36670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh reassigned SPARK-36670:
---
Assignee: L. C. Hsieh (was: Apache Spark)
> Add end-to-end codec test cases for main datas
[
https://issues.apache.org/jira/browse/SPARK-36700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413865#comment-17413865
]
wuyi commented on SPARK-36700:
--
Reverted by [https://github.com/apache/spark/pull/33942] an
[
https://issues.apache.org/jira/browse/SPARK-36700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi resolved SPARK-36700.
--
Fix Version/s: 3.3.0
3.0.4
3.1.3
3.2.0
Assign
Dongjoon Hyun created SPARK-36732:
-
Summary: Upgrade ORC to 1.6.11
Key: SPARK-36732
URL: https://issues.apache.org/jira/browse/SPARK-36732
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-36732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36732:
Assignee: Apache Spark
> Upgrade ORC to 1.6.11
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-36732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413874#comment-17413874
]
Apache Spark commented on SPARK-36732:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-36732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36732:
Assignee: (was: Apache Spark)
> Upgrade ORC to 1.6.11
> -
>
>
Kohki Nishio created SPARK-36733:
Summary: Perf issue in SchemaPruning when a struct has million
fields
Key: SPARK-36733
URL: https://issues.apache.org/jira/browse/SPARK-36733
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-36733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413882#comment-17413882
]
Kohki Nishio commented on SPARK-36733:
--
[https://github.com/apache/spark/blob/maste
[
https://issues.apache.org/jira/browse/SPARK-36733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413882#comment-17413882
]
Kohki Nishio edited comment on SPARK-36733 at 9/13/21, 3:23 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-36733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kohki Nishio updated SPARK-36733:
-
Summary: Perf issue in SchemaPruning when a struct has many fields (was:
Perf issue in SchemaPr
Dongjoon Hyun created SPARK-36734:
-
Summary: Upgrade ORC to 1.5.13
Key: SPARK-36734
URL: https://issues.apache.org/jira/browse/SPARK-36734
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-34183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413895#comment-17413895
]
Anton Okolnychyi commented on SPARK-34183:
--
Sorry for the delay, [~hyukjin.kwon
[
https://issues.apache.org/jira/browse/SPARK-36734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36734:
Assignee: (was: Apache Spark)
> Upgrade ORC to 1.5.13
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-36734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36734:
Assignee: Apache Spark
> Upgrade ORC to 1.5.13
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-36734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36734:
Assignee: Apache Spark
> Upgrade ORC to 1.5.13
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-36734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413896#comment-17413896
]
Apache Spark commented on SPARK-36734:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-34183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413897#comment-17413897
]
Jungtaek Lim commented on SPARK-34183:
--
Sorry I totally missed this issue. My bad.
L. C. Hsieh created SPARK-36735:
---
Summary: Adjust overhead of cached relation for DPP
Key: SPARK-36735
URL: https://issues.apache.org/jira/browse/SPARK-36735
Project: Spark
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/SPARK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36716:
Assignee: Apache Spark
> Join estimation support LeftExistence join type
> --
[
https://issues.apache.org/jira/browse/SPARK-36735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413905#comment-17413905
]
Apache Spark commented on SPARK-36735:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-36730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413904#comment-17413904
]
Apache Spark commented on SPARK-36730:
--
User 'huaxingao' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413903#comment-17413903
]
Apache Spark commented on SPARK-36716:
--
User '007akuan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-36730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36730:
Assignee: (was: Apache Spark)
> Use V2 Filter in V2 file source
> ---
[
https://issues.apache.org/jira/browse/SPARK-36735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36735:
Assignee: (was: Apache Spark)
> Adjust overhead of cached relation for DPP
>
[
https://issues.apache.org/jira/browse/SPARK-36730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36730:
Assignee: Apache Spark
> Use V2 Filter in V2 file source
> --
[
https://issues.apache.org/jira/browse/SPARK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36716:
Assignee: (was: Apache Spark)
> Join estimation support LeftExistence join type
> ---
[
https://issues.apache.org/jira/browse/SPARK-36735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36735:
Assignee: Apache Spark
> Adjust overhead of cached relation for DPP
> ---
[
https://issues.apache.org/jira/browse/SPARK-36735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413906#comment-17413906
]
Apache Spark commented on SPARK-36735:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-36716:
Attachment: (was: image-2021-09-10-17-17-33-082.png)
> Join estimation support LeftExistence j
[
https://issues.apache.org/jira/browse/SPARK-36705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413929#comment-17413929
]
Apache Spark commented on SPARK-36705:
--
User 'rmcyang' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-36705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36705:
Assignee: (was: Apache Spark)
> Disable push based shuffle when IO encryption is enab
[
https://issues.apache.org/jira/browse/SPARK-36705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-36705:
Assignee: Apache Spark
> Disable push based shuffle when IO encryption is enabled or seri
60 matches
Mail list logo
