[
https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang.feng updated SPARK-45903:
---
Description:
Problem description:
I am using spark to generate HFile, OOM occurs in the
[
https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang.feng updated SPARK-45903:
---
Issue Type: Bug (was: Question)
> Different column orders lead to OOM
>
[
https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang.feng updated SPARK-45903:
---
Description:
Problem description:
I am using spark to generate HFile, OOM occurs in the
[
https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang.feng updated SPARK-45903:
---
Attachment: image-2023-11-13-15-47-01-764.png
> Different column orders lead to OOM
>
[
https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang.feng updated SPARK-45903:
---
Attachment: image-2023-11-13-15-46-16-868.png
> Different column orders lead to OOM
>
[
https://issues.apache.org/jira/browse/SPARK-45903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liang.feng updated SPARK-45903:
---
Description:
Problem description:
I am using spark to generate HFile, OOM occurs in the
liang.feng created SPARK-45903:
--
Summary: Different column orders lead to OOM
Key: SPARK-45903
URL: https://issues.apache.org/jira/browse/SPARK-45903
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-45902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45902:
---
Labels: pull-request-available (was: )
> Remove unused function `resolvePartitionColumns`
Yang Jie created SPARK-45902:
Summary: Remove unused function `resolvePartitionColumns` from
`DataSource`
Key: SPARK-45902
URL: https://issues.apache.org/jira/browse/SPARK-45902
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785370#comment-17785370
]
Yang Jie commented on SPARK-45522:
--
Yes, it's June 2024. According to the previous plan, Apache Spark
[
https://issues.apache.org/jira/browse/SPARK-45644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785362#comment-17785362
]
Adi Wehrli commented on SPARK-45644:
Thanks very much, [~bersprockets]. (y)
> After upgrading to
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785356#comment-17785356
]
Yiu-Chung Lee edited comment on SPARK-44512 at 11/13/23 3:34 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785356#comment-17785356
]
Yiu-Chung Lee commented on SPARK-44512:
---
[~dongjoon] As I mentioned before, I need to preserve the
[
https://issues.apache.org/jira/browse/SPARK-45896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-45896:
--
Fix Version/s: 3.4.2
> Expression encoding fails for Seq/Map of
[
https://issues.apache.org/jira/browse/SPARK-37287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-37287:
---
Labels: pull-request-available (was: )
> Pull out dynamic partition and bucket sort from
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44512.
---
Resolution: Not A Problem
> dataset.sort.select.write.partitionBy sorts wrong column
>
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44512:
--
Target Version/s: (was: 3.4.2)
> dataset.sort.select.write.partitionBy sorts wrong column
>
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44512:
--
Labels: (was: correctness)
> dataset.sort.select.write.partitionBy sorts wrong column
>
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-44512.
-
> dataset.sort.select.write.partitionBy sorts wrong column
>
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785352#comment-17785352
]
Dongjoon Hyun commented on SPARK-44512:
---
In general, I believe that the users report this as an
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785350#comment-17785350
]
Dongjoon Hyun commented on SPARK-44512:
---
I reproduced [~leeyc0]'s report like the following.
[
https://issues.apache.org/jira/browse/SPARK-45901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45901.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43774
[
https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45733.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43591
[
https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-45733:
Assignee: Alice Sayutina
> (Python) Support different retry policies for connect client
[
https://issues.apache.org/jira/browse/SPARK-43301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-43301:
---
Labels: pull-request-available (was: )
> BlockStoreClient getHostLocalDirs RPC supports
[
https://issues.apache.org/jira/browse/SPARK-43025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-43025:
---
Labels: pull-request-available (was: )
> Eliminate Union if filters have the same child
[
https://issues.apache.org/jira/browse/SPARK-44203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-44203:
---
Labels: pull-request-available (was: )
> The obtainDelegationTokens method of
[
https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45899.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43772
[
https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-45899:
Assignee: Yihong He
> Set errorClass in errorInfoToThrowable
>
[
https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Holland updated SPARK-45900:
---
Description:
I often work in projects that require deterministic randomness, especially
[
https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Holland updated SPARK-45900:
---
Description:
I often work in projects that require deterministic randomness, especially
[
https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Holland updated SPARK-45900:
---
Description:
I often work in projects that require deterministic randomness, especially
Nathan Holland created SPARK-45900:
--
Summary: Update hash functionalities from xxHash64 to XXH3
Key: SPARK-45900
URL: https://issues.apache.org/jira/browse/SPARK-45900
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-45900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nathan Holland updated SPARK-45900:
---
Summary: Expand hash functionalities from to include XXH3 (was: Update
hash
[
https://issues.apache.org/jira/browse/SPARK-45857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45857.
---
Resolution: Fixed
Issue resolved by pull request 43731
[
https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-45848:
-
Assignee: Yang Jie (was: Yuming Wang)
> spark-build-info.ps1 missing the docroot
[
https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45848.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43726
[
https://issues.apache.org/jira/browse/SPARK-45848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-45848:
-
Assignee: Yuming Wang
> spark-build-info.ps1 missing the docroot property
>
[
https://issues.apache.org/jira/browse/SPARK-45830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-45830:
-
Assignee: Yang Jie
> Refactor StorageUtils#bufferCleaner
>
[
https://issues.apache.org/jira/browse/SPARK-45830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45830.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43675
[
https://issues.apache.org/jira/browse/SPARK-45874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45874.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43747
[
https://issues.apache.org/jira/browse/SPARK-45874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-45874:
-
Assignee: Yang Jie
> Remove Java version check from `IsolatedClientLoader`
>
[
https://issues.apache.org/jira/browse/SPARK-45896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45896.
---
Fix Version/s: 4.0.0
3.5.1
Assignee: Bruce Robbins
[
https://issues.apache.org/jira/browse/SPARK-45770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45770.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43683
[
https://issues.apache.org/jira/browse/SPARK-45886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45886.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43758
[
https://issues.apache.org/jira/browse/SPARK-45875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45875.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43748
[
https://issues.apache.org/jira/browse/SPARK-45875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-45875:
-
Assignee: Yang Jie
> Remove `MissingStageTableRowData` from `core` module
>
[
https://issues.apache.org/jira/browse/SPARK-45870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45870.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43744
[
https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-45282:
-
Assignee: Emil Ejbyfeldt
> Join loses records for cached datasets
>
[
https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45282.
---
Fix Version/s: 3.4.2
Resolution: Fixed
Issue resolved by pull request 43729
[
https://issues.apache.org/jira/browse/SPARK-45899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45899:
---
Labels: pull-request-available (was: )
> Set errorClass in errorInfoToThrowable
>
Yihong He created SPARK-45899:
-
Summary: Set errorClass in errorInfoToThrowable
Key: SPARK-45899
URL: https://issues.apache.org/jira/browse/SPARK-45899
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45898:
---
Labels: pull-request-available (was: )
> Rewrite catalog table APIs to use unresolved
Yihong He created SPARK-45898:
-
Summary: Rewrite catalog table APIs to use unresolved logical plan
Key: SPARK-45898
URL: https://issues.apache.org/jira/browse/SPARK-45898
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-45190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785303#comment-17785303
]
Hannah Amundson commented on SPARK-45190:
-
I have started on this ticket
> XML: StructType
[
https://issues.apache.org/jira/browse/SPARK-45897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arnaud Nauwynck updated SPARK-45897:
Description:
updating springboot-dependencies 2.7 to 3.1 breaks spark with springboot
[
https://issues.apache.org/jira/browse/SPARK-45897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arnaud Nauwynck updated SPARK-45897:
Attachment: test-springboot-spark.zip
> java.lang.NoClassDefFoundError:
[
https://issues.apache.org/jira/browse/SPARK-45897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arnaud Nauwynck updated SPARK-45897:
Description:
updating springboot-dependencies 2.7 to 3.1 breaks spark with springboot
Arnaud Nauwynck created SPARK-45897:
---
Summary: java.lang.NoClassDefFoundError: javax/servlet/Servlet
incompatibilities upgrading springboot-dependencies 2.7 to 3.* (package javax.*
-> jakarta.*)
Key: SPARK-45897
[
https://issues.apache.org/jira/browse/SPARK-45896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45896:
---
Labels: pull-request-available (was: )
> Expression encoding fails for Seq/Map of
[
https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-44493:
---
Labels: pull-request-available (was: )
> Extract pushable predicates from disjunctive
[
https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785289#comment-17785289
]
HiuFung commented on SPARK-45522:
-
[~LuciferYang] Just to be sure, is that 2024 June?
If that is the
[
https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275
]
Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 11:28 AM:
--
The
[
https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275
]
Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:56 AM:
--
The
[
https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275
]
Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:56 AM:
--
The
[
https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275
]
Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:55 AM:
--
The
[
https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275
]
Marc Le Bihan commented on SPARK-45311:
---
The problem *java.util.NoSuchElementException: None.get*
[
https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785275#comment-17785275
]
Marc Le Bihan edited comment on SPARK-45311 at 11/12/23 10:55 AM:
--
The
68 matches
Mail list logo