[jira] [Resolved] (SPARK-47163) Fix `make-distribution.sh` to check `jackson-core-asl-1.9.13.jar` existence first

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47163. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45253

[jira] [Assigned] (SPARK-47163) Fix `make-distribution.sh` to check `jackson-core-asl-1.9.13.jar` existence first

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47163: - Assignee: Dongjoon Hyun > Fix `make-distribution.sh` to check

[jira] [Updated] (SPARK-47162) Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer classpaths

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47162: -- Description: This is resolved via SPARK-47152. > Exclude `CodeHaus Jackson` dependencies from

[jira] [Resolved] (SPARK-47160) Update K8s `Dockerfile` to include `hive-jackson` directory if exists

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47160. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45251

[jira] [Resolved] (SPARK-47161) Uses hash key properly for SparkR build on Windows

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47161. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45252

[jira] [Assigned] (SPARK-47161) Uses hash key properly for SparkR build on Windows

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47161: - Assignee: Hyukjin Kwon > Uses hash key properly for SparkR build on Windows >

[jira] [Updated] (SPARK-47163) Fix `make-distribution.sh` to check `jackson-core-asl-1.9.13.jar` existence first

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47163: -- Summary: Fix `make-distribution.sh` to check `jackson-core-asl-1.9.13.jar` existence first

[jira] [Updated] (SPARK-47163) Fix `make-distribution.sh` to check `jackson-*-asl-*.jar` existence first

2024-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47163: --- Labels: pull-request-available (was: ) > Fix `make-distribution.sh` to check

[jira] [Created] (SPARK-47163) Fix `make-distribution.sh` to check `jackson-*-asl-*.jar` existence first

2024-02-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47163: - Summary: Fix `make-distribution.sh` to check `jackson-*-asl-*.jar` existence first Key: SPARK-47163 URL: https://issues.apache.org/jira/browse/SPARK-47163 Project:

[jira] [Resolved] (SPARK-47162) Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer classpaths

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47162. --- Fix Version/s: 4.0.0 Resolution: Fixed > Exclude `CodeHaus Jackson` dependencies

[jira] [Updated] (SPARK-47161) Uses hash key properly for SparkR build on Windows

2024-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47161: --- Labels: pull-request-available (was: ) > Uses hash key properly for SparkR build on

[jira] [Updated] (SPARK-47162) Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer class paths

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47162: -- Summary: Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer class paths

[jira] [Created] (SPARK-47162) Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer

2024-02-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47162: - Summary: Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer Key: SPARK-47162 URL: https://issues.apache.org/jira/browse/SPARK-47162 Project:

[jira] [Updated] (SPARK-47162) Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer classpaths

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47162: -- Summary: Exclude `CodeHaus Jackson` dependencies from Master/Worker/HistoryServer classpaths

[jira] [Created] (SPARK-47161) Uses hash key properly for SparkR build on Windows

2024-02-25 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47161: Summary: Uses hash key properly for SparkR build on Windows Key: SPARK-47161 URL: https://issues.apache.org/jira/browse/SPARK-47161 Project: Spark Issue

[jira] [Updated] (SPARK-47160) Update K8s `Dockerfile` to include `hive-jackson` directory if exists

2024-02-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47160: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Update K8s

[jira] [Created] (SPARK-47160) Update K8s `Dockerfile` to include `hive-jackson` directory if exists

2024-02-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47160: - Summary: Update K8s `Dockerfile` to include `hive-jackson` directory if exists Key: SPARK-47160 URL: https://issues.apache.org/jira/browse/SPARK-47160 Project:

[jira] [Updated] (SPARK-47160) Update K8s `Dockerfile` to include `hive-jackson` directory if exists

2024-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47160: --- Labels: pull-request-available (was: ) > Update K8s `Dockerfile` to include `hive-jackson`

[jira] [Resolved] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47159. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45249

[jira] [Assigned] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47159: Assignee: Dongjoon Hyun > Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS`

[jira] [Updated] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

2024-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47159: --- Labels: pull-request-available (was: ) > Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in

[jira] [Created] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

2024-02-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47159: - Summary: Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job Key: SPARK-47159 URL: https://issues.apache.org/jira/browse/SPARK-47159

[jira] [Updated] (SPARK-47158) Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231

2024-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47158: --- Labels: pull-request-available (was: ) > Assign proper name and sqlState to

[jira] [Updated] (SPARK-47158) Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231

2024-02-25 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-47158: Summary: Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231 (was: Assign proper

[jira] [Created] (SPARK-47158) Assign proper name to top LEGACY errors

2024-02-25 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47158: --- Summary: Assign proper name to top LEGACY errors Key: SPARK-47158 URL: https://issues.apache.org/jira/browse/SPARK-47158 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47120) Null comparison push down data filter from subquery produces in NPE in Parquet filter

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47120. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45202

[jira] [Resolved] (SPARK-47157) Introduce abstraction that facilitates more flexible management of file listings within the system.

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47157. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45224

[jira] [Commented] (SPARK-41125) Simple call to createDataFrame fails with PicklingError but only on python3.11

2024-02-25 Thread Jamie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820502#comment-17820502 ] Jamie commented on SPARK-41125: --- I can confirm this now works on python 3.11 using the latest available

[jira] [Updated] (SPARK-47156) SparkSession returns a null context during a dataset creation

2024-02-25 Thread Marc Le Bihan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marc Le Bihan updated SPARK-47156: -- Description: I need first to know if I'm in front of a bug or not. If it's the case, I'll

[jira] [Created] (SPARK-47156) SparkSession returns a null context during a dataset creation

2024-02-25 Thread Marc Le Bihan (Jira)
Marc Le Bihan created SPARK-47156: - Summary: SparkSession returns a null context during a dataset creation Key: SPARK-47156 URL: https://issues.apache.org/jira/browse/SPARK-47156 Project: Spark