[
https://issues.apache.org/jira/browse/SPARK-46144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-46144.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44060
[https:
[
https://issues.apache.org/jira/browse/SPARK-46144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-46144:
--
Assignee: Gengliang Wang
> Fail INSERT INTO ... REPLACE statement if the condition co
[
https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46181.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44088
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-46181:
Assignee: Hyukjin Kwon
> Split scheduled Python build
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46178.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44087
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-46178:
Assignee: Hyukjin Kwon
> Move MockDF under PlanOnlyTestFixture
>
[
https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46177.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44086
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-46177:
Assignee: Hyukjin Kwon
> Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' wi
[
https://issues.apache.org/jira/browse/SPARK-46182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46182:
---
Labels: pull-request-available (was: )
> Shuffle data lost on decommissioned executor cause
[
https://issues.apache.org/jira/browse/SPARK-46032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791423#comment-17791423
]
Erik Ordentlich commented on SPARK-46032:
-
I'm seeing the same error when going
Xingbo Jiang created SPARK-46182:
Summary: Shuffle data lost on decommissioned executor caused by
race condition between lastTaskRunningTime and lastShuffleMigrationTime
Key: SPARK-46182
URL: https://issues.apache
[
https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-46151:
Assignee: BingKun Pan
> Hide the "More" drop-down button in the PySpark docs navigation b
[
https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46151.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44068
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46152.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44069
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-46152:
Assignee: Sandip Agarwala
> XML: Add DecimalType support in schema inference
> --
[
https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-46056:
Assignee: Cosmin Dumitru
> Vectorized parquet reader throws NPE when reading files with D
[
https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-45943:
Assignee: Zhen Wang
> DataSourceV2Relation.computeStats throws IllegalStateException in t
[
https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46056.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43960
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-45943:
-
Fix Version/s: 3.5.2
(was: 3.5.1)
> DataSourceV2Relation.computeStats thr
[
https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45943.
--
Fix Version/s: 3.5.1
4.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46181:
---
Labels: pull-request-available (was: )
> Split scheduled Python build
> ---
Hyukjin Kwon created SPARK-46181:
Summary: Split scheduled Python build
Key: SPARK-46181
URL: https://issues.apache.org/jira/browse/SPARK-46181
Project: Spark
Issue Type: Sub-task
C
[
https://issues.apache.org/jira/browse/SPARK-46176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vitalii Tymchyshyn updated SPARK-46176:
---
Description:
[https://github.com/apache/spark/blob/9987cab84bb05a61a5c0b43f94a733561
[
https://issues.apache.org/jira/browse/SPARK-46180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46180.
--
Resolution: Invalid
> Reduce the number of shuffle partitions in pandas-on-Spark test cases
>
Hyukjin Kwon created SPARK-46180:
Summary: Reduce the number of shuffle partitions in
pandas-on-Spark test cases
Key: SPARK-46180
URL: https://issues.apache.org/jira/browse/SPARK-46180
Project: Spark
Andy Lam created SPARK-46179:
Summary: Generate golden files for SQLQueryTestSuites with Postgres
Key: SPARK-46179
URL: https://issues.apache.org/jira/browse/SPARK-46179
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46178:
---
Labels: pull-request-available (was: )
> Move MockDF under PlanOnlyTestFixture
> --
[
https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-46178:
-
Issue Type: Test (was: Improvement)
> Move MockDF under PlanOnlyTestFixture
> -
Hyukjin Kwon created SPARK-46178:
Summary: Move MockDF under PlanOnlyTestFixture
Key: SPARK-46178
URL: https://issues.apache.org/jira/browse/SPARK-46178
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46177:
---
Labels: pull-request-available (was: )
> Skip 'CrossValidatorTests.test_crossvalidator_wit
Hyukjin Kwon created SPARK-46177:
Summary: Skip
'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12
Key: SPARK-46177
URL: https://issues.apache.org/jira/browse/SPARK-46177
Projec
[
https://issues.apache.org/jira/browse/SPARK-45940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45940:
---
Labels: pull-request-available (was: )
> Add InputPartition to DataSourceReader interface
>
[
https://issues.apache.org/jira/browse/SPARK-44864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-44864:
---
Labels: pull-request-available (was: )
> Align streaming statistics link format with other
[
https://issues.apache.org/jira/browse/SPARK-44793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-44793:
---
Labels: pull-request-available (was: )
> WholeStageCodeGen pipelineTime metric incorrect re
Vitalii Tymchyshyn created SPARK-46176:
--
Summary: Union of two kryo-encoded Dataset[Object] produces rows
of bytes
Key: SPARK-46176
URL: https://issues.apache.org/jira/browse/SPARK-46176
Project:
[
https://issues.apache.org/jira/browse/SPARK-46060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-46060:
-
Assignee: BingKun Pan
> Upgrade jdbc related test dependencies
> --
[
https://issues.apache.org/jira/browse/SPARK-46060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-46060.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43963
[https://
[
https://issues.apache.org/jira/browse/SPARK-46060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-46060:
--
Summary: Upgrade `MySQL/MariaDB/PostgreSQL/DB2` test dependencies (was:
Upgrade jdbc related
[
https://issues.apache.org/jira/browse/SPARK-46133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-46133:
-
Assignee: Binjie Yang
> Refine ShuffleWriteProcessor write methods comment
> --
[
https://issues.apache.org/jira/browse/SPARK-46133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-46133.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44054
[https://
[
https://issues.apache.org/jira/browse/SPARK-46169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-46169.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44073
[https://
[
https://issues.apache.org/jira/browse/SPARK-46169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-46169:
-
Assignee: Haejoon Lee
> Assign appropriate JIRA numbers to unlabeled TODO items for Dat
[
https://issues.apache.org/jira/browse/SPARK-46172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-46172.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44078
[https://
[
https://issues.apache.org/jira/browse/SPARK-46174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-46174.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44081
[https://
[
https://issues.apache.org/jira/browse/SPARK-46175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Avery updated SPARK-46175:
---
Description:
I'm using
from pyspark.ml.functions import predict_batch_udf
to construct a pandas u
Ryan Avery created SPARK-46175:
--
Summary: can't return prediction that has different length than ml
input
Key: SPARK-46175
URL: https://issues.apache.org/jira/browse/SPARK-46175
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-46124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-46124.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44041
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-45746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-45746.
---
Fix Version/s: 4.0.0
Assignee: Daniel
Resolution: Fixed
Issue resolved by pu
[
https://issues.apache.org/jira/browse/SPARK-38473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791247#comment-17791247
]
Hannah Amundson commented on SPARK-38473:
-
Hi [~maxgekk] [~bozhang]! This one i
[
https://issues.apache.org/jira/browse/SPARK-46174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46174:
---
Labels: pull-request-available (was: )
> Upgrade `gcs-connector` to 2.2.18
> --
[
https://issues.apache.org/jira/browse/SPARK-46155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-46155.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44071
[https://
[
https://issues.apache.org/jira/browse/SPARK-46141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-46141.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44058
[https://gith
Aleksandar Tomic created SPARK-46173:
Summary: Skipping trimAll call in stringToDate functions to avoid
needless string copy
Key: SPARK-46173
URL: https://issues.apache.org/jira/browse/SPARK-46173
[
https://issues.apache.org/jira/browse/SPARK-46143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791153#comment-17791153
]
Matheus Pavanetti edited comment on SPARK-46143 at 11/29/23 3:59 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-46143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791153#comment-17791153
]
Matheus Pavanetti commented on SPARK-46143:
---
Tested the same scenario on a spa
[
https://issues.apache.org/jira/browse/SPARK-46143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matheus Pavanetti updated SPARK-46143:
--
Environment:
pyspark 3.4.1.5.3 build 20230713.
Running on Microsoft Fabric workspace
[
https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-46036:
---
Assignee: Aleksandar Tomic
> raise_error should only take the error class parameter for int
[
https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791143#comment-17791143
]
Aleksandar Tomic commented on SPARK-46036:
--
This is done now.
> raise_error sh
[
https://issues.apache.org/jira/browse/SPARK-46172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46172:
---
Labels: pull-request-available (was: )
> Describe arguments of encode()
> -
[
https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-46036.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44004
[https://gith
Max Gekk created SPARK-46172:
Summary: Describe arguments of encode()
Key: SPARK-46172
URL: https://issues.apache.org/jira/browse/SPARK-46172
Project: Spark
Issue Type: Documentation
Co
[
https://issues.apache.org/jira/browse/SPARK-46171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-46171:
---
Labels: pull-request-available (was: )
> Remove `HiveContext` from Apache Spark 4.0
> -
[
https://issues.apache.org/jira/browse/SPARK-46171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-46171:
-
Component/s: PySpark
R
> Remove `HiveContext` from Apache Spark 4.0
> -
Yang Jie created SPARK-46171:
Summary: Remove `HiveContext` from Apache Spark 4.0
Key: SPARK-46171
URL: https://issues.apache.org/jira/browse/SPARK-46171
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-46036:
--
Assignee: Apache Spark
> raise_error should only take the error class parameter for i
[
https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-46036:
--
Assignee: (was: Apache Spark)
> raise_error should only take the error class para
[
https://issues.apache.org/jira/browse/SPARK-46052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-46052:
--
Assignee: Apache Spark
> Remove unnecessary TaskScheduler.killAllTaskAttempts
> -
67 matches
Mail list logo