[
https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-40265.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37739
[https://
[
https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-40265:
-
Assignee: Haejoon Lee
> Fix the inconsistent behavior for Index.intersection.
> ---
[
https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600218#comment-17600218
]
Apache Spark commented on SPARK-39830:
--
User 'cxzl25' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600217#comment-17600217
]
Apache Spark commented on SPARK-39830:
--
User 'cxzl25' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39830:
Assignee: (was: Apache Spark)
> Reading ORC table that requires type promotion may th
[
https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39830:
Assignee: Apache Spark
> Reading ORC table that requires type promotion may throw AIOOBE
[
https://issues.apache.org/jira/browse/SPARK-40305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40305:
Parent: SPARK-40327
Issue Type: Sub-task (was: Improvement)
> Implement Groupby.sem
> ---
[
https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600215#comment-17600215
]
Apache Spark commented on SPARK-40331:
--
User 'LuciferYang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40331:
Assignee: (was: Apache Spark)
> Java 11 should be used as the recommended running env
[
https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40331:
Assignee: Apache Spark
> Java 11 should be used as the recommended running environment
>
[
https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mars updated SPARK-40320:
-
Description:
*Reproduce step:*
set `spark.plugins=ErrorSparkPlugin`
`ErrorSparkPlugin` && `ErrorExecutorPlugin`
[
https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mars updated SPARK-40320:
-
Description:
*Reproduce step:*
set `spark.plugins=ErrorSparkPlugin`
`ErrorSparkPlugin` && `ErrorExecutorPlugin`
[
https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600203#comment-17600203
]
Ruifeng Zheng commented on SPARK-40327:
---
cc [~yikunkero] If you want to have a try
[
https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
todd reopened SPARK-40298:
--
> shuffle data recovery on the reused PVCs no effect
> ---
>
>
Haejoon Lee created SPARK-40349:
---
Summary: Implement `RollingGroupby.sem`.
Key: SPARK-40349
URL: https://issues.apache.org/jira/browse/SPARK-40349
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-40348:
---
Summary: Implement `RollingGroupby.quantile`.
Key: SPARK-40348
URL: https://issues.apache.org/jira/browse/SPARK-40348
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-40347:
---
Summary: Implement `RollingGroupby.median`.
Key: SPARK-40347
URL: https://issues.apache.org/jira/browse/SPARK-40347
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-40346:
---
Summary: Implement `ExpandingGroupby.sem`.
Key: SPARK-40346
URL: https://issues.apache.org/jira/browse/SPARK-40346
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-40345:
---
Summary: Implement `ExpandingGroupby.quantile`.
Key: SPARK-40345
URL: https://issues.apache.org/jira/browse/SPARK-40345
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-40344:
---
Summary: Implement `ExpandingGroupby.median`.
Key: SPARK-40344
URL: https://issues.apache.org/jira/browse/SPARK-40344
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-40331:
-
Description:
Similar cases described in SPARK-40303 will not have negative effects if Java
11+ is used
Haejoon Lee created SPARK-40343:
---
Summary: Implement `Rolling.sem`.
Key: SPARK-40343
URL: https://issues.apache.org/jira/browse/SPARK-40343
Project: Spark
Issue Type: Sub-task
Compone
Haejoon Lee created SPARK-40342:
---
Summary: Implement `Rolling.quantile`.
Key: SPARK-40342
URL: https://issues.apache.org/jira/browse/SPARK-40342
Project: Spark
Issue Type: Sub-task
Co
Haejoon Lee created SPARK-40340:
---
Summary: Implement `Expanding.sem`.
Key: SPARK-40340
URL: https://issues.apache.org/jira/browse/SPARK-40340
Project: Spark
Issue Type: Sub-task
Compo
Haejoon Lee created SPARK-40341:
---
Summary: Implement `Rolling.median`.
Key: SPARK-40341
URL: https://issues.apache.org/jira/browse/SPARK-40341
Project: Spark
Issue Type: Sub-task
Comp
[
https://issues.apache.org/jira/browse/SPARK-40338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40338:
Description:
We should implement `Expanding.median` for increasing pandas API coverage.
pandas do
Haejoon Lee created SPARK-40339:
---
Summary: Implement `Expanding.quantile`.
Key: SPARK-40339
URL: https://issues.apache.org/jira/browse/SPARK-40339
Project: Spark
Issue Type: Sub-task
Haejoon Lee created SPARK-40337:
---
Summary: Implement `SeriesGroupBy.describe`.
Key: SPARK-40337
URL: https://issues.apache.org/jira/browse/SPARK-40337
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40338:
Summary: Implement `Expanding.median`. (was: Imple)
> Implement `Expanding.median`.
> ---
Haejoon Lee created SPARK-40338:
---
Summary: Imple
Key: SPARK-40338
URL: https://issues.apache.org/jira/browse/SPARK-40338
Project: Spark
Issue Type: Sub-task
Components: Pandas API on
[
https://issues.apache.org/jira/browse/SPARK-40336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40336:
Summary: Implement `DataFrameGroupBy.cov`. (was: Implement
`DataFrame.cov`.)
> Implement `DataFr
Haejoon Lee created SPARK-40336:
---
Summary: Implement `DataFrame.cov`.
Key: SPARK-40336
URL: https://issues.apache.org/jira/browse/SPARK-40336
Project: Spark
Issue Type: Sub-task
Compo
[
https://issues.apache.org/jira/browse/SPARK-40292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600198#comment-17600198
]
Ivan Sadikov commented on SPARK-40292:
--
I will take a look.
> arrays_zip output un
Haejoon Lee created SPARK-40335:
---
Summary: Implement `DataFrameGroupBy.corr`.
Key: SPARK-40335
URL: https://issues.apache.org/jira/browse/SPARK-40335
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40286.
--
Target Version/s: (was: 3.2.1)
Resolution: Invalid
> Load Data from S3 deletes dat
Haejoon Lee created SPARK-40334:
---
Summary: Implement `GroupBy.prod`.
Key: SPARK-40334
URL: https://issues.apache.org/jira/browse/SPARK-40334
Project: Spark
Issue Type: Sub-task
Compon
Haejoon Lee created SPARK-40333:
---
Summary: Implement `GroupBy.nth`.
Key: SPARK-40333
URL: https://issues.apache.org/jira/browse/SPARK-40333
Project: Spark
Issue Type: Sub-task
Compone
[
https://issues.apache.org/jira/browse/SPARK-40333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40333:
Description:
We should implement `GroupBy.nth` for increasing pandas API coverage.
pandas docs:
[
https://issues.apache.org/jira/browse/SPARK-40287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reopened SPARK-40287:
--
> Load Data using Spark by a single partition moves entire dataset under same
> location in S3
>
[
https://issues.apache.org/jira/browse/SPARK-40287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40287.
--
Resolution: Invalid
> Load Data using Spark by a single partition moves entire dataset under s
[
https://issues.apache.org/jira/browse/SPARK-40287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40287.
--
Resolution: Not A Problem
> Load Data using Spark by a single partition moves entire dataset u
[
https://issues.apache.org/jira/browse/SPARK-40289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600197#comment-17600197
]
Hyukjin Kwon commented on SPARK-40289:
--
Hm, why don't you read it as a string and c
[
https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40332:
Description:
We should implement `GroupBy.quantile` for increasing pandas API coverage.
pandas do
Haejoon Lee created SPARK-40332:
---
Summary: Implement `GroupBy.quantile`.
Key: SPARK-40332
URL: https://issues.apache.org/jira/browse/SPARK-40332
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-40298:
-
Priority: Major (was: Blocker)
> shuffle data recovery on the reused PVCs no effect
>
[
https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40298.
--
Resolution: Invalid
> shuffle data recovery on the reused PVCs no effect
> --
[
https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600196#comment-17600196
]
Hyukjin Kwon commented on SPARK-40298:
--
[~todd5167] for questions, it's better to i
[
https://issues.apache.org/jira/browse/SPARK-40299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-40299.
--
Resolution: Cannot Reproduce
> java api calls the count() method to appear: java.lang.Arithmet
[
https://issues.apache.org/jira/browse/SPARK-40317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-40317:
-
Component/s: SQL
(was: Spark Core)
> Improvement to JDBC predicate for quer
Yang Jie created SPARK-40331:
Summary: Java 11 should be used as the recommended running
environment
Key: SPARK-40331
URL: https://issues.apache.org/jira/browse/SPARK-40331
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-40271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600193#comment-17600193
]
Apache Spark commented on SPARK-40271:
--
User 'HyukjinKwon' has created a pull reque
Haejoon Lee created SPARK-40330:
---
Summary: Implement `Series.searchsorted`.
Key: SPARK-40330
URL: https://issues.apache.org/jira/browse/SPARK-40330
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40327:
Component/s: Pandas API on Spark
(was: ps)
> Increase pandas API coverage for
[
https://issues.apache.org/jira/browse/SPARK-40328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40328:
Component/s: Pandas API on Spark
(was: ps)
> Implement `DataFrame.compare`.
>
Haejoon Lee created SPARK-40329:
---
Summary: Implement `Series.compare`.
Key: SPARK-40329
URL: https://issues.apache.org/jira/browse/SPARK-40329
Project: Spark
Issue Type: Sub-task
Comp
[
https://issues.apache.org/jira/browse/SPARK-40328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40328:
Description:
We should implement `DataFrame.compare` for increasing pandas API coverage.
pandas d
Haejoon Lee created SPARK-40328:
---
Summary: Implement `DataFrame.compare`.
Key: SPARK-40328
URL: https://issues.apache.org/jira/browse/SPARK-40328
Project: Spark
Issue Type: Sub-task
C
[
https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haejoon Lee updated SPARK-40327:
Description: Increasing the pandas API coverage for Apache Spark 3.4.0.
(was: Increasing the pand
Haejoon Lee created SPARK-40327:
---
Summary: Increase pandas API coverage for pandas API on Spark
Key: SPARK-40327
URL: https://issues.apache.org/jira/browse/SPARK-40327
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-40149:
-
Priority: Blocker (was: Major)
> Star expansion after outer join asymmetrically includes joinin
[
https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-40149:
-
Target Version/s: 3.4.0
> Star expansion after outer join asymmetrically includes joining key
>
[
https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-40149:
-
Target Version/s: (was: 3.4.0)
> Star expansion after outer join asymmetrically includes joini
[
https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-40149:
-
Priority: Major (was: Blocker)
> Star expansion after outer join asymmetrically includes joinin
[
https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600111#comment-17600111
]
Apache Spark commented on SPARK-40142:
--
User 'khalidmammadov' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600110#comment-17600110
]
Apache Spark commented on SPARK-40142:
--
User 'khalidmammadov' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40326:
Assignee: (was: Apache Spark)
> upgrade com.fasterxml.jackson.dataformat:jackson-data
[
https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40326:
Assignee: Apache Spark
> upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml
[
https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600084#comment-17600084
]
Apache Spark commented on SPARK-40326:
--
User 'bjornjorgensen' has created a pull re
Bjørn Jørgensen created SPARK-40326:
---
Summary: upgrade
com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4
Key: SPARK-40326
URL: https://issues.apache.org/jira/browse/SPARK-40326
[
https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40321:
Assignee: Yang Jie
> Upgrade rocksdbjni to 7.5.3
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40321.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37783
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-39996:
Assignee: Bjørn Jørgensen
> Upgrade postgresql to 42.5.0
>
>
[
https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-39996.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 37762
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-39996:
-
Component/s: Tests
> Upgrade postgresql to 42.5.0
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-39996:
-
Priority: Minor (was: Major)
> Upgrade postgresql to 42.5.0
>
>
>
Igor Suhorukov created SPARK-40325:
--
Summary: Support of Columnar result(ColumnarBatch) in
org.apache.spark.sql.Dataset flatMap, transform, etc
Key: SPARK-40325
URL: https://issues.apache.org/jira/browse/SPARK-40
[
https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40324:
Assignee: Apache Spark (was: Max Gekk)
> Provide a query context of ParseException
> ---
[
https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40324:
Assignee: Max Gekk (was: Apache Spark)
> Provide a query context of ParseException
> ---
[
https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600047#comment-17600047
]
Apache Spark commented on SPARK-40324:
--
User 'MaxGekk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600048#comment-17600048
]
Apache Spark commented on SPARK-40324:
--
User 'MaxGekk' has created a pull request f
Max Gekk created SPARK-40324:
Summary: Provide a query context of ParseException
Key: SPARK-40324
URL: https://issues.apache.org/jira/browse/SPARK-40324
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600035#comment-17600035
]
Apache Spark commented on SPARK-40251:
--
User 'panbingkun' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600032#comment-17600032
]
Apache Spark commented on SPARK-40288:
--
User 'hgs19921112' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600031#comment-17600031
]
Apache Spark commented on SPARK-40288:
--
User 'hgs19921112' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600029#comment-17600029
]
Apache Spark commented on SPARK-40288:
--
User 'hgs19921112' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600028#comment-17600028
]
Apache Spark commented on SPARK-40288:
--
User 'hgs19921112' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600021#comment-17600021
]
Augustine Theodore Prince commented on SPARK-39796:
---
Hi [~planga82] ,
87 matches
Mail list logo