[jira] [Resolved] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

2022-09-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40265. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37739 [https://

[jira] [Assigned] (SPARK-40265) Fix the inconsistent behavior for Index.intersection.

2022-09-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40265: - Assignee: Haejoon Lee > Fix the inconsistent behavior for Index.intersection. > ---

[jira] [Commented] (SPARK-39830) Reading ORC table that requires type promotion may throw AIOOBE

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600218#comment-17600218 ] Apache Spark commented on SPARK-39830: -- User 'cxzl25' has created a pull request fo

[jira] [Commented] (SPARK-39830) Reading ORC table that requires type promotion may throw AIOOBE

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600217#comment-17600217 ] Apache Spark commented on SPARK-39830: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-39830) Reading ORC table that requires type promotion may throw AIOOBE

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39830: Assignee: (was: Apache Spark) > Reading ORC table that requires type promotion may th

[jira] [Assigned] (SPARK-39830) Reading ORC table that requires type promotion may throw AIOOBE

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39830: Assignee: Apache Spark > Reading ORC table that requires type promotion may throw AIOOBE

[jira] [Updated] (SPARK-40305) Implement Groupby.sem

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40305: Parent: SPARK-40327 Issue Type: Sub-task (was: Improvement) > Implement Groupby.sem > ---

[jira] [Commented] (SPARK-40331) Java 11 should be used as the recommended running environment

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600215#comment-17600215 ] Apache Spark commented on SPARK-40331: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-40331) Java 11 should be used as the recommended running environment

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40331: Assignee: (was: Apache Spark) > Java 11 should be used as the recommended running env

[jira] [Assigned] (SPARK-40331) Java 11 should be used as the recommended running environment

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40331: Assignee: Apache Spark > Java 11 should be used as the recommended running environment >

[jira] [Updated] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-04 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40320: - Description: *Reproduce step:* set `spark.plugins=ErrorSparkPlugin` `ErrorSparkPlugin` && `ErrorExecutorPlugin`

[jira] [Updated] (SPARK-40320) When the Executor plugin fails to initialize, the Executor shows active but does not accept tasks forever, just like being hung

2022-09-04 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40320: - Description: *Reproduce step:* set `spark.plugins=ErrorSparkPlugin` `ErrorSparkPlugin` && `ErrorExecutorPlugin`

[jira] [Commented] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2022-09-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600203#comment-17600203 ] Ruifeng Zheng commented on SPARK-40327: --- cc [~yikunkero] If you want to have a try

[jira] [Reopened] (SPARK-40298) shuffle data recovery on the reused PVCs no effect

2022-09-04 Thread todd (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] todd reopened SPARK-40298: -- > shuffle data recovery on the reused PVCs no effect > --- > >

[jira] [Created] (SPARK-40349) Implement `RollingGroupby.sem`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40349: --- Summary: Implement `RollingGroupby.sem`. Key: SPARK-40349 URL: https://issues.apache.org/jira/browse/SPARK-40349 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40348) Implement `RollingGroupby.quantile`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40348: --- Summary: Implement `RollingGroupby.quantile`. Key: SPARK-40348 URL: https://issues.apache.org/jira/browse/SPARK-40348 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40347) Implement `RollingGroupby.median`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40347: --- Summary: Implement `RollingGroupby.median`. Key: SPARK-40347 URL: https://issues.apache.org/jira/browse/SPARK-40347 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40346) Implement `ExpandingGroupby.sem`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40346: --- Summary: Implement `ExpandingGroupby.sem`. Key: SPARK-40346 URL: https://issues.apache.org/jira/browse/SPARK-40346 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40345) Implement `ExpandingGroupby.quantile`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40345: --- Summary: Implement `ExpandingGroupby.quantile`. Key: SPARK-40345 URL: https://issues.apache.org/jira/browse/SPARK-40345 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40344) Implement `ExpandingGroupby.median`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40344: --- Summary: Implement `ExpandingGroupby.median`. Key: SPARK-40344 URL: https://issues.apache.org/jira/browse/SPARK-40344 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40331) Java 11 should be used as the recommended running environment

2022-09-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40331: - Description: Similar cases described in SPARK-40303  will not have negative effects if Java 11+ is used

[jira] [Created] (SPARK-40343) Implement `Rolling.sem`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40343: --- Summary: Implement `Rolling.sem`. Key: SPARK-40343 URL: https://issues.apache.org/jira/browse/SPARK-40343 Project: Spark Issue Type: Sub-task Compone

[jira] [Created] (SPARK-40342) Implement `Rolling.quantile`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40342: --- Summary: Implement `Rolling.quantile`. Key: SPARK-40342 URL: https://issues.apache.org/jira/browse/SPARK-40342 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-40340) Implement `Expanding.sem`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40340: --- Summary: Implement `Expanding.sem`. Key: SPARK-40340 URL: https://issues.apache.org/jira/browse/SPARK-40340 Project: Spark Issue Type: Sub-task Compo

[jira] [Created] (SPARK-40341) Implement `Rolling.median`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40341: --- Summary: Implement `Rolling.median`. Key: SPARK-40341 URL: https://issues.apache.org/jira/browse/SPARK-40341 Project: Spark Issue Type: Sub-task Comp

[jira] [Updated] (SPARK-40338) Implement `Expanding.median`.

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40338: Description: We should implement `Expanding.median` for increasing pandas API coverage. pandas do

[jira] [Created] (SPARK-40339) Implement `Expanding.quantile`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40339: --- Summary: Implement `Expanding.quantile`. Key: SPARK-40339 URL: https://issues.apache.org/jira/browse/SPARK-40339 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40337) Implement `SeriesGroupBy.describe`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40337: --- Summary: Implement `SeriesGroupBy.describe`. Key: SPARK-40337 URL: https://issues.apache.org/jira/browse/SPARK-40337 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40338) Implement `Expanding.median`.

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40338: Summary: Implement `Expanding.median`. (was: Imple) > Implement `Expanding.median`. > ---

[jira] [Created] (SPARK-40338) Imple

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40338: --- Summary: Imple Key: SPARK-40338 URL: https://issues.apache.org/jira/browse/SPARK-40338 Project: Spark Issue Type: Sub-task Components: Pandas API on

[jira] [Updated] (SPARK-40336) Implement `DataFrameGroupBy.cov`.

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40336: Summary: Implement `DataFrameGroupBy.cov`. (was: Implement `DataFrame.cov`.) > Implement `DataFr

[jira] [Created] (SPARK-40336) Implement `DataFrame.cov`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40336: --- Summary: Implement `DataFrame.cov`. Key: SPARK-40336 URL: https://issues.apache.org/jira/browse/SPARK-40336 Project: Spark Issue Type: Sub-task Compo

[jira] [Commented] (SPARK-40292) arrays_zip output unexpected alias column names

2022-09-04 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600198#comment-17600198 ] Ivan Sadikov commented on SPARK-40292: -- I will take a look. > arrays_zip output un

[jira] [Created] (SPARK-40335) Implement `DataFrameGroupBy.corr`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40335: --- Summary: Implement `DataFrameGroupBy.corr`. Key: SPARK-40335 URL: https://issues.apache.org/jira/browse/SPARK-40335 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-40286) Load Data from S3 deletes data source file

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40286. -- Target Version/s: (was: 3.2.1) Resolution: Invalid > Load Data from S3 deletes dat

[jira] [Created] (SPARK-40334) Implement `GroupBy.prod`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40334: --- Summary: Implement `GroupBy.prod`. Key: SPARK-40334 URL: https://issues.apache.org/jira/browse/SPARK-40334 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-40333) Implement `GroupBy.nth`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40333: --- Summary: Implement `GroupBy.nth`. Key: SPARK-40333 URL: https://issues.apache.org/jira/browse/SPARK-40333 Project: Spark Issue Type: Sub-task Compone

[jira] [Updated] (SPARK-40333) Implement `GroupBy.nth`.

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40333: Description: We should implement `GroupBy.nth` for increasing pandas API coverage. pandas docs:

[jira] [Reopened] (SPARK-40287) Load Data using Spark by a single partition moves entire dataset under same location in S3

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-40287: -- > Load Data using Spark by a single partition moves entire dataset under same > location in S3 >

[jira] [Resolved] (SPARK-40287) Load Data using Spark by a single partition moves entire dataset under same location in S3

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40287. -- Resolution: Invalid > Load Data using Spark by a single partition moves entire dataset under s

[jira] [Resolved] (SPARK-40287) Load Data using Spark by a single partition moves entire dataset under same location in S3

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40287. -- Resolution: Not A Problem > Load Data using Spark by a single partition moves entire dataset u

[jira] [Commented] (SPARK-40289) The result is strange when casting string to date in ORC reading via Schema Evolution

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600197#comment-17600197 ] Hyukjin Kwon commented on SPARK-40289: -- Hm, why don't you read it as a string and c

[jira] [Updated] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40332: Description: We should implement `GroupBy.quantile` for increasing pandas API coverage. pandas do

[jira] [Created] (SPARK-40332) Implement `GroupBy.quantile`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40332: --- Summary: Implement `GroupBy.quantile`. Key: SPARK-40332 URL: https://issues.apache.org/jira/browse/SPARK-40332 Project: Spark Issue Type: Sub-task Co

[jira] [Updated] (SPARK-40298) shuffle data recovery on the reused PVCs no effect

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40298: - Priority: Major (was: Blocker) > shuffle data recovery on the reused PVCs no effect >

[jira] [Resolved] (SPARK-40298) shuffle data recovery on the reused PVCs no effect

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40298. -- Resolution: Invalid > shuffle data recovery on the reused PVCs no effect > --

[jira] [Commented] (SPARK-40298) shuffle data recovery on the reused PVCs no effect

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600196#comment-17600196 ] Hyukjin Kwon commented on SPARK-40298: -- [~todd5167] for questions, it's better to i

[jira] [Resolved] (SPARK-40299) java api calls the count() method to appear: java.lang.ArithmeticException: BigInteger would overflow supported range

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40299. -- Resolution: Cannot Reproduce > java api calls the count() method to appear: java.lang.Arithmet

[jira] [Updated] (SPARK-40317) Improvement to JDBC predicate for queries involving joins

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40317: - Component/s: SQL (was: Spark Core) > Improvement to JDBC predicate for quer

[jira] [Created] (SPARK-40331) Java 11 should be used as the recommended running environment

2022-09-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-40331: Summary: Java 11 should be used as the recommended running environment Key: SPARK-40331 URL: https://issues.apache.org/jira/browse/SPARK-40331 Project: Spark Issue

[jira] [Commented] (SPARK-40271) Support list type for pyspark.sql.functions.lit

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600193#comment-17600193 ] Apache Spark commented on SPARK-40271: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-40330) Implement `Series.searchsorted`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40330: --- Summary: Implement `Series.searchsorted`. Key: SPARK-40330 URL: https://issues.apache.org/jira/browse/SPARK-40330 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40327: Component/s: Pandas API on Spark (was: ps) > Increase pandas API coverage for

[jira] [Updated] (SPARK-40328) Implement `DataFrame.compare`.

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40328: Component/s: Pandas API on Spark (was: ps) > Implement `DataFrame.compare`. >

[jira] [Created] (SPARK-40329) Implement `Series.compare`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40329: --- Summary: Implement `Series.compare`. Key: SPARK-40329 URL: https://issues.apache.org/jira/browse/SPARK-40329 Project: Spark Issue Type: Sub-task Comp

[jira] [Updated] (SPARK-40328) Implement `DataFrame.compare`.

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40328: Description: We should implement `DataFrame.compare` for increasing pandas API coverage. pandas d

[jira] [Created] (SPARK-40328) Implement `DataFrame.compare`.

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40328: --- Summary: Implement `DataFrame.compare`. Key: SPARK-40328 URL: https://issues.apache.org/jira/browse/SPARK-40328 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2022-09-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40327: Description: Increasing the pandas API coverage for Apache Spark 3.4.0. (was: Increasing the pand

[jira] [Created] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2022-09-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40327: --- Summary: Increase pandas API coverage for pandas API on Spark Key: SPARK-40327 URL: https://issues.apache.org/jira/browse/SPARK-40327 Project: Spark Issue Type

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40149: - Priority: Blocker (was: Major) > Star expansion after outer join asymmetrically includes joinin

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40149: - Target Version/s: 3.4.0 > Star expansion after outer join asymmetrically includes joining key >

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40149: - Target Version/s: (was: 3.4.0) > Star expansion after outer join asymmetrically includes joini

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-09-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40149: - Priority: Major (was: Blocker) > Star expansion after outer join asymmetrically includes joinin

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600111#comment-17600111 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull re

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600110#comment-17600110 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull re

[jira] [Assigned] (SPARK-40326) upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40326: Assignee: (was: Apache Spark) > upgrade com.fasterxml.jackson.dataformat:jackson-data

[jira] [Assigned] (SPARK-40326) upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40326: Assignee: Apache Spark > upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml

[jira] [Commented] (SPARK-40326) upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600084#comment-17600084 ] Apache Spark commented on SPARK-40326: -- User 'bjornjorgensen' has created a pull re

[jira] [Created] (SPARK-40326) upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4

2022-09-04 Thread Jira
Bjørn Jørgensen created SPARK-40326: --- Summary: upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-yaml from 2.13.3 to 2.13.4 Key: SPARK-40326 URL: https://issues.apache.org/jira/browse/SPARK-40326

[jira] [Assigned] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

2022-09-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40321: Assignee: Yang Jie > Upgrade rocksdbjni to 7.5.3 > --- > >

[jira] [Resolved] (SPARK-40321) Upgrade rocksdbjni to 7.5.3

2022-09-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40321. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37783 [https://gi

[jira] [Assigned] (SPARK-39996) Upgrade postgresql to 42.5.0

2022-09-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39996: Assignee: Bjørn Jørgensen > Upgrade postgresql to 42.5.0 > >

[jira] [Resolved] (SPARK-39996) Upgrade postgresql to 42.5.0

2022-09-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39996. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37762 [https://gi

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.5.0

2022-09-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39996: - Component/s: Tests > Upgrade postgresql to 42.5.0 > > >

[jira] [Updated] (SPARK-39996) Upgrade postgresql to 42.5.0

2022-09-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39996: - Priority: Minor (was: Major) > Upgrade postgresql to 42.5.0 > > >

[jira] [Created] (SPARK-40325) Support of Columnar result(ColumnarBatch) in org.apache.spark.sql.Dataset flatMap, transform, etc

2022-09-04 Thread Igor Suhorukov (Jira)
Igor Suhorukov created SPARK-40325: -- Summary: Support of Columnar result(ColumnarBatch) in org.apache.spark.sql.Dataset flatMap, transform, etc Key: SPARK-40325 URL: https://issues.apache.org/jira/browse/SPARK-40

[jira] [Assigned] (SPARK-40324) Provide a query context of ParseException

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40324: Assignee: Apache Spark (was: Max Gekk) > Provide a query context of ParseException > ---

[jira] [Assigned] (SPARK-40324) Provide a query context of ParseException

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40324: Assignee: Max Gekk (was: Apache Spark) > Provide a query context of ParseException > ---

[jira] [Commented] (SPARK-40324) Provide a query context of ParseException

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600047#comment-17600047 ] Apache Spark commented on SPARK-40324: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-40324) Provide a query context of ParseException

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600048#comment-17600048 ] Apache Spark commented on SPARK-40324: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-40324) Provide a query context of ParseException

2022-09-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-40324: Summary: Provide a query context of ParseException Key: SPARK-40324 URL: https://issues.apache.org/jira/browse/SPARK-40324 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-40251) Upgrade dev.ludovic.netlib from 2.2.1 to 3.0.2

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600035#comment-17600035 ] Apache Spark commented on SPARK-40251: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600032#comment-17600032 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull reque

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600031#comment-17600031 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull reque

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600029#comment-17600029 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull reque

[jira] [Commented] (SPARK-40288) After `RemoveRedundantAggregates`, `PullOutGroupingExpressions` should applied to avoid attribute missing when use complex expression.

2022-09-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600028#comment-17600028 ] Apache Spark commented on SPARK-40288: -- User 'hgs19921112' has created a pull reque

[jira] [Commented] (SPARK-39796) Add a regexp_extract variant which returns an array of all the matched capture groups

2022-09-04 Thread Augustine Theodore Prince (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600021#comment-17600021 ] Augustine Theodore Prince commented on SPARK-39796: --- Hi [~planga82] ,