[jira] [Assigned] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-30602: --- Assignee: Min Shen > SPIP: Support push-based shuffle to improve shuffle ef

[jira] [Commented] (SPARK-35811) Deprecate DataFrame.to_spark_io

[ https://issues.apache.org/jira/browse/SPARK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392714#comment-17392714 ] Apache Spark commented on SPARK-35811: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-35811) Deprecate DataFrame.to_spark_io

[ https://issues.apache.org/jira/browse/SPARK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392713#comment-17392713 ] Apache Spark commented on SPARK-35811: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-36408) Upgrade json4s to 4.0.3

[ https://issues.apache.org/jira/browse/SPARK-36408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36408: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade json4s to 4.0.3 > ---

[jira] [Commented] (SPARK-36408) Upgrade json4s to 4.0.3

[ https://issues.apache.org/jira/browse/SPARK-36408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392711#comment-17392711 ] Apache Spark commented on SPARK-36408: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36408) Upgrade json4s to 4.0.3

[ https://issues.apache.org/jira/browse/SPARK-36408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36408: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade json4s to 4.0.3 > ---

[jira] [Updated] (SPARK-36408) Upgrade json4s to 4.0.3

[ https://issues.apache.org/jira/browse/SPARK-36408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36408: --- Issue Type: Improvement (was: Bug) > Upgrade json4s to 4.0.3 > --- > >

[jira] [Created] (SPARK-36408) Upgrade json4s to 4.0.3

Kousuke Saruta created SPARK-36408: -- Summary: Upgrade json4s to 4.0.3 Key: SPARK-36408 URL: https://issues.apache.org/jira/browse/SPARK-36408 Project: Spark Issue Type: Bug Compone

[jira] [Assigned] (SPARK-36407) Avoid potential integer multiplications overflow risk

[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36407: Assignee: (was: Apache Spark) > Avoid potential integer multiplications overflow risk

[jira] [Commented] (SPARK-36407) Avoid potential integer multiplications overflow risk

[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392702#comment-17392702 ] Apache Spark commented on SPARK-36407: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36407) Avoid potential integer multiplications overflow risk

[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36407: Assignee: Apache Spark > Avoid potential integer multiplications overflow risk >

[jira] [Commented] (SPARK-36407) Avoid potential integer multiplications overflow risk

[ https://issues.apache.org/jira/browse/SPARK-36407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392700#comment-17392700 ] Apache Spark commented on SPARK-36407: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-36407) Avoid potential integer multiplications overflow risk

Yang Jie created SPARK-36407: Summary: Avoid potential integer multiplications overflow risk Key: SPARK-36407 URL: https://issues.apache.org/jira/browse/SPARK-36407 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392693#comment-17392693 ] Apache Spark commented on SPARK-36406: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36406: Assignee: Apache Spark > No longer do file truncate operation before delete a write faile

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392691#comment-17392691 ] Hyukjin Kwon commented on SPARK-36387: -- [~dc-heros] please go ahead! > Fix Series.

[jira] [Assigned] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36406: Assignee: (was: Apache Spark) > No longer do file truncate operation before delete a

[jira] [Commented] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392692#comment-17392692 ] Apache Spark commented on SPARK-36406: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

Yang Jie created SPARK-36406: Summary: No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter Key: SPARK-36406 URL: https://issues.apache.org/jira/browse/SPARK-36406

[jira] [Assigned] (SPARK-36405) Check that error class SQLSTATEs are valid

[ https://issues.apache.org/jira/browse/SPARK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36405: Assignee: Apache Spark > Check that error class SQLSTATEs are valid > ---

[jira] [Assigned] (SPARK-36405) Check that error class SQLSTATEs are valid

[ https://issues.apache.org/jira/browse/SPARK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36405: Assignee: (was: Apache Spark) > Check that error class SQLSTATEs are valid >

[jira] [Commented] (SPARK-36405) Check that error class SQLSTATEs are valid

[ https://issues.apache.org/jira/browse/SPARK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392682#comment-17392682 ] Apache Spark commented on SPARK-36405: -- User 'karenfeng' has created a pull request

[jira] [Commented] (SPARK-36405) Check that error class SQLSTATEs are valid

[ https://issues.apache.org/jira/browse/SPARK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392681#comment-17392681 ] Apache Spark commented on SPARK-36405: -- User 'karenfeng' has created a pull request

[jira] [Created] (SPARK-36405) Check that error class SQLSTATEs are valid

Karen Feng created SPARK-36405: -- Summary: Check that error class SQLSTATEs are valid Key: SPARK-36405 URL: https://issues.apache.org/jira/browse/SPARK-36405 Project: Spark Issue Type: Improvemen

[jira] [Assigned] (SPARK-36404) Support nested columns in ORC vectorized reader for data source v2

[ https://issues.apache.org/jira/browse/SPARK-36404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36404: - Assignee: Cheng Su > Support nested columns in ORC vectorized reader for data source v2

[jira] [Resolved] (SPARK-36404) Support nested columns in ORC vectorized reader for data source v2

[ https://issues.apache.org/jira/browse/SPARK-36404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36404. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33626 [https://

[jira] [Commented] (SPARK-36387) Fix Series.astype from datetime to nullable string

[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392648#comment-17392648 ] dgd_contributor commented on SPARK-36387: - Can I work on this ? > Fix Series.as

[jira] [Commented] (SPARK-36369) Fix Index.union to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392637#comment-17392637 ] Haejoon Lee commented on SPARK-36369: - I'm working on it > Fix Index.union to follo

[jira] [Resolved] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

[ https://issues.apache.org/jira/browse/SPARK-36381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36381. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33618 [https://gi

[jira] [Assigned] (SPARK-36381) ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitive for v2 command.

[ https://issues.apache.org/jira/browse/SPARK-36381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36381: Assignee: PengLei > ALTER TABLE ADD/RENAME COLUMNS check exist does not use case sensitiv

[jira] [Assigned] (SPARK-36404) Support nested columns in ORC vectorized reader for data source v2

[ https://issues.apache.org/jira/browse/SPARK-36404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36404: Assignee: Apache Spark > Support nested columns in ORC vectorized reader for data source

[jira] [Commented] (SPARK-36404) Support nested columns in ORC vectorized reader for data source v2

[ https://issues.apache.org/jira/browse/SPARK-36404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392600#comment-17392600 ] Apache Spark commented on SPARK-36404: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-36404) Support nested columns in ORC vectorized reader for data source v2

[ https://issues.apache.org/jira/browse/SPARK-36404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36404: Assignee: (was: Apache Spark) > Support nested columns in ORC vectorized reader for d

[jira] [Created] (SPARK-36404) Support nested columns in ORC vectorized reader for data source v2

Cheng Su created SPARK-36404: Summary: Support nested columns in ORC vectorized reader for data source v2 Key: SPARK-36404 URL: https://issues.apache.org/jira/browse/SPARK-36404 Project: Spark I

[jira] [Created] (SPARK-36403) Implement Index.putmask

Xinrong Meng created SPARK-36403: Summary: Implement Index.putmask Key: SPARK-36403 URL: https://issues.apache.org/jira/browse/SPARK-36403 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-36402) Implement Series.combine

Xinrong Meng created SPARK-36402: Summary: Implement Series.combine Key: SPARK-36402 URL: https://issues.apache.org/jira/browse/SPARK-36402 Project: Spark Issue Type: Sub-task Compo

[jira] [Updated] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Krivenko updated SPARK-36400: --- Attachment: SQL Statistics.png > Redact sensitive information in Spark Thrift Server UI > --

[jira] [Updated] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Krivenko updated SPARK-36400: --- Description: Spark UI displays sensitive information on "JDBC/ODBC Server" tab The reason o

[jira] [Created] (SPARK-36401) Implement Series.cov

Xinrong Meng created SPARK-36401: Summary: Implement Series.cov Key: SPARK-36401 URL: https://issues.apache.org/jira/browse/SPARK-36401 Project: Spark Issue Type: Sub-task Component

[jira] [Created] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

Denis Krivenko created SPARK-36400: -- Summary: Redact sensitive information in Spark Thrift Server UI Key: SPARK-36400 URL: https://issues.apache.org/jira/browse/SPARK-36400 Project: Spark Is

[jira] [Created] (SPARK-36399) Implement DataFrame.combine_first

Xinrong Meng created SPARK-36399: Summary: Implement DataFrame.combine_first Key: SPARK-36399 URL: https://issues.apache.org/jira/browse/SPARK-36399 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36397) Implement DataFrame.mode

[ https://issues.apache.org/jira/browse/SPARK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392581#comment-17392581 ] Apache Spark commented on SPARK-36397: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-36397) Implement DataFrame.mode

[ https://issues.apache.org/jira/browse/SPARK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36397: Assignee: (was: Apache Spark) > Implement DataFrame.mode > >

[jira] [Commented] (SPARK-36397) Implement DataFrame.mode

[ https://issues.apache.org/jira/browse/SPARK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392579#comment-17392579 ] Apache Spark commented on SPARK-36397: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-36397) Implement DataFrame.mode

[ https://issues.apache.org/jira/browse/SPARK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36397: Assignee: Apache Spark > Implement DataFrame.mode > > >

[jira] [Created] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

Denis Krivenko created SPARK-36398: -- Summary: Redact sensitive information in Spark Thrift Server log Key: SPARK-36398 URL: https://issues.apache.org/jira/browse/SPARK-36398 Project: Spark I

[jira] [Updated] (SPARK-36395) Implement Index.map

[ https://issues.apache.org/jira/browse/SPARK-36395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36395: - Summary: Implement Index.map (was: Implement Index.map functionality) > Implement Index.map > -

[jira] [Updated] (SPARK-36396) Implement DataFrame.cov

[ https://issues.apache.org/jira/browse/SPARK-36396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36396: - Summary: Implement DataFrame.cov (was: Implement dataframe.cov) > Implement DataFrame.cov > ---

[jira] [Created] (SPARK-36397) Implement DataFrame.mode

Xinrong Meng created SPARK-36397: Summary: Implement DataFrame.mode Key: SPARK-36397 URL: https://issues.apache.org/jira/browse/SPARK-36397 Project: Spark Issue Type: Sub-task Compo

[jira] [Resolved] (SPARK-36280) Remove redundant aliases after RewritePredicateSubquery

[ https://issues.apache.org/jira/browse/SPARK-36280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36280. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33509 [https://

[jira] [Assigned] (SPARK-36280) Remove redundant aliases after RewritePredicateSubquery

[ https://issues.apache.org/jira/browse/SPARK-36280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36280: - Assignee: Yuming Wang > Remove redundant aliases after RewritePredicateSubquery > -

[jira] [Updated] (SPARK-36394) Increase pandas API coverage in PySpark

[ https://issues.apache.org/jira/browse/SPARK-36394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36394: - Description: Increase pandas API coverage in PySpark.   Especially, pending PRs [https://githu

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392536#comment-17392536 ] Dongjoon Hyun commented on SPARK-18105: --- It's a good news because you make it cons

[jira] [Created] (SPARK-36396) Implement dataframe.cov

Xinrong Meng created SPARK-36396: Summary: Implement dataframe.cov Key: SPARK-36396 URL: https://issues.apache.org/jira/browse/SPARK-36396 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-36395) Implement Index.map functionality

Xinrong Meng created SPARK-36395: Summary: Implement Index.map functionality Key: SPARK-36395 URL: https://issues.apache.org/jira/browse/SPARK-36395 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36394) Increase pandas API coverage in PySpark

Xinrong Meng created SPARK-36394: Summary: Increase pandas API coverage in PySpark Key: SPARK-36394 URL: https://issues.apache.org/jira/browse/SPARK-36394 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392457#comment-17392457 ] Apache Spark commented on SPARK-35881: -- User 'cloud-fan' has created a pull request

[jira] [Resolved] (SPARK-36370) Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36370. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed This was incl

[jira] [Resolved] (SPARK-36349) Disallow ANSI intervals in file-based datasources

[ https://issues.apache.org/jira/browse/SPARK-36349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36349. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33580 [https://github.com

[jira] [Assigned] (SPARK-36393) Try to raise memory and parallelism again for GA

[ https://issues.apache.org/jira/browse/SPARK-36393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36393: Assignee: (was: Apache Spark) > Try to raise memory and parallelism again for GA > --

[jira] [Assigned] (SPARK-36393) Try to raise memory and parallelism again for GA

[ https://issues.apache.org/jira/browse/SPARK-36393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36393: Assignee: Apache Spark > Try to raise memory and parallelism again for GA > -

[jira] [Commented] (SPARK-36393) Try to raise memory and parallelism again for GA

[ https://issues.apache.org/jira/browse/SPARK-36393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392413#comment-17392413 ] Apache Spark commented on SPARK-36393: -- User 'viirya' has created a pull request fo

[jira] [Created] (SPARK-36393) Try to raise memory and parallelism again for GA

L. C. Hsieh created SPARK-36393: --- Summary: Try to raise memory and parallelism again for GA Key: SPARK-36393 URL: https://issues.apache.org/jira/browse/SPARK-36393 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-36383) NullPointerException throws during executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36383: -- Fix Version/s: 3.2.0 > NullPointerException throws during executor shutdown >

[jira] [Created] (SPARK-36392) pandas fixed width file support

John Ayoub created SPARK-36392: -- Summary: pandas fixed width file support Key: SPARK-36392 URL: https://issues.apache.org/jira/browse/SPARK-36392 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392234#comment-17392234 ] Apache Spark commented on SPARK-36353: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392233#comment-17392233 ] Apache Spark commented on SPARK-36353: -- User 'AngersZh' has created a pull requ

[jira] [Resolved] (SPARK-36356) RemoveRedundantAlias should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-36356. --- Resolution: Fixed > RemoveRedundantAlias should keep output schema > --

[jira] [Assigned] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36353: Assignee: (was: Apache Spark) > RemoveNoopOperators should keep output schema > -

[jira] [Assigned] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36353: Assignee: Apache Spark > RemoveNoopOperators should keep output schema >

[jira] [Assigned] (SPARK-36315) Only skip AQEShuffleReadRule in the final stage if it breaks the distribution requirement

[ https://issues.apache.org/jira/browse/SPARK-36315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36315: --- Assignee: Wenchen Fan > Only skip AQEShuffleReadRule in the final stage if it breaks the di

[jira] [Resolved] (SPARK-36315) Only skip AQEShuffleReadRule in the final stage if it breaks the distribution requirement

[ https://issues.apache.org/jira/browse/SPARK-36315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36315. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33541 [https://gith

[jira] [Commented] (SPARK-36391) When fetch chunk throw NPE, improve the error message

[ https://issues.apache.org/jira/browse/SPARK-36391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392209#comment-17392209 ] Apache Spark commented on SPARK-36391: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-36391) When fetch chunk throw NPE, improve the error message

[ https://issues.apache.org/jira/browse/SPARK-36391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392207#comment-17392207 ] Apache Spark commented on SPARK-36391: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36391) When fetch chunk throw NPE, improve the error message

[ https://issues.apache.org/jira/browse/SPARK-36391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36391: Assignee: Apache Spark > When fetch chunk throw NPE, improve the error message >

[jira] [Assigned] (SPARK-36391) When fetch chunk throw NPE, improve the error message

[ https://issues.apache.org/jira/browse/SPARK-36391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36391: Assignee: (was: Apache Spark) > When fetch chunk throw NPE, improve the error message

[jira] [Comment Edited] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392205#comment-17392205 ] Cameron Todd edited comment on SPARK-18105 at 8/3/21, 9:44 AM: ---

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392205#comment-17392205 ] Cameron Todd commented on SPARK-18105: -- I'm also facing this same error when scalin

[jira] [Created] (SPARK-36391) When fetch chunk throw NPE, improve the error message

angerszhu created SPARK-36391: - Summary: When fetch chunk throw NPE, improve the error message Key: SPARK-36391 URL: https://issues.apache.org/jira/browse/SPARK-36391 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-35437) Use expressions to filter Hive partitions at client side

[ https://issues.apache.org/jira/browse/SPARK-35437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-35437: --- Summary: Use expressions to filter Hive partitions at client side (was: Hive partition filtering client opt

[jira] [Commented] (SPARK-36390) Replace SessionState.close with SessionState.detachSession

[ https://issues.apache.org/jira/browse/SPARK-36390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392179#comment-17392179 ] Apache Spark commented on SPARK-36390: -- User 'cxzl25' has created a pull request fo

[jira] [Commented] (SPARK-36390) Replace SessionState.close with SessionState.detachSession

[ https://issues.apache.org/jira/browse/SPARK-36390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392177#comment-17392177 ] Apache Spark commented on SPARK-36390: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-36390) Replace SessionState.close with SessionState.detachSession

[ https://issues.apache.org/jira/browse/SPARK-36390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36390: Assignee: (was: Apache Spark) > Replace SessionState.close with SessionState.detachSe

[jira] [Assigned] (SPARK-36390) Replace SessionState.close with SessionState.detachSession

[ https://issues.apache.org/jira/browse/SPARK-36390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36390: Assignee: Apache Spark > Replace SessionState.close with SessionState.detachSession > ---

[jira] [Created] (SPARK-36390) Replace SessionState.close with SessionState.detachSession

dzcxzl created SPARK-36390: -- Summary: Replace SessionState.close with SessionState.detachSession Key: SPARK-36390 URL: https://issues.apache.org/jira/browse/SPARK-36390 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-36383) NullPointerException throws during executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392175#comment-17392175 ] Apache Spark commented on SPARK-36383: -- User 'Ngone51' has created a pull request f

[jira] [Updated] (SPARK-36383) NullPointerException throws during executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-36383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-36383: - Issue Type: Bug (was: Improvement) > NullPointerException throws during executor shutdown > ---

[jira] [Assigned] (SPARK-36380) Simplify the logical plan names for ALTER TABLE ... COLUMN

[ https://issues.apache.org/jira/browse/SPARK-36380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36380: Assignee: Wenchen Fan > Simplify the logical plan names for ALTER TABLE ... COLUMN >

[jira] [Resolved] (SPARK-36380) Simplify the logical plan names for ALTER TABLE ... COLUMN

[ https://issues.apache.org/jira/browse/SPARK-36380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36380. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33609 [https://github.com

[jira] [Resolved] (SPARK-36192) Better error messages for DataTypeOps against list

[ https://issues.apache.org/jira/browse/SPARK-36192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36192. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33581 [https://gi

[jira] [Assigned] (SPARK-36192) Better error messages for DataTypeOps against list

[ https://issues.apache.org/jira/browse/SPARK-36192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36192: Assignee: Xinrong Meng > Better error messages for DataTypeOps against list > --

[jira] [Updated] (SPARK-36389) Revert the change that accepts negative mapId in ShuffleBlockId

[ https://issues.apache.org/jira/browse/SPARK-36389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36389: -- Fix Version/s: 3.2.0 > Revert the change that accepts negative mapId in ShuffleBlockId > -