[jira] [Updated] (SPARK-39791) In Spark 3.0 standalone cluster mode, unable to customize driver JVM path

[ https://issues.apache.org/jira/browse/SPARK-39791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ObobjXin updated SPARK-39791: - Description: In Spark 3.0 standalone mode, unable to customize driver JVM path, instead the JAVA_HOME o

[jira] [Created] (SPARK-39791) In Spark 3.0 standalone cluster mode, unable to customize driver JVM path

ObobjXin created SPARK-39791: Summary: In Spark 3.0 standalone cluster mode, unable to customize driver JVM path Key: SPARK-39791 URL: https://issues.apache.org/jira/browse/SPARK-39791 Project: Spark

[jira] [Commented] (SPARK-39788) Rename catalogName to dialectName for JdbcUtils

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567103#comment-17567103 ] Apache Spark commented on SPARK-39788: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-39788) Rename catalogName to dialectName for JdbcUtils

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39788: Assignee: (was: Apache Spark) > Rename catalogName to dialectName for JdbcUtils > ---

[jira] [Assigned] (SPARK-39788) Rename catalogName to dialectName for JdbcUtils

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39788: Assignee: Apache Spark > Rename catalogName to dialectName for JdbcUtils > --

[jira] [Assigned] (SPARK-39790) Replace put element to map one by one to putAll, remove redundant new ArrayList

[ https://issues.apache.org/jira/browse/SPARK-39790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39790: Assignee: (was: Apache Spark) > Replace put element to map one by one to putAll, remo

[jira] [Commented] (SPARK-39790) Replace put element to map one by one to putAll, remove redundant new ArrayList

[ https://issues.apache.org/jira/browse/SPARK-39790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567100#comment-17567100 ] Apache Spark commented on SPARK-39790: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-39790) Replace put element to map one by one to putAll, remove redundant new ArrayList

[ https://issues.apache.org/jira/browse/SPARK-39790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567099#comment-17567099 ] Apache Spark commented on SPARK-39790: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-39790) Replace put element to map one by one to putAll, remove redundant new ArrayList

[ https://issues.apache.org/jira/browse/SPARK-39790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39790: Assignee: Apache Spark > Replace put element to map one by one to putAll, remove redundan

[jira] [Updated] (SPARK-39790) Replace put element to map one by one to putAll, remove redundant new ArrayList

[ https://issues.apache.org/jira/browse/SPARK-39790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-39790: Summary: Replace put element to map one by one to putAll, remove redundant new ArrayList (was: Re

[jira] [Updated] (SPARK-39788) Rename catalogName to dialectName for JdbcUtils

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39788: --- Description: Currently, processIndexProperties and getSupportedIndexTypeList in JdbcUtils have one

[jira] [Updated] (SPARK-39788) Rename catalogName to dialectName for JdbcUtils

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39788: --- Description: Currently, processIndexProperties and getSupportedIndexTypeList in JdbcUtils have one p

[jira] [Updated] (SPARK-39788) Rename catalogName to dialectName for JdbcUtils

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39788: --- Description: Currently, > Rename catalogName to dialectName for JdbcUtils > ---

[jira] [Updated] (SPARK-39788) Rename catalogName to dialectName for JdbcUtils

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39788: --- Summary: Rename catalogName to dialectName for JdbcUtils (was: Implement createIndex and IndexExist

[jira] [Created] (SPARK-39790) Replace put element to map one by one to putAll

BingKun Pan created SPARK-39790: --- Summary: Replace put element to map one by one to putAll Key: SPARK-39790 URL: https://issues.apache.org/jira/browse/SPARK-39790 Project: Spark Issue Type: Imp

[jira] [Assigned] (SPARK-39789) Remove unused method and redundant throw exception declare

[ https://issues.apache.org/jira/browse/SPARK-39789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39789: Assignee: (was: Apache Spark) > Remove unused method and redundant throw exception de

[jira] [Commented] (SPARK-39789) Remove unused method and redundant throw exception declare

[ https://issues.apache.org/jira/browse/SPARK-39789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567095#comment-17567095 ] Apache Spark commented on SPARK-39789: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-39789) Remove unused method and redundant throw exception declare

[ https://issues.apache.org/jira/browse/SPARK-39789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39789: Assignee: Apache Spark > Remove unused method and redundant throw exception declare > ---

[jira] [Commented] (SPARK-39789) Remove unused method and redundant throw exception declare

[ https://issues.apache.org/jira/browse/SPARK-39789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567094#comment-17567094 ] Apache Spark commented on SPARK-39789: -- User 'panbingkun' has created a pull reques

[jira] [Created] (SPARK-39789) Remove unused method and redundant throw exception declare

BingKun Pan created SPARK-39789: --- Summary: Remove unused method and redundant throw exception declare Key: SPARK-39789 URL: https://issues.apache.org/jira/browse/SPARK-39789 Project: Spark Issu

[jira] [Updated] (SPARK-39786) Fix performance gap and inconsistent behavior between using Scala 2.12 and Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-39786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39786: - Description: After SPARK-39576, we can run benchmark GitHub Actions to to generate Scala 2.13 benchmark

[jira] [Updated] (SPARK-39786) Fix performance gap and inconsistent behavior between using Scala 2.12 and Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-39786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39786: - Description: After SPARK-39576, we can run benchmark GitHub Actions to to generate Scala 2.13 benchmark

[jira] [Commented] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567087#comment-17567087 ] Yang Jie commented on SPARK-39652: -- For this issue, I haven't found workaround way,  We

[jira] [Commented] (SPARK-39788) Implement createIndex and IndexExists in JDBC (DB2 dialect)

[ https://issues.apache.org/jira/browse/SPARK-39788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567083#comment-17567083 ] jiaan.geng commented on SPARK-39788: I'm working on. > Implement createIndex and In

[jira] [Created] (SPARK-39788) Implement createIndex and IndexExists in JDBC (DB2 dialect)

jiaan.geng created SPARK-39788: -- Summary: Implement createIndex and IndexExists in JDBC (DB2 dialect) Key: SPARK-39788 URL: https://issues.apache.org/jira/browse/SPARK-39788 Project: Spark Issu

[jira] [Resolved] (SPARK-39741) Support url encode/decode as built-in function

[ https://issues.apache.org/jira/browse/SPARK-39741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39741. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37113 [https://gith

[jira] [Assigned] (SPARK-39741) Support url encode/decode as built-in function

[ https://issues.apache.org/jira/browse/SPARK-39741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39741: --- Assignee: Yi kaifei > Support url encode/decode as built-in function >

[jira] [Assigned] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39781: Assignee: Anish Shrigondekar > Add support for configuring max_open_files through RocksDB

[jira] [Resolved] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39781. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37196 [https://gi

[jira] [Updated] (SPARK-39553) Failed to remove shuffle ${shuffleId} - null when using Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-39553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39553: - Summary: Failed to remove shuffle ${shuffleId} - null when using Scala 2.13 (was: Failed to remove shuf

[jira] [Commented] (SPARK-39787) Use error class in the parsing error of function to_timestamp

[ https://issues.apache.org/jira/browse/SPARK-39787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567057#comment-17567057 ] Apache Spark commented on SPARK-39787: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-39787) Use error class in the parsing error of function to_timestamp

[ https://issues.apache.org/jira/browse/SPARK-39787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39787: Assignee: Apache Spark (was: Gengliang Wang) > Use error class in the parsing error of f

[jira] [Assigned] (SPARK-39787) Use error class in the parsing error of function to_timestamp

[ https://issues.apache.org/jira/browse/SPARK-39787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39787: Assignee: Gengliang Wang (was: Apache Spark) > Use error class in the parsing error of f

[jira] [Commented] (SPARK-39787) Use error class in the parsing error of function to_timestamp

[ https://issues.apache.org/jira/browse/SPARK-39787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567056#comment-17567056 ] Apache Spark commented on SPARK-39787: -- User 'gengliangwang' has created a pull req

[jira] [Updated] (SPARK-39787) Use error class in the parsing error of function to_timestamp

[ https://issues.apache.org/jira/browse/SPARK-39787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39787: --- Summary: Use error class in the parsing error of function to_timestamp (was: Use error clas

[jira] [Created] (SPARK-39787) Use error class in the parsing errror of function to_timestamp

Gengliang Wang created SPARK-39787: -- Summary: Use error class in the parsing errror of function to_timestamp Key: SPARK-39787 URL: https://issues.apache.org/jira/browse/SPARK-39787 Project: Spark

[jira] [Updated] (SPARK-39553) Failed to remove shuffle ${shuffleId} - null

[ https://issues.apache.org/jira/browse/SPARK-39553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39553: - Parent: SPARK-39786 Issue Type: Sub-task (was: Bug) > Failed to remove shuffle ${shuffleId} - n

[jira] [Updated] (SPARK-39786) Fix performance gap and inconsistent behavior between using Scala 2.12 and Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-39786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39786: - Summary: Fix performance gap and inconsistent behavior between using Scala 2.12 and Scala 2.13 (was: Fi

[jira] [Updated] (SPARK-39786) Fix performance gap and inconsistent behavior between Scala 2.12 and Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-39786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39786: - Summary: Fix performance gap and inconsistent behavior between Scala 2.12 and Scala 2.13 (was: Fix perf

[jira] [Updated] (SPARK-39652) For CoalescedRDDBenchmark, the test results using Scala 2.13 are slower than Scala 2.12`, the test results using Scala 2.13 are slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39652: - Parent: SPARK-39786 Issue Type: Sub-task (was: Improvement) > For CoalescedRDDBenchmark, the te

[jira] [Updated] (SPARK-39766) For the `arrayOfAnyAsSeq` scenario in `GenericArrayDataBenchmark`, using Scala 2.13 is slower than Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-39766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39766: - Parent: SPARK-39786 Issue Type: Sub-task (was: Improvement) > For the `arrayOfAnyAsSeq` scenari

[jira] [Created] (SPARK-39786) Fix performance gap and inconsistent behavior between using Scala 2.12 and Scala 2.13

Yang Jie created SPARK-39786: Summary: Fix performance gap and inconsistent behavior between using Scala 2.12 and Scala 2.13 Key: SPARK-39786 URL: https://issues.apache.org/jira/browse/SPARK-39786 Project

[jira] [Resolved] (SPARK-39785) Use setBufferedIo instead of withBufferedIo to cleanup log4j2 deprecated api usage

[ https://issues.apache.org/jira/browse/SPARK-39785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-39785. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37193 [https://gith

[jira] [Assigned] (SPARK-39785) Use setBufferedIo instead of withBufferedIo to cleanup log4j2 deprecated api usage

[ https://issues.apache.org/jira/browse/SPARK-39785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-39785: --- Assignee: Yang Jie > Use setBufferedIo instead of withBufferedIo to cleanup log4j2 deprecat

[jira] [Updated] (SPARK-39785) Use setBufferedIo instead of withBufferedIo to cleanup log4j2 deprecated api usage

[ https://issues.apache.org/jira/browse/SPARK-39785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39785: - Summary: Use setBufferedIo instead of withBufferedIo to cleanup log4j2 deprecated api usage (was: Use s

[jira] [Updated] (SPARK-39785) Use setBufferedIo instead of deprecated withBufferedIo to cleanup log4j2 deprecated api usage

[ https://issues.apache.org/jira/browse/SPARK-39785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-39785: - Summary: Use setBufferedIo instead of deprecated withBufferedIo to cleanup log4j2 deprecated api usage

[jira] [Commented] (SPARK-39785) Use log4j2 setBufferedIo instead of deprecated withBufferedIo

[ https://issues.apache.org/jira/browse/SPARK-39785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567054#comment-17567054 ] Apache Spark commented on SPARK-39785: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39785) Use log4j2 setBufferedIo instead of deprecated withBufferedIo

[ https://issues.apache.org/jira/browse/SPARK-39785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39785: Assignee: (was: Apache Spark) > Use log4j2 setBufferedIo instead of deprecated withBu

[jira] [Assigned] (SPARK-39785) Use log4j2 setBufferedIo instead of deprecated withBufferedIo

[ https://issues.apache.org/jira/browse/SPARK-39785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39785: Assignee: Apache Spark > Use log4j2 setBufferedIo instead of deprecated withBufferedIo >

[jira] [Created] (SPARK-39785) Use log4j2 setBufferedIo instead of deprecated withBufferedIo

Yang Jie created SPARK-39785: Summary: Use log4j2 setBufferedIo instead of deprecated withBufferedIo Key: SPARK-39785 URL: https://issues.apache.org/jira/browse/SPARK-39785 Project: Spark Issue

[jira] [Resolved] (SPARK-39777) Remove Hive bucketing incompatibility doc

[ https://issues.apache.org/jira/browse/SPARK-39777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39777. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-39777) Remove Hive bucketing incompatibility doc

[ https://issues.apache.org/jira/browse/SPARK-39777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39777: Assignee: Cheng Su > Remove Hive bucketing incompatibility doc >

[jira] [Resolved] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

[ https://issues.apache.org/jira/browse/SPARK-39761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-39761. -- Fix Version/s: 3.4.0 Resolution: Fixed > Add Apache Spark images info in running-on-kub

[jira] [Assigned] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

[ https://issues.apache.org/jira/browse/SPARK-39761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-39761: Assignee: Yikun Jiang > Add Apache Spark images info in running-on-kubernetes doc > -

[jira] [Commented] (SPARK-39761) Add Apache Spark images info in running-on-kubernetes doc

[ https://issues.apache.org/jira/browse/SPARK-39761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567037#comment-17567037 ] Xinrong Meng commented on SPARK-39761: -- Fixed in [https://github.com/apache/spark/p

[jira] [Assigned] (SPARK-39784) Literal values should be on the right side of the data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39784: Assignee: (was: Apache Spark) > Literal values should be on the right side of the dat

[jira] [Commented] (SPARK-39784) Literal values should be on the right side of the data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567036#comment-17567036 ] Apache Spark commented on SPARK-39784: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-39784) Literal values should be on the right side of the data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567035#comment-17567035 ] Apache Spark commented on SPARK-39784: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-39784) Literal values should be on the right side of the data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39784: Assignee: Apache Spark > Literal values should be on the right side of the data source fi

[jira] [Created] (SPARK-39784) Literal values should be on the right side of the data source filter

Huaxin Gao created SPARK-39784: -- Summary: Literal values should be on the right side of the data source filter Key: SPARK-39784 URL: https://issues.apache.org/jira/browse/SPARK-39784 Project: Spark

[jira] [Resolved] (SPARK-39780) Add an additional usage example for the map_zip_with function

[ https://issues.apache.org/jira/browse/SPARK-39780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39780. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37192 [https://gi

[jira] [Assigned] (SPARK-39780) Add an additional usage example for the map_zip_with function

[ https://issues.apache.org/jira/browse/SPARK-39780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39780: Assignee: Brian Yue > Add an additional usage example for the map_zip_with function > ---

[jira] [Commented] (SPARK-39783) Wrong column backticks in UNRESOLVED_COLUMN error

[ https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566998#comment-17566998 ] Enrico Minack commented on SPARK-39783: --- [~srielau] [~cloud_fan]  > Wrong column

[jira] [Created] (SPARK-39783) Wrong column backticks in UNRESOLVED_COLUMN error

Enrico Minack created SPARK-39783: - Summary: Wrong column backticks in UNRESOLVED_COLUMN error Key: SPARK-39783 URL: https://issues.apache.org/jira/browse/SPARK-39783 Project: Spark Issue Typ

[jira] [Updated] (SPARK-39782) 3.2.2 Window function doc references TIMESTAMPNTZ

[ https://issues.apache.org/jira/browse/SPARK-39782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39782: -- Priority: Minor (was: Major) > 3.2.2 Window function doc references TIMESTAMPNTZ > --

[jira] [Created] (SPARK-39782) 3.2.2 Window function doc references TIMESTAMPNTZ

Bruce Robbins created SPARK-39782: - Summary: 3.2.2 Window function doc references TIMESTAMPNTZ Key: SPARK-39782 URL: https://issues.apache.org/jira/browse/SPARK-39782 Project: Spark Issue Typ

[jira] [Updated] (SPARK-37580) Reset numFailures when one of task attempts succeeds

[ https://issues.apache.org/jira/browse/SPARK-37580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37580: -- Summary: Reset numFailures when one of task attempts succeeds (was: Optimize current TaskSetM

[jira] [Updated] (SPARK-37580) Optimize current TaskSetManager abort logic when task failed count reach the threshold

[ https://issues.apache.org/jira/browse/SPARK-37580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37580: -- Affects Version/s: 3.3.0 (was: 3.2.0) > Optimize current TaskSetMan

[jira] [Commented] (SPARK-37580) Optimize current TaskSetManager abort logic when task failed count reach the threshold

[ https://issues.apache.org/jira/browse/SPARK-37580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566988#comment-17566988 ] Dongjoon Hyun commented on SPARK-37580: --- I added `3.3.0` as `Fixed Version` becaus

[jira] [Updated] (SPARK-37580) Optimize current TaskSetManager abort logic when task failed count reach the threshold

[ https://issues.apache.org/jira/browse/SPARK-37580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37580: -- Fix Version/s: 3.3.0 > Optimize current TaskSetManager abort logic when task failed count reac

[jira] [Commented] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566968#comment-17566968 ] Apache Spark commented on SPARK-39781: -- User 'anishshri-db' has created a pull requ

[jira] [Commented] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566966#comment-17566966 ] Apache Spark commented on SPARK-39781: -- User 'anishshri-db' has created a pull requ

[jira] [Assigned] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39781: Assignee: Apache Spark > Add support for configuring max_open_files through RocksDB state

[jira] [Assigned] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39781: Assignee: (was: Apache Spark) > Add support for configuring max_open_files through Ro

[jira] [Commented] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566965#comment-17566965 ] Anish Shrigondekar commented on SPARK-39781: Sent change here: [https://gith

[jira] [Comment Edited] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multip

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566945#comment-17566945 ] Dongjoon Hyun edited comment on SPARK-25250 at 7/14/22 6:31 PM: --

[jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple ti

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566945#comment-17566945 ] Dongjoon Hyun commented on SPARK-25250: --- To sync with the comment and commit histo

[jira] [Updated] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple time

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25250: -- Fix Version/s: (was: 2.4.1) (was: 2.3.4) > Race condition with task

[jira] [Updated] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple time

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25250: -- Attachment: Screen Shot 2022-07-14 at 11.24.58 AM.png > Race condition with tasks running when

[jira] [Commented] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-39781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566940#comment-17566940 ] Anish Shrigondekar commented on SPARK-39781: Working on the change and will

[jira] [Created] (SPARK-39781) Add support for configuring max_open_files through RocksDB state store provider

Anish Shrigondekar created SPARK-39781: -- Summary: Add support for configuring max_open_files through RocksDB state store provider Key: SPARK-39781 URL: https://issues.apache.org/jira/browse/SPARK-39781

[jira] [Commented] (SPARK-39732) pyspark.pandas.DataFrame.drop drops dataframe if axis not specified

[ https://issues.apache.org/jira/browse/SPARK-39732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566928#comment-17566928 ] Xinrong Meng commented on SPARK-39732: -- Thanks [~itsmeandy] for raising that!   P

[jira] [Commented] (SPARK-39732) pyspark.pandas.DataFrame.drop drops dataframe if axis not specified

[ https://issues.apache.org/jira/browse/SPARK-39732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566924#comment-17566924 ] Xinrong Meng commented on SPARK-39732: -- How about we match pandas behavior/results

[jira] [Resolved] (SPARK-39774) [BUG] char(n) type cannot be directly compared with string equals and needs to be cast to String. hive sql can be compared without conversion

[ https://issues.apache.org/jira/browse/SPARK-39774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin resolved SPARK-39774. --- Resolution: Fixed > [BUG] char(n) type cannot be directly compared with string equals and needs > to be cas

[jira] [Updated] (SPARK-39779) Support adding maven packages while pip

[ https://issues.apache.org/jira/browse/SPARK-39779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serena Ruan updated SPARK-39779: Shepherd: Mark Hamilton > Support adding maven packages while pip > --

[jira] [Updated] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39758: - Fix Version/s: 3.2.2 > NPE on invalid patterns from the regexp functions > -

[jira] [Updated] (SPARK-39758) NPE on invalid patterns from the regexp functions

[ https://issues.apache.org/jira/browse/SPARK-39758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39758: - Fix Version/s: 3.3.1 > NPE on invalid patterns from the regexp functions > -

[jira] [Commented] (SPARK-39732) pyspark.pandas.DataFrame.drop drops dataframe if axis not specified

[ https://issues.apache.org/jira/browse/SPARK-39732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566839#comment-17566839 ] Andreas Saltveit commented on SPARK-39732: -- 3.2.0 [https://spark.apache.org/do

[jira] [Commented] (SPARK-39732) pyspark.pandas.DataFrame.drop drops dataframe if axis not specified

[ https://issues.apache.org/jira/browse/SPARK-39732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566840#comment-17566840 ] Andreas Saltveit commented on SPARK-39732: -- Seems weird to change default. > p

[jira] [Commented] (SPARK-39732) pyspark.pandas.DataFrame.drop drops dataframe if axis not specified

[ https://issues.apache.org/jira/browse/SPARK-39732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566835#comment-17566835 ] Andreas Saltveit commented on SPARK-39732: -- this is a behavior change from old

[jira] [Commented] (SPARK-39780) Add an additional usage example for the map_zip_with function

[ https://issues.apache.org/jira/browse/SPARK-39780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566819#comment-17566819 ] Apache Spark commented on SPARK-39780: -- User 'byyue' has created a pull request for

[jira] [Commented] (SPARK-39780) Add an additional usage example for the map_zip_with function

[ https://issues.apache.org/jira/browse/SPARK-39780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566820#comment-17566820 ] Apache Spark commented on SPARK-39780: -- User 'byyue' has created a pull request for

[jira] [Assigned] (SPARK-39780) Add an additional usage example for the map_zip_with function

[ https://issues.apache.org/jira/browse/SPARK-39780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39780: Assignee: (was: Apache Spark) > Add an additional usage example for the map_zip_with

[jira] [Assigned] (SPARK-39780) Add an additional usage example for the map_zip_with function

[ https://issues.apache.org/jira/browse/SPARK-39780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39780: Assignee: Apache Spark > Add an additional usage example for the map_zip_with function >

[jira] [Updated] (SPARK-39622) ParquetIOSuite fails intermittently on master branch

[ https://issues.apache.org/jira/browse/SPARK-39622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-39622: - Description: "SPARK-7837 Do not close output writer twice when commitTask() fails" in ParquetIO

[jira] [Commented] (SPARK-39622) ParquetIOSuite fails intermittently on master branch

[ https://issues.apache.org/jira/browse/SPARK-39622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566816#comment-17566816 ] Jungtaek Lim commented on SPARK-39622: -- Another failure: https://github.com/HeartSa

[jira] [Updated] (SPARK-39622) ParquetIOSuite fails intermittently on master branch

[ https://issues.apache.org/jira/browse/SPARK-39622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-39622: - Summary: ParquetIOSuite fails intermittently on master branch (was: ParquetIOSuite fails consis

[jira] [Assigned] (SPARK-39775) Regression due to AVRO-2035

[ https://issues.apache.org/jira/browse/SPARK-39775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39775: Assignee: Apache Spark > Regression due to AVRO-2035 > --- > >

[jira] [Commented] (SPARK-39775) Regression due to AVRO-2035

[ https://issues.apache.org/jira/browse/SPARK-39775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566814#comment-17566814 ] Apache Spark commented on SPARK-39775: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-39775) Regression due to AVRO-2035

[ https://issues.apache.org/jira/browse/SPARK-39775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39775: Assignee: (was: Apache Spark) > Regression due to AVRO-2035 > ---

  1   2   >