[jira] [Updated] (SPARK-36160) pyspark sql/column documentation doesn't always match scala documentation

[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Gehl updated SPARK-36160: - Description: The pyspark sql/column documentation for methods between, getField, dropFields and

[jira] [Commented] (SPARK-36175) Support TimestampNTZ in Avro data source

[ https://issues.apache.org/jira/browse/SPARK-36175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381806#comment-17381806 ] jiaan.geng commented on SPARK-36175: [~Gengliang.Wang]Thanks for ping me. > Support

[jira] [Created] (SPARK-36175) Support TimestampNTZ in Avro data source

Gengliang Wang created SPARK-36175: -- Summary: Support TimestampNTZ in Avro data source Key: SPARK-36175 URL: https://issues.apache.org/jira/browse/SPARK-36175 Project: Spark Issue Type: Sub

[jira] [Assigned] (SPARK-36174) Support explain final plan in AQE

[ https://issues.apache.org/jira/browse/SPARK-36174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36174: Assignee: Apache Spark > Support explain final plan in AQE >

[jira] [Commented] (SPARK-36175) Support TimestampNTZ in Avro data source

[ https://issues.apache.org/jira/browse/SPARK-36175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381805#comment-17381805 ] Gengliang Wang commented on SPARK-36175: cc [~beliefer] > Support TimestampNTZ

[jira] [Commented] (SPARK-36174) Support explain final plan in AQE

[ https://issues.apache.org/jira/browse/SPARK-36174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381804#comment-17381804 ] Apache Spark commented on SPARK-36174: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-36174) Support explain final plan in AQE

[ https://issues.apache.org/jira/browse/SPARK-36174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36174: Assignee: (was: Apache Spark) > Support explain final plan in AQE > -

[jira] [Commented] (SPARK-35508) job group and description do not apply on broadcasts

[ https://issues.apache.org/jira/browse/SPARK-35508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381790#comment-17381790 ] Shockang commented on SPARK-35508: -- Put this issue on hold and wait for the complete pl

[jira] [Assigned] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

[ https://issues.apache.org/jira/browse/SPARK-35985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35985: --- Assignee: Steven Aerts > File source V2 ignores partition filters when empty readDataSchema

[jira] [Resolved] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

[ https://issues.apache.org/jira/browse/SPARK-35985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35985. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33191 [https://gith

[jira] [Created] (SPARK-36174) Support explain final plan in AQE

XiDuo You created SPARK-36174: - Summary: Support explain final plan in AQE Key: SPARK-36174 URL: https://issues.apache.org/jira/browse/SPARK-36174 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36173: Assignee: Apache Spark > [CORE] Support getting CPU number in TaskContext > -

[jira] [Assigned] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36173: Assignee: (was: Apache Spark) > [CORE] Support getting CPU number in TaskContext > --

[jira] [Commented] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381741#comment-17381741 ] Apache Spark commented on SPARK-36173: -- User 'xwu99' has created a pull request for

[jira] [Created] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

Xiaochang Wu created SPARK-36173: Summary: [CORE] Support getting CPU number in TaskContext Key: SPARK-36173 URL: https://issues.apache.org/jira/browse/SPARK-36173 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36171) Upgrade GenJavadoc to 0.18

[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36171. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33383 [https://

[jira] [Updated] (SPARK-36171) Upgrade GenJavadoc to 0.18

[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36171: -- Affects Version/s: 3.2.0 > Upgrade GenJavadoc to 0.18 > -- > >

[jira] [Created] (SPARK-36172) Document session window in Structured Streaming guide doc

Jungtaek Lim created SPARK-36172: Summary: Document session window in Structured Streaming guide doc Key: SPARK-36172 URL: https://issues.apache.org/jira/browse/SPARK-36172 Project: Spark Iss

[jira] [Updated] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36034: - Fix Version/s: 3.1.3 > Incorrect datetime filter when reading Parquet files written in legacy mo

[jira] [Resolved] (SPARK-36167) Revisit more InternalField managements.

[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36167. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Commented] (SPARK-36167) Revisit more InternalField managements.

[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381689#comment-17381689 ] Apache Spark commented on SPARK-36167: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381680#comment-17381680 ] Hyukjin Kwon commented on SPARK-36169: -- fixed in https://github.com/apache/spark/pu

[jira] [Resolved] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36169. -- Fix Version/s: 3.3.0 Assignee: Hyukjin Kwon Resolution: Fixed > Make 'spark.sq

[jira] [Updated] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36146: - Fix Version/s: 3.2.0 > Upgrade Python version from 3.6 to higher version in GitHub linter >

[jira] [Assigned] (SPARK-36171) Upgrade GenJavadoc to 0.18

[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36171: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade GenJavadoc to 0.18 >

[jira] [Assigned] (SPARK-36171) Upgrade GenJavadoc to 0.18

[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36171: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade GenJavadoc to 0.18 >

[jira] [Assigned] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36137: Assignee: Apache Spark > HiveShim always fallback to getAllPartitionsOf regardless of whe

[jira] [Commented] (SPARK-36171) Upgrade GenJavadoc to 0.18

[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381671#comment-17381671 ] Apache Spark commented on SPARK-36171: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36137: Assignee: (was: Apache Spark) > HiveShim always fallback to getAllPartitionsOf regard

[jira] [Commented] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381670#comment-17381670 ] Apache Spark commented on SPARK-36137: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381669#comment-17381669 ] Apache Spark commented on SPARK-36137: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381667#comment-17381667 ] Apache Spark commented on SPARK-36169: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381664#comment-17381664 ] Apache Spark commented on SPARK-36169: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36169: Assignee: (was: Apache Spark) > Make 'spark.sql.sources.disabledJdbcConnProviderList'

[jira] [Assigned] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36169: Assignee: Apache Spark > Make 'spark.sql.sources.disabledJdbcConnProviderList' as a stati

[jira] [Resolved] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36166. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33376 [https://

[jira] [Created] (SPARK-36171) Upgrade GenJavadoc to 0.18

Kousuke Saruta created SPARK-36171: -- Summary: Upgrade GenJavadoc to 0.18 Key: SPARK-36171 URL: https://issues.apache.org/jira/browse/SPARK-36171 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-35810) Deprecate ps.broadcast API

[ https://issues.apache.org/jira/browse/SPARK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35810: Assignee: Apache Spark > Deprecate ps.broadcast API > -- > >

[jira] [Commented] (SPARK-35810) Deprecate ps.broadcast API

[ https://issues.apache.org/jira/browse/SPARK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381657#comment-17381657 ] Apache Spark commented on SPARK-35810: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-35810) Deprecate ps.broadcast API

[ https://issues.apache.org/jira/browse/SPARK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35810: Assignee: (was: Apache Spark) > Deprecate ps.broadcast API >

[jira] [Commented] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381659#comment-17381659 ] Apache Spark commented on SPARK-36170: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36170: Assignee: Apache Spark (was: Kousuke Saruta) > Change quoted interval literal (interval

[jira] [Commented] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381658#comment-17381658 ] Apache Spark commented on SPARK-36170: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36170: Assignee: Kousuke Saruta (was: Apache Spark) > Change quoted interval literal (interval

[jira] [Created] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

Kousuke Saruta created SPARK-36170: -- Summary: Change quoted interval literal (interval constructor) to be converted to ANSI interval types Key: SPARK-36170 URL: https://issues.apache.org/jira/browse/SPARK-36170

[jira] [Commented] (SPARK-36134) jackson-databind RCE vulnerability

[ https://issues.apache.org/jira/browse/SPARK-36134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381642#comment-17381642 ] Sumit commented on SPARK-36134: --- [~xkrogen] Thank you  [https://spark.apache.org/docs/lat

[jira] [Created] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

Hyukjin Kwon created SPARK-36169: Summary: Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted) Key: SPARK-36169 URL: https://issues.apache.org/jira/browse/SPARK-36169

[jira] [Commented] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381620#comment-17381620 ] Apache Spark commented on SPARK-32922: -- User 'otterc' has created a pull request fo

[jira] [Commented] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381619#comment-17381619 ] Apache Spark commented on SPARK-32922: -- User 'otterc' has created a pull request fo

[jira] [Assigned] (SPARK-36167) Revisit more InternalField managements.

[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36167: Assignee: Apache Spark > Revisit more InternalField managements. > --

[jira] [Commented] (SPARK-36167) Revisit more InternalField managements.

[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381618#comment-17381618 ] Apache Spark commented on SPARK-36167: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-36167) Revisit more InternalField managements.

[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36167: Assignee: (was: Apache Spark) > Revisit more InternalField managements. > ---

[jira] [Commented] (SPARK-36167) Revisit more InternalField managements.

[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381617#comment-17381617 ] Apache Spark commented on SPARK-36167: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36152: - Assignee: Dongjoon Hyun > Add Scala 2.13 daily build and test GitHub Action job > -

[jira] [Updated] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36152: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Test) > Add Scala 2.13 daily build and

[jira] [Updated] (SPARK-35850) Upgrade scala-maven-plugin to 4.5.3

[ https://issues.apache.org/jira/browse/SPARK-35850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35850: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade scala-maven-plu

[jira] [Assigned] (SPARK-36110) Upgrade SBT to 1.5.5

[ https://issues.apache.org/jira/browse/SPARK-36110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36110: - Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade SBT to 1.5.5 >

[jira] [Updated] (SPARK-36110) Upgrade SBT to 1.5.5

[ https://issues.apache.org/jira/browse/SPARK-36110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36110: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade SBT to 1.5.5 >

[jira] [Updated] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36150: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Test) > Disable MiMa for Scala 2.13 ar

[jira] [Assigned] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36166: - Assignee: Dongjoon Hyun > Support Scala 2.13 test in `dev/run-tests.py` > -

[jira] [Updated] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36166: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Test) > Support Scala 2.13 test in `de

[jira] [Created] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh`

Dongjoon Hyun created SPARK-36168: - Summary: Support Scala 2.13 in `dev/test-dependencies.sh` Key: SPARK-36168 URL: https://issues.apache.org/jira/browse/SPARK-36168 Project: Spark Issue Type

[jira] [Created] (SPARK-36167) Revisit more InternalField managements.

Takuya Ueshin created SPARK-36167: - Summary: Revisit more InternalField managements. Key: SPARK-36167 URL: https://issues.apache.org/jira/browse/SPARK-36167 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381613#comment-17381613 ] Apache Spark commented on SPARK-36166: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36166: Assignee: Apache Spark > Support Scala 2.13 test in `dev/run-tests.py` >

[jira] [Assigned] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36166: Assignee: (was: Apache Spark) > Support Scala 2.13 test in `dev/run-tests.py` > -

[jira] [Commented] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381612#comment-17381612 ] Apache Spark commented on SPARK-36166: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

Dongjoon Hyun created SPARK-36166: - Summary: Support Scala 2.13 test in `dev/run-tests.py` Key: SPARK-36166 URL: https://issues.apache.org/jira/browse/SPARK-36166 Project: Spark Issue Type: T

[jira] [Updated] (SPARK-36074) add error class for StructType.findNestedField

[ https://issues.apache.org/jira/browse/SPARK-36074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-36074: --- Parent: SPARK-36094 Issue Type: Sub-task (was: Improvement) > add error class for StructTyp

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381582#comment-17381582 ] Apache Spark commented on SPARK-36034: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381579#comment-17381579 ] Apache Spark commented on SPARK-36034: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381568#comment-17381568 ] Apache Spark commented on SPARK-36164: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381567#comment-17381567 ] Apache Spark commented on SPARK-36164: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36034: Assignee: Max Gekk > Incorrect datetime filter when reading Parquet files written in legacy mode

[jira] [Updated] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36034: - Fix Version/s: 3.3.0 3.2.0 > Incorrect datetime filter when reading Parquet files wri

[jira] [Resolved] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36034. -- Resolution: Fixed > Incorrect datetime filter when reading Parquet files written in legacy mode >

[jira] [Assigned] (SPARK-36127) Support comparison between a Categorical and a scalar

[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36127: Assignee: Apache Spark > Support comparison between a Categorical and a scalar >

[jira] [Assigned] (SPARK-36127) Support comparison between a Categorical and a scalar

[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36127: Assignee: (was: Apache Spark) > Support comparison between a Categorical and a scalar

[jira] [Assigned] (SPARK-36127) Support comparison between a Categorical and a scalar

[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36127: Assignee: Apache Spark > Support comparison between a Categorical and a scalar >

[jira] [Commented] (SPARK-36127) Support comparison between a Categorical and a scalar

[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381550#comment-17381550 ] Apache Spark commented on SPARK-36127: -- User 'xinrong-databricks' has created a pul

[jira] [Resolved] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36164. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33371 [https://

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36164: - Assignee: William Hyun > Change run-test.py so that it does not fail when > os.environ

[jira] [Resolved] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36165. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33372 [https://

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36165: - Assignee: Dongjoon Hyun > Fix SQL doc generation in GitHub Action > ---

[jira] [Updated] (SPARK-36127) Support comparison between a Categorical and a scalar

[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36127: - Summary: Support comparison between a Categorical and a scalar (was: Adjust non-equality compar

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36165: Assignee: Apache Spark > Fix SQL doc generation in GitHub Action > --

[jira] [Commented] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381494#comment-17381494 ] Apache Spark commented on SPARK-36165: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36165: Assignee: (was: Apache Spark) > Fix SQL doc generation in GitHub Action > ---

[jira] [Created] (SPARK-36165) Fix SQL doc generation in GitHub Action

Dongjoon Hyun created SPARK-36165: - Summary: Fix SQL doc generation in GitHub Action Key: SPARK-36165 URL: https://issues.apache.org/jira/browse/SPARK-36165 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381476#comment-17381476 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: Apache Spark > Change run-test.py so that it does not fail when > os.environ["

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381477#comment-17381477 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: (was: Apache Spark) > Change run-test.py so that it does not fail when > o

[jira] [Resolved] (SPARK-36135) Support TimestampNTZ type in file partitioning

[ https://issues.apache.org/jira/browse/SPARK-36135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36135. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33344 [https:

[jira] [Created] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

William Hyun created SPARK-36164: Summary: Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined. Key: SPARK-36164 URL: https://issues.apache.org/jira/browse/SPARK-36164

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36157: --- Assignee: Jungtaek Lim > TimeWindow expression: apply filter before project > -

[jira] [Resolved] (SPARK-36157) TimeWindow expression: apply filter before project

[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36157. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33367 [https://gith

[jira] [Resolved] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36158. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33366 [https://github.com

[jira] [Commented] (SPARK-36134) jackson-databind RCE vulnerability

[ https://issues.apache.org/jira/browse/SPARK-36134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381417#comment-17381417 ] Erik Krogen commented on SPARK-36134: - 3.1.2 doesn't exist yet, the only release in

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36146: - Assignee: Hyukjin Kwon > Upgrade Python version from 3.6 to higher version in GitHub li

  1   2   >