[jira] [Assigned] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

2021-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35985: --- Assignee: Steven Aerts > File source V2 ignores partition filters when empty

[jira] [Resolved] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

2021-07-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35985. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33191

[jira] [Created] (SPARK-36174) Support explain final plan in AQE

2021-07-15 Thread XiDuo You (Jira)
XiDuo You created SPARK-36174: - Summary: Support explain final plan in AQE Key: SPARK-36174 URL: https://issues.apache.org/jira/browse/SPARK-36174 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36173: Assignee: Apache Spark > [CORE] Support getting CPU number in TaskContext >

[jira] [Assigned] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36173: Assignee: (was: Apache Spark) > [CORE] Support getting CPU number in TaskContext >

[jira] [Commented] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381741#comment-17381741 ] Apache Spark commented on SPARK-36173: -- User 'xwu99' has created a pull request for this issue:

[jira] [Created] (SPARK-36173) [CORE] Support getting CPU number in TaskContext

2021-07-15 Thread Xiaochang Wu (Jira)
Xiaochang Wu created SPARK-36173: Summary: [CORE] Support getting CPU number in TaskContext Key: SPARK-36173 URL: https://issues.apache.org/jira/browse/SPARK-36173 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36171) Upgrade GenJavadoc to 0.18

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36171. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33383

[jira] [Updated] (SPARK-36171) Upgrade GenJavadoc to 0.18

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36171: -- Affects Version/s: 3.2.0 > Upgrade GenJavadoc to 0.18 > -- > >

[jira] [Created] (SPARK-36172) Document session window in Structured Streaming guide doc

2021-07-15 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-36172: Summary: Document session window in Structured Streaming guide doc Key: SPARK-36172 URL: https://issues.apache.org/jira/browse/SPARK-36172 Project: Spark

[jira] [Updated] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36034: - Fix Version/s: 3.1.3 > Incorrect datetime filter when reading Parquet files written in legacy

[jira] [Resolved] (SPARK-36167) Revisit more InternalField managements.

2021-07-15 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36167. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Commented] (SPARK-36167) Revisit more InternalField managements.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381689#comment-17381689 ] Apache Spark commented on SPARK-36167: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

2021-07-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381680#comment-17381680 ] Hyukjin Kwon commented on SPARK-36169: -- fixed in https://github.com/apache/spark/pull/33381 > Make

[jira] [Resolved] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

2021-07-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36169. -- Fix Version/s: 3.3.0 Assignee: Hyukjin Kwon Resolution: Fixed > Make

[jira] [Updated] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36146: - Fix Version/s: 3.2.0 > Upgrade Python version from 3.6 to higher version in GitHub linter >

[jira] [Assigned] (SPARK-36171) Upgrade GenJavadoc to 0.18

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36171: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade GenJavadoc to 0.18 >

[jira] [Assigned] (SPARK-36171) Upgrade GenJavadoc to 0.18

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36171: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade GenJavadoc to 0.18 >

[jira] [Assigned] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36137: Assignee: Apache Spark > HiveShim always fallback to getAllPartitionsOf regardless of

[jira] [Commented] (SPARK-36171) Upgrade GenJavadoc to 0.18

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381671#comment-17381671 ] Apache Spark commented on SPARK-36171: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381669#comment-17381669 ] Apache Spark commented on SPARK-36137: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36137: Assignee: (was: Apache Spark) > HiveShim always fallback to getAllPartitionsOf

[jira] [Commented] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381670#comment-17381670 ] Apache Spark commented on SPARK-36137: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381667#comment-17381667 ] Apache Spark commented on SPARK-36169: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381664#comment-17381664 ] Apache Spark commented on SPARK-36169: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36169: Assignee: (was: Apache Spark) > Make

[jira] [Assigned] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36169: Assignee: Apache Spark > Make 'spark.sql.sources.disabledJdbcConnProviderList' as a

[jira] [Resolved] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36166. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33376

[jira] [Created] (SPARK-36171) Upgrade GenJavadoc to 0.18

2021-07-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36171: -- Summary: Upgrade GenJavadoc to 0.18 Key: SPARK-36171 URL: https://issues.apache.org/jira/browse/SPARK-36171 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-35810) Deprecate ps.broadcast API

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35810: Assignee: Apache Spark > Deprecate ps.broadcast API > -- > >

[jira] [Commented] (SPARK-35810) Deprecate ps.broadcast API

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381657#comment-17381657 ] Apache Spark commented on SPARK-35810: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35810) Deprecate ps.broadcast API

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35810: Assignee: (was: Apache Spark) > Deprecate ps.broadcast API >

[jira] [Commented] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381659#comment-17381659 ] Apache Spark commented on SPARK-36170: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36170: Assignee: Apache Spark (was: Kousuke Saruta) > Change quoted interval literal (interval

[jira] [Commented] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381658#comment-17381658 ] Apache Spark commented on SPARK-36170: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36170: Assignee: Kousuke Saruta (was: Apache Spark) > Change quoted interval literal (interval

[jira] [Created] (SPARK-36170) Change quoted interval literal (interval constructor) to be converted to ANSI interval types

2021-07-15 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36170: -- Summary: Change quoted interval literal (interval constructor) to be converted to ANSI interval types Key: SPARK-36170 URL: https://issues.apache.org/jira/browse/SPARK-36170

[jira] [Commented] (SPARK-36134) jackson-databind RCE vulnerability

2021-07-15 Thread Sumit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381642#comment-17381642 ] Sumit commented on SPARK-36134: --- [~xkrogen] Thank you  [https://spark.apache.org/docs/latest/index.html] 

[jira] [Created] (SPARK-36169) Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted)

2021-07-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-36169: Summary: Make 'spark.sql.sources.disabledJdbcConnProviderList' as a static conf (as documneted) Key: SPARK-36169 URL: https://issues.apache.org/jira/browse/SPARK-36169

[jira] [Commented] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381620#comment-17381620 ] Apache Spark commented on SPARK-32922: -- User 'otterc' has created a pull request for this issue:

[jira] [Commented] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381619#comment-17381619 ] Apache Spark commented on SPARK-32922: -- User 'otterc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36167) Revisit more InternalField managements.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36167: Assignee: Apache Spark > Revisit more InternalField managements. >

[jira] [Commented] (SPARK-36167) Revisit more InternalField managements.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381618#comment-17381618 ] Apache Spark commented on SPARK-36167: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36167) Revisit more InternalField managements.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36167: Assignee: (was: Apache Spark) > Revisit more InternalField managements. >

[jira] [Commented] (SPARK-36167) Revisit more InternalField managements.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381617#comment-17381617 ] Apache Spark commented on SPARK-36167: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36152: - Assignee: Dongjoon Hyun > Add Scala 2.13 daily build and test GitHub Action job >

[jira] [Updated] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36152: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Test) > Add Scala 2.13 daily build

[jira] [Updated] (SPARK-35850) Upgrade scala-maven-plugin to 4.5.3

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35850: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade

[jira] [Assigned] (SPARK-36110) Upgrade SBT to 1.5.5

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36110: - Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade SBT to 1.5.5 >

[jira] [Updated] (SPARK-36110) Upgrade SBT to 1.5.5

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36110: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Upgrade SBT to 1.5.5 >

[jira] [Updated] (SPARK-36150) Disable MiMa for Scala 2.13 artifacts

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36150: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Test) > Disable MiMa for Scala 2.13

[jira] [Assigned] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36166: - Assignee: Dongjoon Hyun > Support Scala 2.13 test in `dev/run-tests.py` >

[jira] [Updated] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36166: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Test) > Support Scala 2.13 test in

[jira] [Created] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh`

2021-07-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36168: - Summary: Support Scala 2.13 in `dev/test-dependencies.sh` Key: SPARK-36168 URL: https://issues.apache.org/jira/browse/SPARK-36168 Project: Spark Issue

[jira] [Created] (SPARK-36167) Revisit more InternalField managements.

2021-07-15 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36167: - Summary: Revisit more InternalField managements. Key: SPARK-36167 URL: https://issues.apache.org/jira/browse/SPARK-36167 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381613#comment-17381613 ] Apache Spark commented on SPARK-36166: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36166: Assignee: Apache Spark > Support Scala 2.13 test in `dev/run-tests.py` >

[jira] [Assigned] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36166: Assignee: (was: Apache Spark) > Support Scala 2.13 test in `dev/run-tests.py` >

[jira] [Commented] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381612#comment-17381612 ] Apache Spark commented on SPARK-36166: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

2021-07-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36166: - Summary: Support Scala 2.13 test in `dev/run-tests.py` Key: SPARK-36166 URL: https://issues.apache.org/jira/browse/SPARK-36166 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36074) add error class for StructType.findNestedField

2021-07-15 Thread Karen Feng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Feng updated SPARK-36074: --- Parent: SPARK-36094 Issue Type: Sub-task (was: Improvement) > add error class for

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381582#comment-17381582 ] Apache Spark commented on SPARK-36034: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381579#comment-17381579 ] Apache Spark commented on SPARK-36034: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381568#comment-17381568 ] Apache Spark commented on SPARK-36164: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381567#comment-17381567 ] Apache Spark commented on SPARK-36164: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36034: Assignee: Max Gekk > Incorrect datetime filter when reading Parquet files written in legacy mode

[jira] [Updated] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36034: - Fix Version/s: 3.3.0 3.2.0 > Incorrect datetime filter when reading Parquet files

[jira] [Resolved] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36034. -- Resolution: Fixed > Incorrect datetime filter when reading Parquet files written in legacy mode >

[jira] [Assigned] (SPARK-36127) Support comparison between a Categorical and a scalar

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36127: Assignee: Apache Spark > Support comparison between a Categorical and a scalar >

[jira] [Assigned] (SPARK-36127) Support comparison between a Categorical and a scalar

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36127: Assignee: (was: Apache Spark) > Support comparison between a Categorical and a

[jira] [Assigned] (SPARK-36127) Support comparison between a Categorical and a scalar

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36127: Assignee: Apache Spark > Support comparison between a Categorical and a scalar >

[jira] [Commented] (SPARK-36127) Support comparison between a Categorical and a scalar

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381550#comment-17381550 ] Apache Spark commented on SPARK-36127: -- User 'xinrong-databricks' has created a pull request for

[jira] [Resolved] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36164. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33371

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36164: - Assignee: William Hyun > Change run-test.py so that it does not fail when >

[jira] [Resolved] (SPARK-36165) Fix SQL doc generation in GitHub Action

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36165. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33372

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36165: - Assignee: Dongjoon Hyun > Fix SQL doc generation in GitHub Action >

[jira] [Updated] (SPARK-36127) Support comparison between a Categorical and a scalar

2021-07-15 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-36127: - Summary: Support comparison between a Categorical and a scalar (was: Adjust non-equality

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36165: Assignee: Apache Spark > Fix SQL doc generation in GitHub Action >

[jira] [Commented] (SPARK-36165) Fix SQL doc generation in GitHub Action

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381494#comment-17381494 ] Apache Spark commented on SPARK-36165: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36165) Fix SQL doc generation in GitHub Action

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36165: Assignee: (was: Apache Spark) > Fix SQL doc generation in GitHub Action >

[jira] [Created] (SPARK-36165) Fix SQL doc generation in GitHub Action

2021-07-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-36165: - Summary: Fix SQL doc generation in GitHub Action Key: SPARK-36165 URL: https://issues.apache.org/jira/browse/SPARK-36165 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381476#comment-17381476 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: Apache Spark > Change run-test.py so that it does not fail when >

[jira] [Commented] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381477#comment-17381477 ] Apache Spark commented on SPARK-36164: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36164: Assignee: (was: Apache Spark) > Change run-test.py so that it does not fail when >

[jira] [Resolved] (SPARK-36135) Support TimestampNTZ type in file partitioning

2021-07-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36135. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33344

[jira] [Created] (SPARK-36164) Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined.

2021-07-15 Thread William Hyun (Jira)
William Hyun created SPARK-36164: Summary: Change run-test.py so that it does not fail when os.environ["APACHE_SPARK_REF"] is not defined. Key: SPARK-36164 URL: https://issues.apache.org/jira/browse/SPARK-36164

[jira] [Assigned] (SPARK-36157) TimeWindow expression: apply filter before project

2021-07-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36157: --- Assignee: Jungtaek Lim > TimeWindow expression: apply filter before project >

[jira] [Resolved] (SPARK-36157) TimeWindow expression: apply filter before project

2021-07-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36157. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33367

[jira] [Resolved] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

2021-07-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36158. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33366

[jira] [Commented] (SPARK-36134) jackson-databind RCE vulnerability

2021-07-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381417#comment-17381417 ] Erik Krogen commented on SPARK-36134: - 3.1.2 doesn't exist yet, the only release in the 3.1 line is

[jira] [Assigned] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36146: - Assignee: Hyukjin Kwon > Upgrade Python version from 3.6 to higher version in GitHub

[jira] [Resolved] (SPARK-36146) Upgrade Python version from 3.6 to higher version in GitHub linter

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36146. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33356

[jira] [Resolved] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36159. --- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution:

[jira] [Assigned] (SPARK-36159) Replace 'python' to 'python3' in dev/test-dependencies.sh

2021-07-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36159: - Assignee: Hyukjin Kwon > Replace 'python' to 'python3' in dev/test-dependencies.sh >

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381389#comment-17381389 ] Apache Spark commented on SPARK-36163: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36163: Assignee: (was: Apache Spark) > Propagate correct JDBC properties in JDBC connector

[jira] [Assigned] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36163: Assignee: Apache Spark > Propagate correct JDBC properties in JDBC connector provider

[jira] [Commented] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381388#comment-17381388 ] Apache Spark commented on SPARK-36163: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Created] (SPARK-36163) Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

2021-07-15 Thread Ivan (Jira)
Ivan created SPARK-36163: Summary: Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option Key: SPARK-36163 URL: https://issues.apache.org/jira/browse/SPARK-36163

  1   2   >