[jira] [Assigned] (SPARK-35276) Write checksum files for shuffle

[ https://issues.apache.org/jira/browse/SPARK-35276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-35276: --- Assignee: wuyi > Write checksum files for shuffle >

[jira] [Resolved] (SPARK-35276) Write checksum files for shuffle

[ https://issues.apache.org/jira/browse/SPARK-35276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-35276. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-36192) Better error messages when comparing against list

Xinrong Meng created SPARK-36192: Summary: Better error messages when comparing against list Key: SPARK-36192 URL: https://issues.apache.org/jira/browse/SPARK-36192 Project: Spark Issue

[jira] [Created] (SPARK-36191) Support ORDER BY and LIMIT to be on the correlation path

Allison Wang created SPARK-36191: Summary: Support ORDER BY and LIMIT to be on the correlation path Key: SPARK-36191 URL: https://issues.apache.org/jira/browse/SPARK-36191 Project: Spark

[jira] [Updated] (SPARK-36187) Commit collision avoidance in dynamicPartitionOverwrite for non-Parquet formats

[ https://issues.apache.org/jira/browse/SPARK-36187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Zhang updated SPARK-36187: --- Description: Hi, my question here is specifically about [PR

[jira] [Assigned] (SPARK-36189) Improve bool, string, numeric DataTypeOps tests by avoiding joins

[ https://issues.apache.org/jira/browse/SPARK-36189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36189: Assignee: Apache Spark > Improve bool, string, numeric DataTypeOps tests by avoiding

[jira] [Assigned] (SPARK-36189) Improve bool, string, numeric DataTypeOps tests by avoiding joins

[ https://issues.apache.org/jira/browse/SPARK-36189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36189: Assignee: (was: Apache Spark) > Improve bool, string, numeric DataTypeOps tests by

[jira] [Commented] (SPARK-36188) Add categories setter to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382378#comment-17382378 ] Takuya Ueshin commented on SPARK-36188: --- I'm working on this. > Add categories setter to

[jira] [Commented] (SPARK-36189) Improve bool, string, numeric DataTypeOps tests by avoiding joins

[ https://issues.apache.org/jira/browse/SPARK-36189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382379#comment-17382379 ] Apache Spark commented on SPARK-36189: -- User 'xinrong-databricks' has created a pull request for

[jira] [Created] (SPARK-36190) Improve the rest of DataTypeOps tests by avoiding joins

Xinrong Meng created SPARK-36190: Summary: Improve the rest of DataTypeOps tests by avoiding joins Key: SPARK-36190 URL: https://issues.apache.org/jira/browse/SPARK-36190 Project: Spark

[jira] [Created] (SPARK-36189) Improve bool, string, numeric DataTypeOps tests by avoiding joins

Xinrong Meng created SPARK-36189: Summary: Improve bool, string, numeric DataTypeOps tests by avoiding joins Key: SPARK-36189 URL: https://issues.apache.org/jira/browse/SPARK-36189 Project: Spark

[jira] [Created] (SPARK-36188) Add categories setter to CategoricalAccessor and CategoricalIndex.

Takuya Ueshin created SPARK-36188: - Summary: Add categories setter to CategoricalAccessor and CategoricalIndex. Key: SPARK-36188 URL: https://issues.apache.org/jira/browse/SPARK-36188 Project: Spark

[jira] [Updated] (SPARK-36187) Commit collision avoidance in dynamicPartitionOverwrite for non-Parquet formats

[ https://issues.apache.org/jira/browse/SPARK-36187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Zhang updated SPARK-36187: --- Shepherd: Wenchen Fan Description: Hi, my question here is specifically about [PR

[jira] [Created] (SPARK-36187) Commit collision avoidance in dynamicPartitionOverwrite for non-Parquet formats

Tony Zhang created SPARK-36187: -- Summary: Commit collision avoidance in dynamicPartitionOverwrite for non-Parquet formats Key: SPARK-36187 URL: https://issues.apache.org/jira/browse/SPARK-36187 Project:

[jira] [Commented] (SPARK-35785) Cleanup support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382361#comment-17382361 ] Apache Spark commented on SPARK-35785: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36186) Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36186: Assignee: (was: Apache Spark) > Add as_ordered/as_unordered to CategoricalAccessor

[jira] [Assigned] (SPARK-36186) Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36186: Assignee: Apache Spark > Add as_ordered/as_unordered to CategoricalAccessor and

[jira] [Commented] (SPARK-36186) Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382352#comment-17382352 ] Apache Spark commented on SPARK-36186: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-36186) Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex.

Takuya Ueshin created SPARK-36186: - Summary: Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex. Key: SPARK-36186 URL: https://issues.apache.org/jira/browse/SPARK-36186 Project:

[jira] [Created] (SPARK-36185) Implement functions in CategoricalAccessor/CategoricalIndex

Takuya Ueshin created SPARK-36185: - Summary: Implement functions in CategoricalAccessor/CategoricalIndex Key: SPARK-36185 URL: https://issues.apache.org/jira/browse/SPARK-36185 Project: Spark

[jira] [Commented] (SPARK-36099) Group exception messages in core/util

[ https://issues.apache.org/jira/browse/SPARK-36099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382330#comment-17382330 ] Allison Wang commented on SPARK-36099: -- [~Shockang] Yes of course! > Group exception messages in

[jira] [Resolved] (SPARK-36128) CatalogFileIndex.filterPartitions should respect spark.sql.hive.metastorePartitionPruning

[ https://issues.apache.org/jira/browse/SPARK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36128. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33348

[jira] [Assigned] (SPARK-36128) CatalogFileIndex.filterPartitions should respect spark.sql.hive.metastorePartitionPruning

[ https://issues.apache.org/jira/browse/SPARK-36128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36128: --- Assignee: Chao Sun > CatalogFileIndex.filterPartitions should respect >

[jira] [Commented] (SPARK-36167) Revisit more InternalField managements.

[ https://issues.apache.org/jira/browse/SPARK-36167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382241#comment-17382241 ] Apache Spark commented on SPARK-36167: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-36183) Push down limit 1 through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-36183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382174#comment-17382174 ] Apache Spark commented on SPARK-36183: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36183) Push down limit 1 through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-36183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36183: Assignee: Apache Spark > Push down limit 1 through Aggregate >

[jira] [Assigned] (SPARK-36183) Push down limit 1 through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-36183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36183: Assignee: (was: Apache Spark) > Push down limit 1 through Aggregate >

[jira] [Commented] (SPARK-36183) Push down limit 1 through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-36183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382173#comment-17382173 ] Apache Spark commented on SPARK-36183: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36184) Use ValidateRequirements instead of EnsureRequirements to skip AQE rules that adds extra shuffles

[ https://issues.apache.org/jira/browse/SPARK-36184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36184: Assignee: (was: Apache Spark) > Use ValidateRequirements instead of

[jira] [Assigned] (SPARK-36184) Use ValidateRequirements instead of EnsureRequirements to skip AQE rules that adds extra shuffles

[ https://issues.apache.org/jira/browse/SPARK-36184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36184: Assignee: Apache Spark > Use ValidateRequirements instead of EnsureRequirements to skip

[jira] [Commented] (SPARK-36184) Use ValidateRequirements instead of EnsureRequirements to skip AQE rules that adds extra shuffles

[ https://issues.apache.org/jira/browse/SPARK-36184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382171#comment-17382171 ] Apache Spark commented on SPARK-36184: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-36184) Use ValidateRequirements instead of EnsureRequirements to skip AQE rules that adds extra shuffles

Wenchen Fan created SPARK-36184: --- Summary: Use ValidateRequirements instead of EnsureRequirements to skip AQE rules that adds extra shuffles Key: SPARK-36184 URL: https://issues.apache.org/jira/browse/SPARK-36184

[jira] [Created] (SPARK-36183) Push down limit 1 through Aggregate

Yuming Wang created SPARK-36183: --- Summary: Push down limit 1 through Aggregate Key: SPARK-36183 URL: https://issues.apache.org/jira/browse/SPARK-36183 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36152: -- Description:

[jira] [Comment Edited] (SPARK-32210) Failed to serialize large MapStatuses

[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382132#comment-17382132 ] Dongjoon Hyun edited comment on SPARK-32210 at 7/16/21, 3:13 PM: - Please

[jira] [Commented] (SPARK-32210) Failed to serialize large MapStatuses

[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382132#comment-17382132 ] Dongjoon Hyun commented on SPARK-32210: --- Please feel free to work on this, [~kazuyukitanimura]. >

[jira] [Commented] (SPARK-32210) Failed to serialize large MapStatuses

[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382131#comment-17382131 ] Dongjoon Hyun commented on SPARK-32210: --- There is a new observation of this situation in 3.1 from

[jira] [Updated] (SPARK-32210) Failed to serialize large MapStatuses

[ https://issues.apache.org/jira/browse/SPARK-32210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32210: -- Affects Version/s: 3.1.2 > Failed to serialize large MapStatuses >

[jira] [Commented] (SPARK-36134) jackson-databind RCE vulnerability

[ https://issues.apache.org/jira/browse/SPARK-36134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382128#comment-17382128 ] Erik Krogen commented on SPARK-36134: - Whoops, must have missed the 3.1.2 release :) Thanks for

[jira] [Commented] (SPARK-36182) Support TimestampNTZ type in Parquet file source

[ https://issues.apache.org/jira/browse/SPARK-36182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382126#comment-17382126 ] Apache Spark commented on SPARK-36182: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-36182) Support TimestampNTZ type in Parquet file source

[ https://issues.apache.org/jira/browse/SPARK-36182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36182: Assignee: Apache Spark (was: Gengliang Wang) > Support TimestampNTZ type in Parquet

[jira] [Assigned] (SPARK-36182) Support TimestampNTZ type in Parquet file source

[ https://issues.apache.org/jira/browse/SPARK-36182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36182: Assignee: Gengliang Wang (was: Apache Spark) > Support TimestampNTZ type in Parquet

[jira] [Resolved] (SPARK-36152) Add Scala 2.13 daily build and test GitHub Action job

[ https://issues.apache.org/jira/browse/SPARK-36152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36152. --- Fix Version/s: 3.2.0 3.3.0 Resolution: Fixed Issue resolved by

[jira] [Created] (SPARK-36182) Support TimestampNTZ type in Parquet file source

Gengliang Wang created SPARK-36182: -- Summary: Support TimestampNTZ type in Parquet file source Key: SPARK-36182 URL: https://issues.apache.org/jira/browse/SPARK-36182 Project: Spark Issue

[jira] [Commented] (SPARK-36181) Update pyspark sql readwriter documentation to Scala level

[ https://issues.apache.org/jira/browse/SPARK-36181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382123#comment-17382123 ] Apache Spark commented on SPARK-36181: -- User 'dominikgehl' has created a pull request for this

[jira] [Assigned] (SPARK-36181) Update pyspark sql readwriter documentation to Scala level

[ https://issues.apache.org/jira/browse/SPARK-36181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36181: Assignee: (was: Apache Spark) > Update pyspark sql readwriter documentation to Scala

[jira] [Assigned] (SPARK-36181) Update pyspark sql readwriter documentation to Scala level

[ https://issues.apache.org/jira/browse/SPARK-36181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36181: Assignee: Apache Spark > Update pyspark sql readwriter documentation to Scala level >

[jira] [Commented] (SPARK-36181) Update pyspark sql readwriter documentation to Scala level

[ https://issues.apache.org/jira/browse/SPARK-36181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382121#comment-17382121 ] Apache Spark commented on SPARK-36181: -- User 'dominikgehl' has created a pull request for this

[jira] [Created] (SPARK-36181) Update pyspark sql readwriter documentation to Scala level

Dominik Gehl created SPARK-36181: Summary: Update pyspark sql readwriter documentation to Scala level Key: SPARK-36181 URL: https://issues.apache.org/jira/browse/SPARK-36181 Project: Spark

[jira] [Resolved] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36177. -- Fix Version/s: 3.0.4 Resolution: Fixed Issue resolved by pull request 33390

[jira] [Updated] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36177: - Fix Version/s: 3.1.3 > Disable CRAN in branches lower than the latest version uploaded >

[jira] [Assigned] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36177: Assignee: Hyukjin Kwon > Disable CRAN in branches lower than the latest version uploaded

[jira] [Updated] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36158: - Fix Version/s: 3.1.3 3.2.0 > pyspark sql/functions documentation for

[jira] [Assigned] (SPARK-36154) pyspark documentation doesn't mention week and quarter as valid format arguments to trunc

[ https://issues.apache.org/jira/browse/SPARK-36154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36154: Assignee: Dominik Gehl > pyspark documentation doesn't mention week and quarter as valid

[jira] [Resolved] (SPARK-36160) pyspark sql/column documentation doesn't always match scala documentation

[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36160. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33369

[jira] [Assigned] (SPARK-36158) pyspark sql/functions documentation for months_between isn't as precise as scala version

[ https://issues.apache.org/jira/browse/SPARK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36158: Assignee: Dominik Gehl > pyspark sql/functions documentation for months_between isn't as

[jira] [Assigned] (SPARK-36160) pyspark sql/column documentation doesn't always match scala documentation

[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36160: Assignee: Dominik Gehl > pyspark sql/column documentation doesn't always match scala

[jira] [Updated] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36034: - Fix Version/s: 3.0.4 > Incorrect datetime filter when reading Parquet files written in legacy

[jira] [Commented] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-36179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382036#comment-17382036 ] Apache Spark commented on SPARK-36179: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-36179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382035#comment-17382035 ] Apache Spark commented on SPARK-36179: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-36179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36179: Assignee: Apache Spark > Support TimestampNTZType in SparkGetColumnsOperation >

[jira] [Assigned] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-36179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36179: Assignee: (was: Apache Spark) > Support TimestampNTZType in SparkGetColumnsOperation

[jira] [Assigned] (SPARK-36178) Document PySpark Catalog APIs in docs/source/reference/pyspark.sql.rst

[ https://issues.apache.org/jira/browse/SPARK-36178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36178: Assignee: Apache Spark > Document PySpark Catalog APIs in

[jira] [Assigned] (SPARK-36178) Document PySpark Catalog APIs in docs/source/reference/pyspark.sql.rst

[ https://issues.apache.org/jira/browse/SPARK-36178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36178: Assignee: (was: Apache Spark) > Document PySpark Catalog APIs in

[jira] [Commented] (SPARK-36178) Document PySpark Catalog APIs in docs/source/reference/pyspark.sql.rst

[ https://issues.apache.org/jira/browse/SPARK-36178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382017#comment-17382017 ] Apache Spark commented on SPARK-36178: -- User 'dominikgehl' has created a pull request for this

[jira] [Created] (SPARK-36180) HMS can not recognize timestamp_ntz

Kent Yao created SPARK-36180: Summary: HMS can not recognize timestamp_ntz Key: SPARK-36180 URL: https://issues.apache.org/jira/browse/SPARK-36180 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

Kent Yao created SPARK-36179: Summary: Support TimestampNTZType in SparkGetColumnsOperation Key: SPARK-36179 URL: https://issues.apache.org/jira/browse/SPARK-36179 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36178) Document PySpark Catalog APIs in docs/source/reference/pyspark.sql.rst

[ https://issues.apache.org/jira/browse/SPARK-36178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Gehl updated SPARK-36178: - Summary: Document PySpark Catalog APIs in docs/source/reference/pyspark.sql.rst (was: document

[jira] [Created] (SPARK-36178) document PySpark Catalog APIs in docs/source/reference/pyspark.sql.rst

Dominik Gehl created SPARK-36178: Summary: document PySpark Catalog APIs in docs/source/reference/pyspark.sql.rst Key: SPARK-36178 URL: https://issues.apache.org/jira/browse/SPARK-36178 Project:

[jira] [Assigned] (SPARK-34893) Support native session window

[ https://issues.apache.org/jira/browse/SPARK-34893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-34893: Assignee: Jungtaek Lim > Support native session window > - >

[jira] [Resolved] (SPARK-34893) Support native session window

[ https://issues.apache.org/jira/browse/SPARK-34893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-34893. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33081

[jira] [Assigned] (SPARK-36122) Spark does not passon needClientAuth to Jetty SSLContextFactory. Does not allow to configure mTLS authentication.

[ https://issues.apache.org/jira/browse/SPARK-36122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36122: Assignee: Apache Spark > Spark does not passon needClientAuth to Jetty

[jira] [Assigned] (SPARK-36122) Spark does not passon needClientAuth to Jetty SSLContextFactory. Does not allow to configure mTLS authentication.

[ https://issues.apache.org/jira/browse/SPARK-36122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36122: Assignee: (was: Apache Spark) > Spark does not passon needClientAuth to Jetty

[jira] [Assigned] (SPARK-36122) Spark does not passon needClientAuth to Jetty SSLContextFactory. Does not allow to configure mTLS authentication.

[ https://issues.apache.org/jira/browse/SPARK-36122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36122: Assignee: Apache Spark > Spark does not passon needClientAuth to Jetty

[jira] [Commented] (SPARK-36122) Spark does not passon needClientAuth to Jetty SSLContextFactory. Does not allow to configure mTLS authentication.

[ https://issues.apache.org/jira/browse/SPARK-36122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381996#comment-17381996 ] Apache Spark commented on SPARK-36122: -- User 'skhandrikagmail' has created a pull request for this

[jira] [Updated] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36177: - Description: CRAN check in branch-3.0 fails as below: {code} Insufficient package version

[jira] [Commented] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381979#comment-17381979 ] Apache Spark commented on SPARK-36177: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36177: Assignee: (was: Apache Spark) > Disable CRAN in branches lower than the latest

[jira] [Assigned] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36177: Assignee: Apache Spark > Disable CRAN in branches lower than the latest version uploaded

[jira] [Commented] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

[ https://issues.apache.org/jira/browse/SPARK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381977#comment-17381977 ] Apache Spark commented on SPARK-36177: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-36177) Disable CRAN in branches lower than the latest version uploaded

Hyukjin Kwon created SPARK-36177: Summary: Disable CRAN in branches lower than the latest version uploaded Key: SPARK-36177 URL: https://issues.apache.org/jira/browse/SPARK-36177 Project: Spark

[jira] [Updated] (SPARK-36176) Expose tableExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36176: - Summary: Expose tableExists in pyspark.sql.catalog (was: expose tableExists in

[jira] [Comment Edited] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381919#comment-17381919 ] canwang edited comment on SPARK-32530 at 7/16/21, 9:17 AM: --- I've been helping

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381919#comment-17381919 ] canwang commented on SPARK-32530: - I've been helping with the Jetbrains' [Kotlin Spark

[jira] [Resolved] (SPARK-36048) Wrong HealthTrackerSuite.allExecutorAndHostIds

[ https://issues.apache.org/jira/browse/SPARK-36048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-36048. -- Fix Version/s: 3.3.0 Assignee: wuyi Resolution: Fixed Issue resolved by 

[jira] [Commented] (SPARK-36176) expose tableExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381904#comment-17381904 ] Apache Spark commented on SPARK-36176: -- User 'dominikgehl' has created a pull request for this

[jira] [Assigned] (SPARK-36176) expose tableExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36176: Assignee: Apache Spark > expose tableExists in pyspark.sql.catalog >

[jira] [Assigned] (SPARK-36176) expose tableExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36176: Assignee: (was: Apache Spark) > expose tableExists in pyspark.sql.catalog >

[jira] [Commented] (SPARK-36176) expose tableExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381902#comment-17381902 ] Apache Spark commented on SPARK-36176: -- User 'dominikgehl' has created a pull request for this

[jira] [Updated] (SPARK-36176) expose tableExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Gehl updated SPARK-36176: - Summary: expose tableExists in pyspark.sql.catalog (was: expost tableExists in

[jira] [Created] (SPARK-36176) expost tableExists in pyspark.sql.catalog

Dominik Gehl created SPARK-36176: Summary: expost tableExists in pyspark.sql.catalog Key: SPARK-36176 URL: https://issues.apache.org/jira/browse/SPARK-36176 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35710) Support DPP + AQE when no reused broadcast exchange

[ https://issues.apache.org/jira/browse/SPARK-35710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35710: --- Assignee: Ke Jia > Support DPP + AQE when no reused broadcast exchange >

[jira] [Resolved] (SPARK-35710) Support DPP + AQE when no reused broadcast exchange

[ https://issues.apache.org/jira/browse/SPARK-35710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35710. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32861

[jira] [Commented] (SPARK-36099) Group exception messages in core/util

[ https://issues.apache.org/jira/browse/SPARK-36099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381874#comment-17381874 ] Shockang commented on SPARK-36099: -- [~allisonwang-db] Could I working on this issue? > Group exception

[jira] [Updated] (SPARK-35972) When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35972: Fix Version/s: 3.1.3 > When replace ExtractValue in NestedColumnAliasing we should use

[jira] [Assigned] (SPARK-35972) When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35972: --- Assignee: angerszhu > When replace ExtractValue in NestedColumnAliasing we should use

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381857#comment-17381857 ] Apache Spark commented on SPARK-36034: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381856#comment-17381856 ] Apache Spark commented on SPARK-36034: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-36160) pyspark sql/column documentation doesn't always match scala documentation

[ https://issues.apache.org/jira/browse/SPARK-36160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Gehl updated SPARK-36160: - Description: The pyspark sql/column documentation for methods between, getField, dropFields and

[jira] [Commented] (SPARK-36175) Support TimestampNTZ in Avro data source

[ https://issues.apache.org/jira/browse/SPARK-36175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17381806#comment-17381806 ] jiaan.geng commented on SPARK-36175: [~Gengliang.Wang]Thanks for ping me. > Support TimestampNTZ in

  1   2   >