[jira] [Commented] (SPARK-32709) Write Hive ORC/Parquet bucketed table with hivehash (for Hive 1,2)

[ https://issues.apache.org/jira/browse/SPARK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383792#comment-17383792 ] Apache Spark commented on SPARK-32709: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-35815) Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals

[ https://issues.apache.org/jira/browse/SPARK-35815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383781#comment-17383781 ] Kousuke Saruta commented on SPARK-35815: I don't think so, and I'll work on this soon. > Allow

[jira] [Commented] (SPARK-35815) Allow delayThreshold for watermark to be represented as ANSI day-time/year-month interval literals

[ https://issues.apache.org/jira/browse/SPARK-35815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383780#comment-17383780 ] Wenchen Fan commented on SPARK-35815: - [~sarutak] do we have any more blockers for this one? >

[jira] [Updated] (SPARK-35228) Add expression ToHiveString for keep consistent between hive/spark format in df.show and transform

[ https://issues.apache.org/jira/browse/SPARK-35228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35228: Parent: (was: SPARK-27790) Issue Type: Improvement (was: Sub-task) > Add expression

[jira] [Commented] (SPARK-36221) Make sure CustomShuffleReaderExec has at least one partition

[ https://issues.apache.org/jira/browse/SPARK-36221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383751#comment-17383751 ] Apache Spark commented on SPARK-36221: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-36221) Make sure CustomShuffleReaderExec has at least one partition

[ https://issues.apache.org/jira/browse/SPARK-36221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36221: Assignee: (was: Apache Spark) > Make sure CustomShuffleReaderExec has at least one

[jira] [Assigned] (SPARK-36221) Make sure CustomShuffleReaderExec has at least one partition

[ https://issues.apache.org/jira/browse/SPARK-36221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36221: Assignee: Apache Spark > Make sure CustomShuffleReaderExec has at least one partition >

[jira] [Updated] (SPARK-36196) Spark FetchFailedException Stream is corrupted Error

[ https://issues.apache.org/jira/browse/SPARK-36196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-36196: Component/s: PySpark Kubernetes > Spark FetchFailedException Stream is corrupted

[jira] [Assigned] (SPARK-36093) The result incorrect if the partition path case is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-36093: --- Assignee: angerszhu (was: Apache Spark) > The result incorrect if the partition path case

[jira] [Commented] (SPARK-36046) Support new functions make_timestamp_ntz and make_timestamp_ltz

[ https://issues.apache.org/jira/browse/SPARK-36046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383738#comment-17383738 ] Apache Spark commented on SPARK-36046: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36216. -- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution:

[jira] [Assigned] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36216: Assignee: Hyukjin Kwon > Increase timeout for >

[jira] [Commented] (SPARK-36046) Support new functions make_timestamp_ntz and make_timestamp_ltz

[ https://issues.apache.org/jira/browse/SPARK-36046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383736#comment-17383736 ] Apache Spark commented on SPARK-36046: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-36221) Make sure CustomShuffleReaderExec has at least one partition

XiDuo You created SPARK-36221: - Summary: Make sure CustomShuffleReaderExec has at least one partition Key: SPARK-36221 URL: https://issues.apache.org/jira/browse/SPARK-36221 Project: Spark

[jira] [Assigned] (SPARK-36217) Rename CustomShuffleReader and OptimizeLocalShuffleReader

[ https://issues.apache.org/jira/browse/SPARK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36217: Assignee: Apache Spark > Rename CustomShuffleReader and OptimizeLocalShuffleReader >

[jira] [Commented] (SPARK-36217) Rename CustomShuffleReader and OptimizeLocalShuffleReader

[ https://issues.apache.org/jira/browse/SPARK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383731#comment-17383731 ] Apache Spark commented on SPARK-36217: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-36217) Rename CustomShuffleReader and OptimizeLocalShuffleReader

[ https://issues.apache.org/jira/browse/SPARK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383732#comment-17383732 ] Apache Spark commented on SPARK-36217: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36217) Rename CustomShuffleReader and OptimizeLocalShuffleReader

[ https://issues.apache.org/jira/browse/SPARK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36217: Assignee: (was: Apache Spark) > Rename CustomShuffleReader and

[jira] [Commented] (SPARK-36220) Incorrect pyspark.sql.types.Row __new__ and __init__ type annotations

[ https://issues.apache.org/jira/browse/SPARK-36220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383727#comment-17383727 ] Apache Spark commented on SPARK-36220: -- User 'tobiasedwards' has created a pull request for this

[jira] [Assigned] (SPARK-36220) Incorrect pyspark.sql.types.Row __new__ and __init__ type annotations

[ https://issues.apache.org/jira/browse/SPARK-36220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36220: Assignee: Apache Spark > Incorrect pyspark.sql.types.Row __new__ and __init__ type

[jira] [Assigned] (SPARK-36220) Incorrect pyspark.sql.types.Row __new__ and __init__ type annotations

[ https://issues.apache.org/jira/browse/SPARK-36220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36220: Assignee: (was: Apache Spark) > Incorrect pyspark.sql.types.Row __new__ and __init__

[jira] [Updated] (SPARK-36217) Rename CustomShuffleReader and OptimizeLocalShuffleReader

[ https://issues.apache.org/jira/browse/SPARK-36217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36217: - Description: The name {{CustomShuffleReader}} is confusing and sounds like an API. This should

[jira] [Created] (SPARK-36220) Incorrect pyspark.sql.types.Row __new__ and __init__ type annotations

Tobias Edwards created SPARK-36220: -- Summary: Incorrect pyspark.sql.types.Row __new__ and __init__ type annotations Key: SPARK-36220 URL: https://issues.apache.org/jira/browse/SPARK-36220 Project:

[jira] [Updated] (SPARK-36219) Add flag to allow Driver to request for OPPORTUNISTIC containers

[ https://issues.apache.org/jira/browse/SPARK-36219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated SPARK-36219: Affects Version/s: (was: 3.1.2) 3.3.0 > Add flag to allow Driver to request

[jira] [Updated] (SPARK-36219) Add flag to allow Driver to request for OPPORTUNISTIC containers

[ https://issues.apache.org/jira/browse/SPARK-36219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated SPARK-36219: Description: YARN-2882 and YARN-4335 introduces the concept of container ExecutionTypes and specifically

[jira] [Updated] (SPARK-36219) Add flag to allow Driver to request for OPPORTUNISTIC containers

[ https://issues.apache.org/jira/browse/SPARK-36219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaosju updated SPARK-36219: Description: YARN-2882 and YARN-4335 introduces the concept of container ExecutionTypes and specifically

[jira] [Created] (SPARK-36219) Add flag to allow Driver to request for OPPORTUNISTIC containers

chaosju created SPARK-36219: --- Summary: Add flag to allow Driver to request for OPPORTUNISTIC containers Key: SPARK-36219 URL: https://issues.apache.org/jira/browse/SPARK-36219 Project: Spark

[jira] [Updated] (SPARK-36093) The result incorrect if the partition path case is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-36093: Fix Version/s: 3.0.4 > The result incorrect if the partition path case is inconsistent >

[jira] [Comment Edited] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383707#comment-17383707 ] Hyukjin Kwon edited comment on SPARK-36218 at 7/20/21, 2:44 AM: cc

[jira] [Issue Comment Deleted] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36218: - Comment: was deleted (was: If we're not sure, It think we can land the same hacky fix for now

[jira] [Issue Comment Deleted] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36218: - Comment: was deleted (was: Let me create a Pr for now as a temporary workaround ...) > Flaky

[jira] [Commented] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383709#comment-17383709 ] Hyukjin Kwon commented on SPARK-36218: -- Let me create a Pr for now as a temporary workaround ... >

[jira] [Commented] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383708#comment-17383708 ] Hyukjin Kwon commented on SPARK-36218: -- If we're not sure, It think we can land the same hacky fix

[jira] [Comment Edited] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383707#comment-17383707 ] Hyukjin Kwon edited comment on SPARK-36218 at 7/20/21, 2:41 AM: cc

[jira] [Commented] (SPARK-36218) Flaky Test: TPC-DS in PR builder

[ https://issues.apache.org/jira/browse/SPARK-36218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383707#comment-17383707 ] Hyukjin Kwon commented on SPARK-36218: -- cc [~maropu], [~cloud_fan], [~dongjoon] FYI. Actually, I

[jira] [Created] (SPARK-36218) Flaky Test: TPC-DS in PR builder

Hyukjin Kwon created SPARK-36218: Summary: Flaky Test: TPC-DS in PR builder Key: SPARK-36218 URL: https://issues.apache.org/jira/browse/SPARK-36218 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-35807) Deprecate the `num_files` argument

[ https://issues.apache.org/jira/browse/SPARK-35807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35807: - Fix Version/s: 3.2.0 > Deprecate the `num_files` argument > --

[jira] [Assigned] (SPARK-35807) Deprecate the `num_files` argument

[ https://issues.apache.org/jira/browse/SPARK-35807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35807: Assignee: Haejoon Lee > Deprecate the `num_files` argument >

[jira] [Assigned] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36216: Assignee: Apache Spark > Increase timeout for >

[jira] [Commented] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383701#comment-17383701 ] Apache Spark commented on SPARK-36216: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-36217) Rename CustomShuffleReader and OptimizeLocalShuffleReader

Hyukjin Kwon created SPARK-36217: Summary: Rename CustomShuffleReader and OptimizeLocalShuffleReader Key: SPARK-36217 URL: https://issues.apache.org/jira/browse/SPARK-36217 Project: Spark

[jira] [Assigned] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36216: Assignee: (was: Apache Spark) > Increase timeout for >

[jira] [Updated] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36216: - Description: Test is flaky (https://github.com/apache/spark/runs/3109815586): {code} Traceback

[jira] [Created] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

Hyukjin Kwon created SPARK-36216: Summary: Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence Key: SPARK-36216 URL: https://issues.apache.org/jira/browse/SPARK-36216

[jira] [Updated] (SPARK-36216) Increase timeout for StreamingLinearRegressionWithTests.test_parameter_convergence

[ https://issues.apache.org/jira/browse/SPARK-36216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36216: - Docs Text: (was: Test is flaky (https://github.com/apache/spark/runs/3109815586): {code}

[jira] [Commented] (SPARK-35807) Deprecate the `num_files` argument

[ https://issues.apache.org/jira/browse/SPARK-35807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383699#comment-17383699 ] Apache Spark commented on SPARK-35807: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-35807) Deprecate the `num_files` argument

[ https://issues.apache.org/jira/browse/SPARK-35807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383698#comment-17383698 ] Apache Spark commented on SPARK-35807: -- User 'itholic' has created a pull request for this issue:

[jira] [Created] (SPARK-36215) Add logging for slow fetches to diagnose external shuffle service issues

Shardul Mahadik created SPARK-36215: --- Summary: Add logging for slow fetches to diagnose external shuffle service issues Key: SPARK-36215 URL: https://issues.apache.org/jira/browse/SPARK-36215

[jira] [Updated] (SPARK-35809) Add `index_col` argument for ps.sql.

[ https://issues.apache.org/jira/browse/SPARK-35809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-35809: Description: The current behavior of [ps.sql 

[jira] [Resolved] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-36179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36179. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33393

[jira] [Assigned] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-36179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36179: Assignee: Kent Yao > Support TimestampNTZType in SparkGetColumnsOperation >

[jira] [Commented] (SPARK-35809) Add `index_col` argument for ps.sql.

[ https://issues.apache.org/jira/browse/SPARK-35809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383679#comment-17383679 ] Haejoon Lee commented on SPARK-35809: - I'm working on this > Add `index_col` argument for ps.sql. >

[jira] [Resolved] (SPARK-36176) Expose tableExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36176. -- Fix Version/s: 3.2.0 Assignee: Dominik Gehl Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-32920) Add support in Spark driver to coordinate the finalization of the push/merge phase in push-based shuffle for a given shuffle and the initiation of the reduce stage

[ https://issues.apache.org/jira/browse/SPARK-32920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383669#comment-17383669 ] Apache Spark commented on SPARK-32920: -- User 'venkata91' has created a pull request for this issue:

[jira] [Commented] (SPARK-36000) Support creating a ps.Series/Index with `Decimal('NaN')` with Arrow disabled

[ https://issues.apache.org/jira/browse/SPARK-36000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383667#comment-17383667 ] Xinrong Meng commented on SPARK-36000: -- We might want to support

[jira] [Commented] (SPARK-32919) Add support in Spark driver to coordinate the shuffle map stage in push-based shuffle by selecting external shuffle services for merging shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-32919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383663#comment-17383663 ] Apache Spark commented on SPARK-32919: -- User 'venkata91' has created a pull request for this issue:

[jira] [Commented] (SPARK-32919) Add support in Spark driver to coordinate the shuffle map stage in push-based shuffle by selecting external shuffle services for merging shuffle partitions

[ https://issues.apache.org/jira/browse/SPARK-32919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383664#comment-17383664 ] Apache Spark commented on SPARK-32919: -- User 'venkata91' has created a pull request for this issue:

[jira] [Commented] (SPARK-36214) Add add_categories to CategoricalAccessor and CategoricalIndex.

[ https://issues.apache.org/jira/browse/SPARK-36214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383641#comment-17383641 ] Takuya Ueshin commented on SPARK-36214: --- I'm working on this. > Add add_categories to

[jira] [Created] (SPARK-36214) Add add_categories to CategoricalAccessor and CategoricalIndex.

Takuya Ueshin created SPARK-36214: - Summary: Add add_categories to CategoricalAccessor and CategoricalIndex. Key: SPARK-36214 URL: https://issues.apache.org/jira/browse/SPARK-36214 Project: Spark

[jira] [Resolved] (SPARK-35997) Implement comparison operators for CategoricalDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-35997. -- Resolution: Done > Implement comparison operators for CategoricalDtype in pandas API on Spark

[jira] [Resolved] (SPARK-36127) Support comparison between a Categorical and a scalar

[ https://issues.apache.org/jira/browse/SPARK-36127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36127. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng (was: Apache Spark) Resolution:

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383529#comment-17383529 ] Thomas Graves commented on SPARK-25075: --- Just wanted to check the plans for scala 2.13 in 3.2.  It

[jira] [Assigned] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

[ https://issues.apache.org/jira/browse/SPARK-36213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36213: Assignee: (was: Apache Spark) > Normalize PartitionSpec for DescTable with

[jira] [Commented] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

[ https://issues.apache.org/jira/browse/SPARK-36213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383485#comment-17383485 ] Apache Spark commented on SPARK-36213: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

[ https://issues.apache.org/jira/browse/SPARK-36213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36213: Assignee: Apache Spark > Normalize PartitionSpec for DescTable with PartitionSpec >

[jira] [Created] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

Kent Yao created SPARK-36213: Summary: Normalize PartitionSpec for DescTable with PartitionSpec Key: SPARK-36213 URL: https://issues.apache.org/jira/browse/SPARK-36213 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36212) Add exception for Kafka readstream when decryption fails

[ https://issues.apache.org/jira/browse/SPARK-36212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon LaFlamme updated SPARK-36212: - Fix Version/s: (was: 3.1.0) 3.0.0 > Add exception for Kafka readstream

[jira] [Created] (SPARK-36212) Add exception for Kafka readstream when decryption fails

Jon LaFlamme created SPARK-36212: Summary: Add exception for Kafka readstream when decryption fails Key: SPARK-36212 URL: https://issues.apache.org/jira/browse/SPARK-36212 Project: Spark

[jira] [Commented] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

[ https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383415#comment-17383415 ] Apache Spark commented on SPARK-36210: -- User 'koertkuipers' has created a pull request for this

[jira] [Assigned] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

[ https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36210: Assignee: (was: Apache Spark) > Preserve column insertion order in

[jira] [Commented] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

[ https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383414#comment-17383414 ] Apache Spark commented on SPARK-36210: -- User 'koertkuipers' has created a pull request for this

[jira] [Assigned] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

[ https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36210: Assignee: Apache Spark > Preserve column insertion order in Dataset.withColumns >

[jira] [Resolved] (SPARK-36093) The result incorrect if the partition path case is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36093. - Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-34806) Helper class for batch Dataset.observe()

[ https://issues.apache.org/jira/browse/SPARK-34806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383394#comment-17383394 ] Apache Spark commented on SPARK-34806: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()

[ https://issues.apache.org/jira/browse/SPARK-36211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36211: Assignee: (was: Apache Spark) > type check fails for

[jira] [Commented] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()

[ https://issues.apache.org/jira/browse/SPARK-36211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383385#comment-17383385 ] Apache Spark commented on SPARK-36211: -- User 'luranhe' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()

[ https://issues.apache.org/jira/browse/SPARK-36211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36211: Assignee: Apache Spark > type check fails for `F.udf(...).asNonDeterministic() >

[jira] [Created] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()

Luran He created SPARK-36211: Summary: type check fails for `F.udf(...).asNonDeterministic() Key: SPARK-36211 URL: https://issues.apache.org/jira/browse/SPARK-36211 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()

[ https://issues.apache.org/jira/browse/SPARK-36211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luran He updated SPARK-36211: - Description: The following code should type-check, but doesn't: {{import uuid}}

[jira] [Updated] (SPARK-36211) type check fails for `F.udf(...).asNonDeterministic()

[ https://issues.apache.org/jira/browse/SPARK-36211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luran He updated SPARK-36211: - Description: The following code should type-check, but doesn't: {{import uuid}}

[jira] [Created] (SPARK-36210) Preserve column insertion order in Dataset.withColumns

koert kuipers created SPARK-36210: - Summary: Preserve column insertion order in Dataset.withColumns Key: SPARK-36210 URL: https://issues.apache.org/jira/browse/SPARK-36210 Project: Spark

[jira] [Commented] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[ https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383355#comment-17383355 ] Apache Spark commented on SPARK-36209: -- User 'dominikgehl' has created a pull request for this

[jira] [Assigned] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[ https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36209: Assignee: Apache Spark > https://spark.apache.org/docs/latest/sql-programming-guide.html

[jira] [Assigned] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[ https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36209: Assignee: (was: Apache Spark) >

[jira] [Commented] (SPARK-36166) Support Scala 2.13 test in `dev/run-tests.py`

[ https://issues.apache.org/jira/browse/SPARK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383354#comment-17383354 ] Apache Spark commented on SPARK-36166: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

[ https://issues.apache.org/jira/browse/SPARK-36209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Gehl updated SPARK-36209: - Description: On https://spark.apache.org/docs/latest/sql-programming-guide.html , the link to

[jira] [Created] (SPARK-36209) https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc

Dominik Gehl created SPARK-36209: Summary: https://spark.apache.org/docs/latest/sql-programming-guide.html contains invalid link to Python doc Key: SPARK-36209 URL:

[jira] [Commented] (SPARK-36208) SparkScriptTransformation should support ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383330#comment-17383330 ] Apache Spark commented on SPARK-36208: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36208) SparkScriptTransformation should support ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36208: Assignee: Kousuke Saruta (was: Apache Spark) > SparkScriptTransformation should support

[jira] [Commented] (SPARK-36208) SparkScriptTransformation should support ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383329#comment-17383329 ] Apache Spark commented on SPARK-36208: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36208) SparkScriptTransformation should support ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36208: Assignee: Apache Spark (was: Kousuke Saruta) > SparkScriptTransformation should support

[jira] [Updated] (SPARK-36208) SparkScriptTransformation should support ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36208: --- Summary: SparkScriptTransformation should support ANSI interval types (was:

[jira] [Commented] (SPARK-36207) Export databaseExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383323#comment-17383323 ] Apache Spark commented on SPARK-36207: -- User 'dominikgehl' has created a pull request for this

[jira] [Updated] (SPARK-36208) SparkScriptTransformation

[ https://issues.apache.org/jira/browse/SPARK-36208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36208: --- Parent: SPARK-27790 Issue Type: Sub-task (was: Bug) > SparkScriptTransformation >

[jira] [Assigned] (SPARK-36207) Export databaseExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36207: Assignee: (was: Apache Spark) > Export databaseExists in pyspark.sql.catalog >

[jira] [Commented] (SPARK-36093) The result incorrect if the partition path case is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383322#comment-17383322 ] Apache Spark commented on SPARK-36093: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36207) Export databaseExists in pyspark.sql.catalog

[ https://issues.apache.org/jira/browse/SPARK-36207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36207: Assignee: Apache Spark > Export databaseExists in pyspark.sql.catalog >

[jira] [Commented] (SPARK-36093) The result incorrect if the partition path case is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383321#comment-17383321 ] Apache Spark commented on SPARK-36093: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-36208) SparkScriptTransformation

Kousuke Saruta created SPARK-36208: -- Summary: SparkScriptTransformation Key: SPARK-36208 URL: https://issues.apache.org/jira/browse/SPARK-36208 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-36207) Export databaseExists in pyspark.sql.catalog

Dominik Gehl created SPARK-36207: Summary: Export databaseExists in pyspark.sql.catalog Key: SPARK-36207 URL: https://issues.apache.org/jira/browse/SPARK-36207 Project: Spark Issue Type:

  1   2   >