[jira] [Resolved] (SPARK-39144) Nested subquery expressions deduplicate relations should be done bottom up

[ https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39144. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36503

[jira] [Assigned] (SPARK-39144) Nested subquery expressions deduplicate relations should be done bottom up

[ https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39144: --- Assignee: Rui Wang > Nested subquery expressions deduplicate relations should be done

[jira] [Resolved] (SPARK-39266) Cleanup unused spark.rpc.numRetries and spark.rpc.retry.wait configs

[ https://issues.apache.org/jira/browse/SPARK-39266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39266. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36645

[jira] [Commented] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541266#comment-17541266 ] Apache Spark commented on SPARK-39253: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39253: Assignee: Apache Spark > Improve PySpark API reference to be more readable >

[jira] [Assigned] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39253: Assignee: (was: Apache Spark) > Improve PySpark API reference to be more readable >

[jira] [Commented] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541265#comment-17541265 ] Apache Spark commented on SPARK-39253: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39264) Add explicit type checks and casting for awaitOffset fix

[ https://issues.apache.org/jira/browse/SPARK-39264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39264: Assignee: Anish Shrigondekar > Add explicit type checks and casting for awaitOffset fix

[jira] [Resolved] (SPARK-39264) Add explicit type checks and casting for awaitOffset fix

[ https://issues.apache.org/jira/browse/SPARK-39264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39264. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36642

[jira] [Commented] (SPARK-39267) Clean up dsl unnecessary symbol

[ https://issues.apache.org/jira/browse/SPARK-39267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541253#comment-17541253 ] Apache Spark commented on SPARK-39267: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-39267) Clean up dsl unnecessary symbol

[ https://issues.apache.org/jira/browse/SPARK-39267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541252#comment-17541252 ] Apache Spark commented on SPARK-39267: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39267) Clean up dsl unnecessary symbol

[ https://issues.apache.org/jira/browse/SPARK-39267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39267: Assignee: (was: Apache Spark) > Clean up dsl unnecessary symbol >

[jira] [Assigned] (SPARK-39267) Clean up dsl unnecessary symbol

[ https://issues.apache.org/jira/browse/SPARK-39267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39267: Assignee: Apache Spark > Clean up dsl unnecessary symbol >

[jira] [Updated] (SPARK-39259) Timestamps returned by now() and equivalent functions are not consistent in subqueries

[ https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39259: - Target Version/s: (was: 3.2.2) > Timestamps returned by now() and equivalent functions are

[jira] [Assigned] (SPARK-39189) interpolate supports limit_area

[ https://issues.apache.org/jira/browse/SPARK-39189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39189: Assignee: zhengruifeng > interpolate supports limit_area >

[jira] [Resolved] (SPARK-39189) interpolate supports limit_area

[ https://issues.apache.org/jira/browse/SPARK-39189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39189. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36555

[jira] [Created] (SPARK-39267) Clean up dsl unnecessary symbol

XiDuo You created SPARK-39267: - Summary: Clean up dsl unnecessary symbol Key: SPARK-39267 URL: https://issues.apache.org/jira/browse/SPARK-39267 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39266) Cleanup unused spark.rpc.numRetries and spark.rpc.retry.wait configs

[ https://issues.apache.org/jira/browse/SPARK-39266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541223#comment-17541223 ] Apache Spark commented on SPARK-39266: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-39266) Cleanup unused spark.rpc.numRetries and spark.rpc.retry.wait configs

[ https://issues.apache.org/jira/browse/SPARK-39266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541220#comment-17541220 ] Apache Spark commented on SPARK-39266: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified

[ https://issues.apache.org/jira/browse/SPARK-37523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541219#comment-17541219 ] Apache Spark commented on SPARK-37523: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified

[ https://issues.apache.org/jira/browse/SPARK-37523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541218#comment-17541218 ] Apache Spark commented on SPARK-37523: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-39265) Support Parquet file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541214#comment-17541214 ] Apache Spark commented on SPARK-39265: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-39265) Support Parquet file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541213#comment-17541213 ] Apache Spark commented on SPARK-39265: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39265) Support Parquet file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39265: Assignee: (was: Apache Spark) > Support Parquet file scans with DEFAULT values >

[jira] [Assigned] (SPARK-39265) Support Parquet file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39265: Assignee: Apache Spark > Support Parquet file scans with DEFAULT values >

[jira] [Created] (SPARK-39266) Cleanup unused spark.rpc.numRetries and spark.rpc.retry.wait configs

Josh Rosen created SPARK-39266: -- Summary: Cleanup unused spark.rpc.numRetries and spark.rpc.retry.wait configs Key: SPARK-39266 URL: https://issues.apache.org/jira/browse/SPARK-39266 Project: Spark

[jira] [Commented] (SPARK-39245) Support Avro file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541210#comment-17541210 ] Apache Spark commented on SPARK-39245: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Created] (SPARK-39265) Support Parquet file scans with DEFAULT values

Daniel created SPARK-39265: -- Summary: Support Parquet file scans with DEFAULT values Key: SPARK-39265 URL: https://issues.apache.org/jira/browse/SPARK-39265 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-39264) Add explicit type checks and casting for awaitOffset fix

[ https://issues.apache.org/jira/browse/SPARK-39264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39264: Assignee: (was: Apache Spark) > Add explicit type checks and casting for awaitOffset

[jira] [Assigned] (SPARK-39264) Add explicit type checks and casting for awaitOffset fix

[ https://issues.apache.org/jira/browse/SPARK-39264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39264: Assignee: Apache Spark > Add explicit type checks and casting for awaitOffset fix >

[jira] [Commented] (SPARK-39264) Add explicit type checks and casting for awaitOffset fix

[ https://issues.apache.org/jira/browse/SPARK-39264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541203#comment-17541203 ] Apache Spark commented on SPARK-39264: -- User 'anishshri-db' has created a pull request for this

[jira] [Commented] (SPARK-39264) Add explicit type checks and casting for awaitOffset fix

[ https://issues.apache.org/jira/browse/SPARK-39264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541194#comment-17541194 ] Anish Shrigondekar commented on SPARK-39264: Based on Alex's comments post merge. Will send

[jira] [Created] (SPARK-39264) Add explicit type checks and casting for awaitOffset fix

Anish Shrigondekar created SPARK-39264: -- Summary: Add explicit type checks and casting for awaitOffset fix Key: SPARK-39264 URL: https://issues.apache.org/jira/browse/SPARK-39264 Project: Spark

[jira] [Resolved] (SPARK-39245) Support Avro file scans with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-39245. Resolution: Won't Do It appears Spark does not allow ALTER ADD COLUMN DML with Avro tables. Closing this

[jira] [Assigned] (SPARK-39263) GetTable, TableExists and DatabaseExists

[ https://issues.apache.org/jira/browse/SPARK-39263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39263: Assignee: Apache Spark > GetTable, TableExists and DatabaseExists >

[jira] [Assigned] (SPARK-39263) GetTable, TableExists and DatabaseExists

[ https://issues.apache.org/jira/browse/SPARK-39263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39263: Assignee: (was: Apache Spark) > GetTable, TableExists and DatabaseExists >

[jira] [Commented] (SPARK-39263) GetTable, TableExists and DatabaseExists

[ https://issues.apache.org/jira/browse/SPARK-39263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541184#comment-17541184 ] Apache Spark commented on SPARK-39263: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-39263) GetTable, TableExists and DatabaseExists

Rui Wang created SPARK-39263: Summary: GetTable, TableExists and DatabaseExists Key: SPARK-39263 URL: https://issues.apache.org/jira/browse/SPARK-39263 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-39260) Use `Reader.getSchema` instead of `Reader.getTypes`

[ https://issues.apache.org/jira/browse/SPARK-39260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39260. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36638

[jira] [Assigned] (SPARK-39260) Use `Reader.getSchema` instead of `Reader.getTypes`

[ https://issues.apache.org/jira/browse/SPARK-39260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39260: - Assignee: Dongjoon Hyun > Use `Reader.getSchema` instead of `Reader.getTypes` >

[jira] [Resolved] (SPARK-39258) Fix `Hide credentials in show create table` after SPARK-35378

[ https://issues.apache.org/jira/browse/SPARK-39258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39258. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-39258) Fix `Hide credentials in show create table` after SPARK-35378

[ https://issues.apache.org/jira/browse/SPARK-39258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39258: - Assignee: Yang Jie > Fix `Hide credentials in show create table` after SPARK-35378 >

[jira] [Assigned] (SPARK-39262) Correct error messages when creating DataFrame from an RDD with the first element `0`

[ https://issues.apache.org/jira/browse/SPARK-39262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39262: Assignee: Apache Spark > Correct error messages when creating DataFrame from an RDD with

[jira] [Assigned] (SPARK-39262) Correct error messages when creating DataFrame from an RDD with the first element `0`

[ https://issues.apache.org/jira/browse/SPARK-39262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39262: Assignee: (was: Apache Spark) > Correct error messages when creating DataFrame from

[jira] [Commented] (SPARK-39262) Correct error messages when creating DataFrame from an RDD with the first element `0`

[ https://issues.apache.org/jira/browse/SPARK-39262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541103#comment-17541103 ] Apache Spark commented on SPARK-39262: -- User 'xinrong-databricks' has created a pull request for

[jira] [Updated] (SPARK-39262) Correct error messages when creating DataFrame from an RDD with the first element `0`

[ https://issues.apache.org/jira/browse/SPARK-39262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39262: - Description: Correct error messages when creating DataFrame from an RDD with the first element

[jira] [Updated] (SPARK-39262) Correct error messages when creating DataFrame from an RDD with the first element `0`

[ https://issues.apache.org/jira/browse/SPARK-39262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39262: - Summary: Correct error messages when creating DataFrame from an RDD with the first element `0`

[jira] [Created] (SPARK-39262) Correct error messages when creating DataFrame from an RDD with the first row is `0`

Xinrong Meng created SPARK-39262: Summary: Correct error messages when creating DataFrame from an RDD with the first row is `0` Key: SPARK-39262 URL: https://issues.apache.org/jira/browse/SPARK-39262

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541070#comment-17541070 ] Parth Chandra commented on SPARK-38954: --- The flow would be like this (using AWS as an example) - 

[jira] [Assigned] (SPARK-39261) Improve newline formatting for error messages

[ https://issues.apache.org/jira/browse/SPARK-39261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39261: Assignee: (was: Apache Spark) > Improve newline formatting for error messages >

[jira] [Commented] (SPARK-39261) Improve newline formatting for error messages

[ https://issues.apache.org/jira/browse/SPARK-39261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541067#comment-17541067 ] Apache Spark commented on SPARK-39261: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39261) Improve newline formatting for error messages

[ https://issues.apache.org/jira/browse/SPARK-39261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39261: Assignee: Apache Spark > Improve newline formatting for error messages >

[jira] [Created] (SPARK-39261) Improve newline formatting for error messages

Karen Feng created SPARK-39261: -- Summary: Improve newline formatting for error messages Key: SPARK-39261 URL: https://issues.apache.org/jira/browse/SPARK-39261 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39260) Use `Reader.getSchema` instead of `Reader.getTypes`

[ https://issues.apache.org/jira/browse/SPARK-39260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39260: Assignee: Apache Spark > Use `Reader.getSchema` instead of `Reader.getTypes` >

[jira] [Commented] (SPARK-39260) Use `Reader.getSchema` instead of `Reader.getTypes`

[ https://issues.apache.org/jira/browse/SPARK-39260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541033#comment-17541033 ] Apache Spark commented on SPARK-39260: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39260) Use `Reader.getSchema` instead of `Reader.getTypes`

[ https://issues.apache.org/jira/browse/SPARK-39260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39260: Assignee: (was: Apache Spark) > Use `Reader.getSchema` instead of `Reader.getTypes`

[jira] [Created] (SPARK-39260) Use `Reader.getSchema` instead of `Reader.getTypes`

Dongjoon Hyun created SPARK-39260: - Summary: Use `Reader.getSchema` instead of `Reader.getTypes` Key: SPARK-39260 URL: https://issues.apache.org/jira/browse/SPARK-39260 Project: Spark Issue

[jira] [Commented] (SPARK-39259) Timestamps returned by now() and equivalent functions are not consistent in subqueries

[ https://issues.apache.org/jira/browse/SPARK-39259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541026#comment-17541026 ] Jan-Ole Sasse commented on SPARK-39259: --- I will create a PR to fix this in the upcoming days >

[jira] [Created] (SPARK-39259) Timestamps returned by now() and equivalent functions are not consistent in subqueries

Jan-Ole Sasse created SPARK-39259: - Summary: Timestamps returned by now() and equivalent functions are not consistent in subqueries Key: SPARK-39259 URL: https://issues.apache.org/jira/browse/SPARK-39259

[jira] [Commented] (SPARK-35378) Eagerly execute commands in QueryExecution instead of caller sides

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541015#comment-17541015 ] Apache Spark commented on SPARK-35378: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-35378) Eagerly execute commands in QueryExecution instead of caller sides

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541014#comment-17541014 ] Apache Spark commented on SPARK-35378: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-35378) Eagerly execute commands in QueryExecution instead of caller sides

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541012#comment-17541012 ] Apache Spark commented on SPARK-35378: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39258) Fix `Hide credentials in show create table` after SPARK-35378

[ https://issues.apache.org/jira/browse/SPARK-39258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541011#comment-17541011 ] Apache Spark commented on SPARK-39258: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39258) Fix `Hide credentials in show create table` after SPARK-35378

[ https://issues.apache.org/jira/browse/SPARK-39258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541010#comment-17541010 ] Apache Spark commented on SPARK-39258: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39258) Fix `Hide credentials in show create table` after SPARK-35378

[ https://issues.apache.org/jira/browse/SPARK-39258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39258: Assignee: (was: Apache Spark) > Fix `Hide credentials in show create table` after

[jira] [Assigned] (SPARK-39258) Fix `Hide credentials in show create table` after SPARK-35378

[ https://issues.apache.org/jira/browse/SPARK-39258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39258: Assignee: Apache Spark > Fix `Hide credentials in show create table` after SPARK-35378 >

[jira] [Created] (SPARK-39258) Fix `Hide credentials in show create table` after SPARK-35378

Yang Jie created SPARK-39258: Summary: Fix `Hide credentials in show create table` after SPARK-35378 Key: SPARK-39258 URL: https://issues.apache.org/jira/browse/SPARK-39258 Project: Spark Issue

[jira] [Created] (SPARK-39257) use spark.read.jdbc() to read data from SQL databse into dataframe, it fails silently, when the session is killed from SQL server side

Xinran Tao created SPARK-39257: -- Summary: use spark.read.jdbc() to read data from SQL databse into dataframe, it fails silently, when the session is killed from SQL server side Key: SPARK-39257 URL:

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541002#comment-17541002 ] Steve Loughran commented on SPARK-38954: what is the strategy for having the workers get the

[jira] [Resolved] (SPARK-38869) Respect Table capability `ACCEPT_ANY_SCHEMA` in default column resolution

[ https://issues.apache.org/jira/browse/SPARK-38869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38869. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36475

[jira] [Resolved] (SPARK-38687) Use error classes in the compilation errors of generators

[ https://issues.apache.org/jira/browse/SPARK-38687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38687. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36617

[jira] [Assigned] (SPARK-38687) Use error classes in the compilation errors of generators

[ https://issues.apache.org/jira/browse/SPARK-38687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38687: Assignee: panbingkun > Use error classes in the compilation errors of generators >

[jira] [Resolved] (SPARK-39129) impl Groupby.ewm

[ https://issues.apache.org/jira/browse/SPARK-39129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-39129. -- Resolution: Resolved Resolved by https://github.com/apache/spark/pull/36486 > impl

[jira] [Commented] (SPARK-39246) Implement Groupby.skew

[ https://issues.apache.org/jira/browse/SPARK-39246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540881#comment-17540881 ] zhengruifeng commented on SPARK-39246: -- Thanks [~Qin Yao] ! > Implement Groupby.skew >

[jira] [Resolved] (SPARK-39246) Implement Groupby.skew

[ https://issues.apache.org/jira/browse/SPARK-39246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-39246. -- Fix Version/s: 3.4.0 Assignee: zhengruifeng Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-38897) DS V2 supports push down string functions

[ https://issues.apache.org/jira/browse/SPARK-38897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38897. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36330

[jira] [Assigned] (SPARK-38897) DS V2 supports push down string functions

[ https://issues.apache.org/jira/browse/SPARK-38897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38897: --- Assignee: Zhixiong Chen > DS V2 supports push down string functions >

[jira] [Assigned] (SPARK-39256) Reduce multiple file attribute calls of JavaUtils#deleteRecursivelyUsingJavaIO

[ https://issues.apache.org/jira/browse/SPARK-39256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39256: Assignee: Apache Spark > Reduce multiple file attribute calls of

[jira] [Assigned] (SPARK-39256) Reduce multiple file attribute calls of JavaUtils#deleteRecursivelyUsingJavaIO

[ https://issues.apache.org/jira/browse/SPARK-39256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39256: Assignee: (was: Apache Spark) > Reduce multiple file attribute calls of

[jira] [Commented] (SPARK-39256) Reduce multiple file attribute calls of JavaUtils#deleteRecursivelyUsingJavaIO

[ https://issues.apache.org/jira/browse/SPARK-39256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540854#comment-17540854 ] Apache Spark commented on SPARK-39256: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-39256) Reduce multiple file attribute calls of JavaUtils#deleteRecursivelyUsingJavaIO

Yang Jie created SPARK-39256: Summary: Reduce multiple file attribute calls of JavaUtils#deleteRecursivelyUsingJavaIO Key: SPARK-39256 URL: https://issues.apache.org/jira/browse/SPARK-39256 Project:

[jira] [Comment Edited] (SPARK-38934) Provider TemporaryAWSCredentialsProvider has no credentials

[ https://issues.apache.org/jira/browse/SPARK-38934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540848#comment-17540848 ] Lily Kim edited comment on SPARK-38934 at 5/23/22 9:14 AM: --- Unfortunately,

[jira] [Commented] (SPARK-38934) Provider TemporaryAWSCredentialsProvider has no credentials

[ https://issues.apache.org/jira/browse/SPARK-38934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540848#comment-17540848 ] Lily Kim commented on SPARK-38934: -- Unfortunately, mine only sets temporary AWS credentials on spark

[jira] [Commented] (SPARK-39255) Improve error messages

[ https://issues.apache.org/jira/browse/SPARK-39255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540840#comment-17540840 ] Apache Spark commented on SPARK-39255: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39255) Improve error messages

[ https://issues.apache.org/jira/browse/SPARK-39255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39255: Assignee: Apache Spark > Improve error messages > -- > >

[jira] [Commented] (SPARK-39255) Improve error messages

[ https://issues.apache.org/jira/browse/SPARK-39255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540839#comment-17540839 ] Apache Spark commented on SPARK-39255: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39255) Improve error messages

[ https://issues.apache.org/jira/browse/SPARK-39255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39255: Assignee: (was: Apache Spark) > Improve error messages > -- > >

[jira] [Updated] (SPARK-39255) Improve error messages

[ https://issues.apache.org/jira/browse/SPARK-39255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39255: - Description: Improve the following error messages: 1. NON_PARTITION_COLUMN 2. UNSUPPORTED_SAVE_MODE 3.

[jira] [Created] (SPARK-39255) Improve error messages

Max Gekk created SPARK-39255: Summary: Improve error messages Key: SPARK-39255 URL: https://issues.apache.org/jira/browse/SPARK-39255 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-39254) Upgrade ZSTD-JNI to 1.5.2-3

[ https://issues.apache.org/jira/browse/SPARK-39254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540826#comment-17540826 ] Apache Spark commented on SPARK-39254: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39254) Upgrade ZSTD-JNI to 1.5.2-3

[ https://issues.apache.org/jira/browse/SPARK-39254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39254: Assignee: Apache Spark > Upgrade ZSTD-JNI to 1.5.2-3 > > >

[jira] [Assigned] (SPARK-39254) Upgrade ZSTD-JNI to 1.5.2-3

[ https://issues.apache.org/jira/browse/SPARK-39254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39254: Assignee: (was: Apache Spark) > Upgrade ZSTD-JNI to 1.5.2-3 >

[jira] [Updated] (SPARK-39092) Propagate Empty Partitions

[ https://issues.apache.org/jira/browse/SPARK-39092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-39092: - Attachment: PropagateEmptyPartitions.pdf > Propagate Empty Partitions >

[jira] [Created] (SPARK-39254) Upgrade ZSTD-JNI to 1.5.2-3

Yang Jie created SPARK-39254: Summary: Upgrade ZSTD-JNI to 1.5.2-3 Key: SPARK-39254 URL: https://issues.apache.org/jira/browse/SPARK-39254 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-39253: Description: Currently, the PySpark documentation especially ["Spark SQL"

[jira] [Updated] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-39253: Description: Currently, the PySpark documentation especially ["Spark SQL"

[jira] [Commented] (SPARK-39253) Improve PySpark API reference to be more readable

[ https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540809#comment-17540809 ] Haejoon Lee commented on SPARK-39253: - I'm working on this > Improve PySpark API reference to be

[jira] [Created] (SPARK-39253) Improve PySpark API reference to be more readable

Haejoon Lee created SPARK-39253: --- Summary: Improve PySpark API reference to be more readable Key: SPARK-39253 URL: https://issues.apache.org/jira/browse/SPARK-39253 Project: Spark Issue Type: