[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340596#comment-17340596 ] Xianghao Lu commented on SPARK-35332: - cc [~maryannxue]  [~cloud_fan] > Not Coalesc

[jira] [Updated] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated SPARK-35332: Description: *How to reproduce the problem* _linux shell command to prepare data:_ for i in $(se

[jira] [Updated] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated SPARK-35332: Description: *How to reproduce the problem* _linux shell command to prepare data_ for i in $(seq

[jira] [Updated] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated SPARK-35332: Description: *How to reproduce the problem* _linux shell command to prepare data:_ for i in $(se

[jira] [Updated] (SPARK-35332) Not Coalesce shuffle partitions when cache table

[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated SPARK-35332: Attachment: cacheTable.png > Not Coalesce shuffle partitions when cache table > --

[jira] [Created] (SPARK-35332) Not Coalesce shuffle partitions when cache table

Xianghao Lu created SPARK-35332: --- Summary: Not Coalesce shuffle partitions when cache table Key: SPARK-35332 URL: https://issues.apache.org/jira/browse/SPARK-35332 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-35331) Attributes become unknown in RepartitionByExpression after aliased

[ https://issues.apache.org/jira/browse/SPARK-35331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35331: Assignee: Apache Spark > Attributes become unknown in RepartitionByExpression after alias

[jira] [Commented] (SPARK-35331) Attributes become unknown in RepartitionByExpression after aliased

[ https://issues.apache.org/jira/browse/SPARK-35331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340547#comment-17340547 ] Apache Spark commented on SPARK-35331: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-35331) Attributes become unknown in RepartitionByExpression after aliased

[ https://issues.apache.org/jira/browse/SPARK-35331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35331: Assignee: (was: Apache Spark) > Attributes become unknown in RepartitionByExpression

[jira] [Issue Comment Deleted] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-35062: --- Comment: was deleted (was: I'm working on.) > Group exception messages in sql/streaming > -

[jira] [Updated] (SPARK-35331) Attributes become unknown in RepartitionByExpression after aliased

[ https://issues.apache.org/jira/browse/SPARK-35331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-35331: - Summary: Attributes become unknown in RepartitionByExpression after aliased (was: Attributes become unk

[jira] [Created] (SPARK-35331) Attributes become unknown for RepartitionByExpression after aliased

Kent Yao created SPARK-35331: Summary: Attributes become unknown for RepartitionByExpression after aliased Key: SPARK-35331 URL: https://issues.apache.org/jira/browse/SPARK-35331 Project: Spark

[jira] [Assigned] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35062: Assignee: Apache Spark > Group exception messages in sql/streaming >

[jira] [Commented] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340545#comment-17340545 ] Apache Spark commented on SPARK-35062: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340546#comment-17340546 ] Apache Spark commented on SPARK-35062: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35062: Assignee: (was: Apache Spark) > Group exception messages in sql/streaming > -

[jira] [Resolved] (SPARK-35133) EXPLAIN CODEGEN does not work with AQE

[ https://issues.apache.org/jira/browse/SPARK-35133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35133. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32430 [https://

[jira] [Assigned] (SPARK-35133) EXPLAIN CODEGEN does not work with AQE

[ https://issues.apache.org/jira/browse/SPARK-35133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35133: - Assignee: Cheng Su > EXPLAIN CODEGEN does not work with AQE > -

[jira] [Commented] (SPARK-35062) Group exception messages in sql/streaming

[ https://issues.apache.org/jira/browse/SPARK-35062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340528#comment-17340528 ] jiaan.geng commented on SPARK-35062: I'm working on. > Group exception messages in

[jira] [Resolved] (SPARK-35306) Add benchmark results for BLASBenchmark created by Github Actions machines

[ https://issues.apache.org/jira/browse/SPARK-35306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35306. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32435 [https://gi

[jira] [Assigned] (SPARK-35306) Add benchmark results for BLASBenchmark created by Github Actions machines

[ https://issues.apache.org/jira/browse/SPARK-35306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35306: Assignee: Byungsoo Oh > Add benchmark results for BLASBenchmark created by Github Actions

[jira] [Commented] (SPARK-35147) Migrate to resolveWithPruning for two command rules

[ https://issues.apache.org/jira/browse/SPARK-35147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340512#comment-17340512 ] Apache Spark commented on SPARK-35147: -- User 'sigmod' has created a pull request fo

[jira] [Assigned] (SPARK-35147) Migrate to resolveWithPruning for two command rules

[ https://issues.apache.org/jira/browse/SPARK-35147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35147: Assignee: Apache Spark > Migrate to resolveWithPruning for two command rules > --

[jira] [Commented] (SPARK-35147) Migrate to resolveWithPruning for two command rules

[ https://issues.apache.org/jira/browse/SPARK-35147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340511#comment-17340511 ] Apache Spark commented on SPARK-35147: -- User 'sigmod' has created a pull request fo

[jira] [Assigned] (SPARK-35147) Migrate to resolveWithPruning for two command rules

[ https://issues.apache.org/jira/browse/SPARK-35147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35147: Assignee: (was: Apache Spark) > Migrate to resolveWithPruning for two command rules >

[jira] [Commented] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340504#comment-17340504 ] Apache Spark commented on SPARK-35293: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340502#comment-17340502 ] Apache Spark commented on SPARK-35293: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340503#comment-17340503 ] Apache Spark commented on SPARK-35293: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35192) Port minimal TPC-DS datagen code from databricks/spark-sql-perf

[ https://issues.apache.org/jira/browse/SPARK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340501#comment-17340501 ] Apache Spark commented on SPARK-35192: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35192) Port minimal TPC-DS datagen code from databricks/spark-sql-perf

[ https://issues.apache.org/jira/browse/SPARK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340500#comment-17340500 ] Apache Spark commented on SPARK-35192: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-34795) Adds a new job in GitHub Actions to check the output of TPC-DS queries

[ https://issues.apache.org/jira/browse/SPARK-34795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340498#comment-17340498 ] Apache Spark commented on SPARK-34795: -- User 'maropu' has created a pull request fo

[jira] [Resolved] (SPARK-34226) Reduce RepartitionOperation num partitions to its child max row

[ https://issues.apache.org/jira/browse/SPARK-34226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you resolved SPARK-34226. - Resolution: Won't Fix > Reduce RepartitionOperation num partitions to its child max row > --

[jira] [Updated] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35327: - Summary: Filters out the TPC-DS queries that can cause flaky test results (was: Merge s

[jira] [Updated] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35327: - Description: This ticket aims at filtering out TPCDS v1.4 q6 and q75 in `TPCDSQueryTest

[jira] [Commented] (SPARK-35147) Migrate to resolveWithPruning for two command rules

[ https://issues.apache.org/jira/browse/SPARK-35147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340491#comment-17340491 ] Yingyi Bu commented on SPARK-35147: --- I'm WIP on this issue. > Migrate to resolveWithP

[jira] [Assigned] (SPARK-35146) Migrate to transformWithPruning or resolveWithPruning for rules in finishAnalysis

[ https://issues.apache.org/jira/browse/SPARK-35146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35146: Assignee: (was: Apache Spark) > Migrate to transformWithPruning or resolveWithPruning

[jira] [Commented] (SPARK-35146) Migrate to transformWithPruning or resolveWithPruning for rules in finishAnalysis

[ https://issues.apache.org/jira/browse/SPARK-35146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340490#comment-17340490 ] Apache Spark commented on SPARK-35146: -- User 'sigmod' has created a pull request fo

[jira] [Assigned] (SPARK-35146) Migrate to transformWithPruning or resolveWithPruning for rules in finishAnalysis

[ https://issues.apache.org/jira/browse/SPARK-35146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35146: Assignee: Apache Spark > Migrate to transformWithPruning or resolveWithPruning for rules

[jira] [Commented] (SPARK-35146) Migrate to transformWithPruning or resolveWithPruning for rules in finishAnalysis

[ https://issues.apache.org/jira/browse/SPARK-35146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340489#comment-17340489 ] Yingyi Bu commented on SPARK-35146: --- I'm WIP on this. > Migrate to transformWithPruni

[jira] [Commented] (SPARK-35253) Upgrade Janino from 3.0.16 to 3.1.4

[ https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340486#comment-17340486 ] Apache Spark commented on SPARK-35253: -- User 'maropu' has created a pull request fo

[jira] [Updated] (SPARK-35253) Upgrade Janino from 3.0.16 to 3.1.4

[ https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-35253: - Summary: Upgrade Janino from 3.0.16 to 3.1.4 (was: Upgrade Janino from 3.0.x to 3.1.x)

[jira] [Commented] (SPARK-35133) EXPLAIN CODEGEN does not work with AQE

[ https://issues.apache.org/jira/browse/SPARK-35133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340476#comment-17340476 ] Dongjoon Hyun commented on SPARK-35133: --- Thank you, [~chengsu] and all. I collecte

[jira] [Updated] (SPARK-35133) EXPLAIN CODEGEN does not work with AQE

[ https://issues.apache.org/jira/browse/SPARK-35133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35133: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > EXPLAIN CODEGEN does not work w

[jira] [Commented] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340455#comment-17340455 ] Apache Spark commented on SPARK-35293: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-30466) remove dependency on jackson-mapper-asl-1.9.13 and jackson-core-asl-1.9.13

[ https://issues.apache.org/jira/browse/SPARK-30466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340428#comment-17340428 ] Steven commented on SPARK-30466: Is it possible this could be added to Spark 3.2?  Like

[jira] [Commented] (SPARK-26164) [SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

[ https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340296#comment-17340296 ] Apache Spark commented on SPARK-26164: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-35326) Upgrade Jersey to 2.34

[ https://issues.apache.org/jira/browse/SPARK-35326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340270#comment-17340270 ] Apache Spark commented on SPARK-35326: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-35326) Upgrade Jersey to 2.34

[ https://issues.apache.org/jira/browse/SPARK-35326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35326. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32453 [https://

[jira] [Created] (SPARK-35330) Tune shuffle requests frequency dynamically in the case of Netty OOM

wuyi created SPARK-35330: Summary: Tune shuffle requests frequency dynamically in the case of Netty OOM Key: SPARK-35330 URL: https://issues.apache.org/jira/browse/SPARK-35330 Project: Spark Issue T

[jira] [Assigned] (SPARK-35329) Split generated switch code into pieces in ExpandExec

[ https://issues.apache.org/jira/browse/SPARK-35329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35329: Assignee: (was: Apache Spark) > Split generated switch code into pieces in ExpandExec

[jira] [Assigned] (SPARK-35329) Split generated switch code into pieces in ExpandExec

[ https://issues.apache.org/jira/browse/SPARK-35329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35329: Assignee: Apache Spark > Split generated switch code into pieces in ExpandExec >

[jira] [Commented] (SPARK-35329) Split generated switch code into pieces in ExpandExec

[ https://issues.apache.org/jira/browse/SPARK-35329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340256#comment-17340256 ] Apache Spark commented on SPARK-35329: -- User 'maropu' has created a pull request fo

[jira] [Created] (SPARK-35329) Split generated switch code into pieces in ExpandExec

Takeshi Yamamuro created SPARK-35329: Summary: Split generated switch code into pieces in ExpandExec Key: SPARK-35329 URL: https://issues.apache.org/jira/browse/SPARK-35329 Project: Spark

[jira] [Commented] (SPARK-35328) Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default

[ https://issues.apache.org/jira/browse/SPARK-35328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340236#comment-17340236 ] Apache Spark commented on SPARK-35328: -- User 'sharkdtu' has created a pull request

[jira] [Commented] (SPARK-35328) Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default

[ https://issues.apache.org/jira/browse/SPARK-35328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340238#comment-17340238 ] Apache Spark commented on SPARK-35328: -- User 'sharkdtu' has created a pull request

[jira] [Assigned] (SPARK-35328) Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default

[ https://issues.apache.org/jira/browse/SPARK-35328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35328: Assignee: (was: Apache Spark) > Use 'SPARK_LOG_URL_' as env prefix for getting driver

[jira] [Assigned] (SPARK-35328) Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default

[ https://issues.apache.org/jira/browse/SPARK-35328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35328: Assignee: Apache Spark > Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls b

[jira] [Created] (SPARK-35328) Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default

sharkd tu created SPARK-35328: - Summary: Use 'SPARK_LOG_URL_' as env prefix for getting driver log urls by default Key: SPARK-35328 URL: https://issues.apache.org/jira/browse/SPARK-35328 Project: Spark

[jira] [Assigned] (SPARK-35327) Merge similar v1.4/v2.7 TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35327: Assignee: (was: Apache Spark) > Merge similar v1.4/v2.7 TPCDS queries > -

[jira] [Assigned] (SPARK-35327) Merge similar v1.4/v2.7 TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35327: Assignee: Apache Spark > Merge similar v1.4/v2.7 TPCDS queries >

[jira] [Commented] (SPARK-35327) Merge similar v1.4/v2.7 TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340227#comment-17340227 ] Apache Spark commented on SPARK-35327: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35327) Merge similar v1.4/v2.7 TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340226#comment-17340226 ] Apache Spark commented on SPARK-35327: -- User 'maropu' has created a pull request fo

[jira] [Created] (SPARK-35327) Merge similar v1.4/v2.7 TPCDS queries

Takeshi Yamamuro created SPARK-35327: Summary: Merge similar v1.4/v2.7 TPCDS queries Key: SPARK-35327 URL: https://issues.apache.org/jira/browse/SPARK-35327 Project: Spark Issue Type: Tes

[jira] [Resolved] (SPARK-34526) Skip checking glob path in FileStreamSink.hasMetadata

[ https://issues.apache.org/jira/browse/SPARK-34526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-34526. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31638 [https://gi

[jira] [Assigned] (SPARK-34526) Skip checking glob path in FileStreamSink.hasMetadata

[ https://issues.apache.org/jira/browse/SPARK-34526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-34526: Assignee: Yuanjian Li > Skip checking glob path in FileStreamSink.hasMetadata > -

[jira] [Resolved] (SPARK-35215) Update custom metrics per certain rows

[ https://issues.apache.org/jira/browse/SPARK-35215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35215. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32330 [https://gith

[jira] [Commented] (SPARK-35326) Upgrade Jersey to 2.34

[ https://issues.apache.org/jira/browse/SPARK-35326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340197#comment-17340197 ] Apache Spark commented on SPARK-35326: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-35326) Upgrade Jersey to 2.34

[ https://issues.apache.org/jira/browse/SPARK-35326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340196#comment-17340196 ] Apache Spark commented on SPARK-35326: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35326) Upgrade Jersey to 2.34

[ https://issues.apache.org/jira/browse/SPARK-35326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35326: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade Jersey to 2.34 >

[jira] [Assigned] (SPARK-35326) Upgrade Jersey to 2.34

[ https://issues.apache.org/jira/browse/SPARK-35326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35326: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade Jersey to 2.34 >

[jira] [Created] (SPARK-35326) Upgrade Jersey to 2.34

Kousuke Saruta created SPARK-35326: -- Summary: Upgrade Jersey to 2.34 Key: SPARK-35326 URL: https://issues.apache.org/jira/browse/SPARK-35326 Project: Spark Issue Type: Bug Componen

[jira] [Updated] (SPARK-35160) Spark application submitted despite failing to get Hive delegation token

[ https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-35160: --- Description: Currently, when running on YARN and failing to get Hive delegation token, a Spark SQL

[jira] [Updated] (SPARK-35273) CombineFilters support non-deterministic expressions

[ https://issues.apache.org/jira/browse/SPARK-35273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35273: Description: For example: {code:scala} spark.sql("create table t1(id int) using parquet") spark.sq

[jira] [Commented] (SPARK-35243) Support columnar execution on ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-35243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340119#comment-17340119 ] Apache Spark commented on SPARK-35243: -- User 'Peng-Lei' has created a pull request

[jira] [Assigned] (SPARK-35243) Support columnar execution on ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-35243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35243: Assignee: (was: Apache Spark) > Support columnar execution on ANSI interval types > -

[jira] [Assigned] (SPARK-35243) Support columnar execution on ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-35243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35243: Assignee: Apache Spark > Support columnar execution on ANSI interval types >

[jira] [Comment Edited] (SPARK-32007) Spark Driver Supervise does not work reliably

[ https://issues.apache.org/jira/browse/SPARK-32007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340103#comment-17340103 ] Alexandre CLEMENT edited comment on SPARK-32007 at 5/6/21, 9:07 AM: --

[jira] [Commented] (SPARK-32007) Spark Driver Supervise does not work reliably

[ https://issues.apache.org/jira/browse/SPARK-32007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340103#comment-17340103 ] Alexandre CLEMENT commented on SPARK-32007: --- {{[~EveLiao] Here are the logs af

[jira] [Resolved] (SPARK-35240) Use CheckpointFileManager for checkpoint manipulation

[ https://issues.apache.org/jira/browse/SPARK-35240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35240. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32361 [https://gith

[jira] [Resolved] (SPARK-35318) View internal properties should be hidden for describe table command

[ https://issues.apache.org/jira/browse/SPARK-35318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35318. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32441 [https://gith

[jira] [Assigned] (SPARK-35318) View internal properties should be hidden for describe table command

[ https://issues.apache.org/jira/browse/SPARK-35318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35318: --- Assignee: Linhong Liu > View internal properties should be hidden for describe table comman

[jira] [Assigned] (SPARK-35144) Migrate to transformWithPruning or resolveWithPruning for object rules

[ https://issues.apache.org/jira/browse/SPARK-35144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35144: Assignee: (was: Apache Spark) > Migrate to transformWithPruning or resolveWithPruning

[jira] [Commented] (SPARK-35144) Migrate to transformWithPruning or resolveWithPruning for object rules

[ https://issues.apache.org/jira/browse/SPARK-35144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340042#comment-17340042 ] Apache Spark commented on SPARK-35144: -- User 'sigmod' has created a pull request fo

[jira] [Assigned] (SPARK-35144) Migrate to transformWithPruning or resolveWithPruning for object rules

[ https://issues.apache.org/jira/browse/SPARK-35144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35144: Assignee: Apache Spark > Migrate to transformWithPruning or resolveWithPruning for object

[jira] [Commented] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340038#comment-17340038 ] Nick Hryhoriev commented on SPARK-34204: I write every simple code to avoid it,

[jira] [Commented] (SPARK-35144) Migrate to transformWithPruning or resolveWithPruning for object rules

[ https://issues.apache.org/jira/browse/SPARK-35144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340035#comment-17340035 ] Yingyi Bu commented on SPARK-35144: --- I'm WIP on this issue. > Migrate to transformWit