[jira] [Resolved] (SPARK-39637) Involve excludedTpcdsQueries in plan related tests

[ https://issues.apache.org/jira/browse/SPARK-39637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39637. - Resolution: Won't Fix > Involve excludedTpcdsQueries in plan related tests >

[jira] [Updated] (SPARK-40140) REST API for SQL level information does not show information on running queries

[ https://issues.apache.org/jira/browse/SPARK-40140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ming95 updated SPARK-40140: --- Attachment: running.png > REST API for SQL level information does not show information on running

[jira] [Commented] (SPARK-40140) REST API for SQL level information does not show information on running queries

[ https://issues.apache.org/jira/browse/SPARK-40140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582460#comment-17582460 ] ming95 commented on SPARK-40140: !running.png! > REST API for SQL level information does not

[jira] [Comment Edited] (SPARK-40140) REST API for SQL level information does not show information on running queries

[ https://issues.apache.org/jira/browse/SPARK-40140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582459#comment-17582459 ] ming95 edited comment on SPARK-40140 at 8/21/22 4:07 AM: - [~yeachan153] 

[jira] [Comment Edited] (SPARK-40140) REST API for SQL level information does not show information on running queries

[ https://issues.apache.org/jira/browse/SPARK-40140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582459#comment-17582459 ] ming95 edited comment on SPARK-40140 at 8/21/22 4:06 AM: - [~yeachan153] 

[jira] [Commented] (SPARK-40140) REST API for SQL level information does not show information on running queries

[ https://issues.apache.org/jira/browse/SPARK-40140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582459#comment-17582459 ] ming95 commented on SPARK-40140: [~yeachan153]    In my test I was able to get running state

[jira] [Commented] (SPARK-40156) url_decode() exposes a Java error

[ https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582458#comment-17582458 ] ming95 commented on SPARK-40156: {noformat} It should the return an ERROR_CLASS{noformat}

[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582457#comment-17582457 ] Shixiong Zhu commented on SPARK-39915: -- Yeah. I would consider this is a bug since the doc of

[jira] [Commented] (SPARK-40159) Aggregate should be group only after collapse project to aggregate

[ https://issues.apache.org/jira/browse/SPARK-40159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582456#comment-17582456 ] Apache Spark commented on SPARK-40159: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40159) Aggregate should be group only after collapse project to aggregate

[ https://issues.apache.org/jira/browse/SPARK-40159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40159: Assignee: (was: Apache Spark) > Aggregate should be group only after collapse

[jira] [Commented] (SPARK-40159) Aggregate should be group only after collapse project to aggregate

[ https://issues.apache.org/jira/browse/SPARK-40159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582455#comment-17582455 ] Apache Spark commented on SPARK-40159: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40159) Aggregate should be group only after collapse project to aggregate

[ https://issues.apache.org/jira/browse/SPARK-40159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40159: Assignee: Apache Spark > Aggregate should be group only after collapse project to

[jira] [Commented] (SPARK-40148) Make pyspark.sql.window examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582454#comment-17582454 ] Qian Sun commented on SPARK-40148: -- [~hyukjin.kwon] Hi, it seems like that it is same with

[jira] [Comment Edited] (SPARK-40148) Make pyspark.sql.window examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582454#comment-17582454 ] Qian Sun edited comment on SPARK-40148 at 8/21/22 3:30 AM: --- [~hyukjin.kwon]

[jira] [Created] (SPARK-40160) Make pyspark.broadcast examples self-contained

Qian Sun created SPARK-40160: Summary: Make pyspark.broadcast examples self-contained Key: SPARK-40160 URL: https://issues.apache.org/jira/browse/SPARK-40160 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40159) Aggregate should be group only after collapse project to aggregate

Wan Kun created SPARK-40159: --- Summary: Aggregate should be group only after collapse project to aggregate Key: SPARK-40159 URL: https://issues.apache.org/jira/browse/SPARK-40159 Project: Spark

[jira] [Commented] (SPARK-40156) url_decode() exposes a Java error

[ https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582452#comment-17582452 ] Serge Rielau commented on SPARK-40156: -- It's new [~Zing] 

[jira] [Commented] (SPARK-40156) url_decode() exposes a Java error

[ https://issues.apache.org/jira/browse/SPARK-40156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582450#comment-17582450 ] ming95 commented on SPARK-40156: [~srielau] `url_decode` is not a udf inside spark, maybe it's

[jira] [Commented] (SPARK-40158) Remove useless configuration & extract common code for parquet read

[ https://issues.apache.org/jira/browse/SPARK-40158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582442#comment-17582442 ] Apache Spark commented on SPARK-40158: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40158) Remove useless configuration & extract common code for parquet read

[ https://issues.apache.org/jira/browse/SPARK-40158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40158: Assignee: Apache Spark > Remove useless configuration & extract common code for parquet

[jira] [Assigned] (SPARK-40158) Remove useless configuration & extract common code for parquet read

[ https://issues.apache.org/jira/browse/SPARK-40158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40158: Assignee: (was: Apache Spark) > Remove useless configuration & extract common code

[jira] [Commented] (SPARK-40158) Remove useless configuration & extract common code for parquet read

[ https://issues.apache.org/jira/browse/SPARK-40158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582441#comment-17582441 ] Apache Spark commented on SPARK-40158: -- User 'panbingkun' has created a pull request for this

[jira] [Updated] (SPARK-40158) Remove useless configuration & extract common code for parquet read

[ https://issues.apache.org/jira/browse/SPARK-40158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-40158: Description: # Remove useless configuration:

[jira] [Created] (SPARK-40158) Remove useless configuration & extract common code for parquet read

BingKun Pan created SPARK-40158: --- Summary: Remove useless configuration & extract common code for parquet read Key: SPARK-40158 URL: https://issues.apache.org/jira/browse/SPARK-40158 Project: Spark

[jira] [Assigned] (SPARK-40157) Make pyspark.files examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40157: - Assignee: Ruifeng Zheng > Make pyspark.files examples self-contained >

[jira] [Created] (SPARK-40157) Make pyspark.files examples self-contained

Ruifeng Zheng created SPARK-40157: - Summary: Make pyspark.files examples self-contained Key: SPARK-40157 URL: https://issues.apache.org/jira/browse/SPARK-40157 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40147) Make pyspark.sql.session examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40147. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37582

[jira] [Assigned] (SPARK-40147) Make pyspark.sql.session examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40147: Assignee: Hyukjin Kwon > Make pyspark.sql.session examples self-contained >

[jira] [Resolved] (SPARK-40111) Make pyspark.rdd examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40111. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37593

[jira] [Created] (SPARK-40156) url_decode() exposes a Java error

Serge Rielau created SPARK-40156: Summary: url_decode() exposes a Java error Key: SPARK-40156 URL: https://issues.apache.org/jira/browse/SPARK-40156 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-40111) Make pyspark.rdd examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40111: Assignee: Ruifeng Zheng (was: Apache Spark) > Make pyspark.rdd examples self-contained

[jira] [Commented] (SPARK-40111) Make pyspark.rdd examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582413#comment-17582413 ] Apache Spark commented on SPARK-40111: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-40111) Make pyspark.rdd examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582412#comment-17582412 ] Apache Spark commented on SPARK-40111: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40111) Make pyspark.rdd examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40111: Assignee: Apache Spark (was: Ruifeng Zheng) > Make pyspark.rdd examples self-contained

[jira] [Comment Edited] (SPARK-39915) Dataset.repartition(N) may not create N partitions

[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582402#comment-17582402 ] Yuming Wang edited comment on SPARK-39915 at 8/20/22 10:41 PM: --- The reason

[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582402#comment-17582402 ] Yuming Wang commented on SPARK-39915: - The reason is that it will return empty local relation since

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582379#comment-17582379 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull request for this

[jira] [Assigned] (SPARK-40142) Make pyspark.sql.functions examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40142: Assignee: Apache Spark > Make pyspark.sql.functions examples self-contained >

[jira] [Assigned] (SPARK-40142) Make pyspark.sql.functions examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40142: Assignee: (was: Apache Spark) > Make pyspark.sql.functions examples self-contained >

[jira] [Resolved] (SPARK-39832) regexp_replace should support column arguments

[ https://issues.apache.org/jira/browse/SPARK-39832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-39832. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-39832) regexp_replace should support column arguments

[ https://issues.apache.org/jira/browse/SPARK-39832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-39832: -- Assignee: Brian Schaefer > regexp_replace should support column arguments >

[jira] [Created] (SPARK-40155) Optionally use a serialized storage level for DataFrame.localCheckpoint()

Paul Staab created SPARK-40155: -- Summary: Optionally use a serialized storage level for DataFrame.localCheckpoint() Key: SPARK-40155 URL: https://issues.apache.org/jira/browse/SPARK-40155 Project: Spark

[jira] [Commented] (SPARK-39971) ANALYZE TABLE makes some queries run forever

[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582211#comment-17582211 ] Yuming Wang commented on SPARK-39971: - It is difficult to read. Could you set

[jira] [Updated] (SPARK-40154) PySpark: DataFrame.cache docstring gives wrong storage level

[ https://issues.apache.org/jira/browse/SPARK-40154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Staab updated SPARK-40154: --- Description: The docstring of the `DataFrame.cache()` method currently states that it uses a

[jira] [Updated] (SPARK-40154) PySpark: DataFrame.cache docstring gives wrong storage level

[ https://issues.apache.org/jira/browse/SPARK-40154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Staab updated SPARK-40154: --- Priority: Minor (was: Major) > PySpark: DataFrame.cache docstring gives wrong storage level >

[jira] [Created] (SPARK-40154) PySpark: DataFrame.cache docstring gives wrong storage level

Paul Staab created SPARK-40154: -- Summary: PySpark: DataFrame.cache docstring gives wrong storage level Key: SPARK-40154 URL: https://issues.apache.org/jira/browse/SPARK-40154 Project: Spark

[jira] [Resolved] (SPARK-40080) Adds additional EliminateSorts before LimitPushDown

[ https://issues.apache.org/jira/browse/SPARK-40080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40080. - Resolution: Duplicate > Adds additional EliminateSorts before LimitPushDown >

[jira] [Commented] (SPARK-33393) Support SHOW TABLE EXTENDED in DSv2

[ https://issues.apache.org/jira/browse/SPARK-33393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582201#comment-17582201 ] Apache Spark commented on SPARK-33393: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40152: Assignee: Apache Spark > Codegen compilation error when using split_part >

[jira] [Assigned] (SPARK-33393) Support SHOW TABLE EXTENDED in DSv2

[ https://issues.apache.org/jira/browse/SPARK-33393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33393: Assignee: (was: Apache Spark) > Support SHOW TABLE EXTENDED in DSv2 >

[jira] [Assigned] (SPARK-33393) Support SHOW TABLE EXTENDED in DSv2

[ https://issues.apache.org/jira/browse/SPARK-33393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33393: Assignee: Apache Spark > Support SHOW TABLE EXTENDED in DSv2 >

[jira] [Commented] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582202#comment-17582202 ] Apache Spark commented on SPARK-40152: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40152) Codegen compilation error when using split_part

[ https://issues.apache.org/jira/browse/SPARK-40152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40152: Assignee: (was: Apache Spark) > Codegen compilation error when using split_part >

[jira] [Assigned] (SPARK-40081) Add Document Parameters for pyspark.sql.streaming.query

[ https://issues.apache.org/jira/browse/SPARK-40081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40081: Assignee: Apache Spark > Add Document Parameters for pyspark.sql.streaming.query >

[jira] [Assigned] (SPARK-40081) Add Document Parameters for pyspark.sql.streaming.query

[ https://issues.apache.org/jira/browse/SPARK-40081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40081: Assignee: (was: Apache Spark) > Add Document Parameters for

[jira] [Commented] (SPARK-40081) Add Document Parameters for pyspark.sql.streaming.query

[ https://issues.apache.org/jira/browse/SPARK-40081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582159#comment-17582159 ] Apache Spark commented on SPARK-40081: -- User 'dcoliversun' has created a pull request for this

[jira] [Commented] (SPARK-40081) Add Document Parameters for pyspark.sql.streaming.query

[ https://issues.apache.org/jira/browse/SPARK-40081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582149#comment-17582149 ] Qian Sun commented on SPARK-40081: -- [~hyukjin.kwon] Yes, I'm working on it > Add Document Parameters